WO2017156880A1 - 一种终端音频参数管理方法、装置及系统 - Google Patents

一种终端音频参数管理方法、装置及系统 Download PDF

Info

Publication number
WO2017156880A1
WO2017156880A1 PCT/CN2016/083687 CN2016083687W WO2017156880A1 WO 2017156880 A1 WO2017156880 A1 WO 2017156880A1 CN 2016083687 W CN2016083687 W CN 2016083687W WO 2017156880 A1 WO2017156880 A1 WO 2017156880A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
terminal
waveform
difference point
point combination
Prior art date
Application number
PCT/CN2016/083687
Other languages
English (en)
French (fr)
Inventor
王笑飞
蒋晓
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to EP16894042.7A priority Critical patent/EP3416357A4/en
Publication of WO2017156880A1 publication Critical patent/WO2017156880A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
    • H04M1/6016—Substation equipment, e.g. for use by subscribers including speech amplifiers in the receiver circuit
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/22—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired frequency characteristic only 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2203/00—Details of circuits for transducers, loudspeakers or microphones covered by H04R3/00 but not provided for in any of its subgroups

Definitions

  • This document relates to but not limited to the field of terminal audio applications, and relates to a method, device and system for managing terminal audio parameters.
  • the optimization of acoustic performance on the terminal equipment mainly includes two parts: the optimization of the research and development stage and the user-controlled post-processing field.
  • the optimization of the research and development stage is not open to the user, but the effect of this part of the optimization is most obvious.
  • this part of the optimization space is fixed; the user-controlled post-processing part has limited space for user debugging, and can only balance the sound effect ( Optimized for the processing of Equalizer), this optimization is limited, and the availability and utilization are very low.
  • the acoustic performance optimization scheme of the above terminal is either not open to the user, or only involves EQ setting or subwoofer enhancement in the post-processing field, and post-processing such optimization mode (EQ setting or subwoofer enhancement, etc.), the user is not based on actual
  • the acoustic performance is adjusted, there is great randomness, the probability of the sound effect of the optimization effect is great, the risk of damage to the electro-acoustic device is increased, and the EQ adjustment, the bass requirement and the noise level are different in different playback environments. The requirements will be different, and it is difficult for users to get the right medicine.
  • the embodiment of the invention provides a method, a device and a system for managing audio parameters of a terminal, which solves the technical problem that the user cannot meet the requirement of adjusting the audio effect.
  • the embodiment of the invention provides a terminal audio parameter management method, including:
  • the terminal transmits an original audio waveform, and receives an external audio waveform corresponding to the original audio waveform;
  • the terminal calculates a terminal audio parameter difference point combination and an environment audio parameter difference point combination according to the original audio waveform and the external audio waveform;
  • Determining, by the terminal, the terminal audio parameter difference point combination and/or the ring according to an application scenario The difference of the audio parameters of the environment is adjusted to adjust the audio parameters of the terminal.
  • the terminal transmits an original audio waveform
  • receiving the external audio waveform corresponding to the original audio waveform includes: the terminal respectively connecting the transmitter and the receiver through a wired interface and/or a wireless interface;
  • the transmitter transmits the original audio waveform, and the external audio waveform is received by the receiver.
  • the terminal includes a first earphone jack and a second earphone jack, and the terminal respectively connecting the transmitter and the receiver through the wired interface, the terminal connecting the transmitter through the first earphone jack, Passing through the second earphone jack receiver; according to user selection or adaptive configuration, the first earphone jack is set as an output device interface, and the second earphone jack is set as an input device interface.
  • the terminal selects a terminal audio parameter difference point combination and/or the environment audio parameter difference point combination, and the adjustment of the terminal audio parameter includes:
  • the application scenario is a recording application, selecting the ambient audio parameter difference point combination to adjust the terminal audio parameter;
  • the application scenario is a voice call application, selecting a difference point combination of the terminal audio parameters, and adjusting the terminal audio parameters;
  • the terminal audio parameter difference point combination and the environment audio parameter difference point combination are simultaneously selected, and the terminal audio parameter is adjusted.
  • the method further includes: receiving a user confirmation operation, and ending if the user accepts the adjusted audio effect; if the user does not accept the adjusted audio effect, re-adjusting the terminal audio parameter until the user accepts the adjustment After the audio effect.
  • the calculating, by the terminal, the terminal audio parameter difference point combination and the environment audio parameter difference point combination according to the original audio waveform and the external audio waveform comprises:
  • the terminal And acquiring, by the terminal, the derived audio waveform and the ambient reflected audio waveform according to the external audio waveform; acquiring an initial acoustic characteristic indicator group according to the original audio waveform; acquiring a terminal acoustic characteristic indicator group according to the derived audio waveform, according to the environment Reflecting an audio waveform to obtain an environmental acoustic characteristic indicator set;
  • the audio parameter difference point combination is calculated, and the ambient audio parameter difference point combination is calculated according to the initial acoustic characteristic index group and the environmental acoustic characteristic index group.
  • the terminal audio parameter difference point combination includes at least one of a terminal noise output level, a frequency response curve, and an ambient sound pressure characteristic parameter;
  • the ambient audio parameter difference point combination includes a terminal noise output level, a frequency response curve, and an environment. At least one of sound pressure characteristic parameters;
  • the adjusting the terminal audio parameters includes one or more of the following manners:
  • the analog gain and the digital gain of the audio path are adjusted according to the ambient sound pressure characteristic parameter.
  • the acquiring, by the terminal, the derived audio waveform and the ambient reflected audio waveform according to the external audio waveform includes:
  • An embodiment of the present invention provides a terminal audio parameter management apparatus, including:
  • An audio module configured to transmit an original audio waveform, and receive an external audio waveform corresponding to the original audio waveform
  • a processing module configured to calculate a terminal audio parameter difference point combination and an environment audio parameter difference point combination according to the original audio waveform and the external audio waveform;
  • the adjustment module is configured to select a terminal audio parameter difference point combination and/or an environment audio parameter difference point combination according to an application scenario, and adjust the terminal audio parameter.
  • the audio module is configured to respectively connect a transmitter and a receiver through a wired interface and/or a wireless interface, the original audio waveform is transmitted by the transmitter, and the external audio is received by the receiver Waveform.
  • the audio module includes a first earphone jack and a second earphone jack, and the audio module respectively connects the transmitter and the receiver through a wired interface by:
  • the earphone jack is connected to the transmitter, and the first earphone jack is set as an output device interface according to a user selection or an adaptive configuration by the second earphone jack receiver, and the second earphone jack is set to Input device interface.
  • the adjustment module is configured to:
  • the application scenario is a recording application, selecting the ambient audio parameter difference point combination to adjust the terminal audio parameter;
  • the application scenario is a voice call application, selecting a difference point combination of the terminal audio parameters, and adjusting the terminal audio parameters;
  • the terminal audio parameter difference point combination and the environment audio parameter difference point combination are simultaneously selected, and the terminal audio parameter is adjusted.
  • the adjusting module is further configured to: receive a user confirmation operation; if the user accepts the adjusted audio effect, end; if the user does not accept the adjusted audio effect, re-adjust the terminal audio parameter until the user accepts the adjustment After the audio effect.
  • processing module is configured to:
  • the terminal audio parameter difference point combination includes at least one of a terminal noise output level, a frequency response curve, and an ambient sound pressure characteristic parameter;
  • the ambient audio parameter difference point combination includes a terminal noise output level, a frequency response curve, and an environment. At least one of sound pressure characteristic parameters;
  • the adjusting module adjusts the terminal audio parameters by using one or more of the following manners:
  • the analog gain and the digital gain of the audio path are adjusted according to the ambient sound pressure characteristic parameter.
  • the processing module obtains the derived audio waveform and the ambient reflected audio waveform according to the external audio waveform by:
  • the echo signal of the external audio waveform is eliminated to obtain the derived audio waveform; and the ambient sound field data is acquired on the echo signal to obtain the ambient reflected audio waveform.
  • the embodiment of the present invention provides a terminal audio parameter management system, including a terminal, a transmitter, and a receiver.
  • the terminal is provided with a terminal audio parameter management apparatus provided by the embodiment.
  • the embodiment of the invention further provides a computer readable storage medium, wherein the computer readable storage medium stores computer executable instructions, and when the computer executable instructions are executed, the terminal audio parameter management method is implemented.
  • the embodiment of the invention provides a method for managing audio parameters of a terminal.
  • the terminal receives an external audio waveform by transmitting an audio waveform, calculates a difference combination of the terminal and the ambient audio parameter, selects a corresponding difference point combination according to the application scenario, and selects a corresponding audio point parameter. Make adjustments and optimizations.
  • the above technical solution can reduce the probability of audio device damage caused by improper operation of the user, and can also realize a flexible scheme for adjusting important audio parameters of the terminal in different application environments, and provide a more novel audio effect adjustment mode for the user, and solve the problem that the terminal cannot meet the requirements.
  • the technical problem of the user adjusting the audio effect requirements.
  • the flexible peripheral interface can be set more flexibly, which is most convenient for users. Other aspects will be apparent upon reading and understanding the drawings and detailed description.
  • FIG. 1 is a schematic structural diagram of a terminal audio parameter management apparatus in a first embodiment of the present invention
  • FIG. 2 is a flowchart of a terminal audio parameter management method in a second embodiment of the present invention.
  • FIG. 3 is a flowchart of a terminal audio parameter management method in a third embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a dual earphone jack terminal in a third embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a terminal controlling a dual earphone jack in a third embodiment of the present invention.
  • Fig. 6 is a schematic view showing measurement of acoustic characteristics in a third embodiment of the present invention.
  • the terminal audio parameter management apparatus 1 provided by the embodiment of the present invention includes:
  • the audio module 11 is configured to transmit an original audio waveform, and receive an external audio waveform corresponding to the original audio waveform;
  • the processing module 12 is configured to calculate a terminal audio parameter difference point combination and an environment audio parameter difference point combination according to the original audio waveform and the external audio waveform;
  • the adjusting module 13 is configured to adjust the terminal audio parameters according to the application scenario, selecting a terminal audio parameter difference point combination and/or an environment audio parameter difference point combination.
  • the audio module 11 in the above embodiment is configured to respectively connect the transmitter and the receiver through a wired interface and/or a wireless interface, transmit the original audio waveform through the transmitter, and receive the external audio waveform through the receiver.
  • the audio module 11 in the foregoing embodiment includes a first earphone jack and a second earphone jack, and the audio module separately connects the transmitter and the receiver through the wired interface by: through the first earphone jack
  • the transmitter is connected to the second headphone jack receiver, and the first headphone jack is set as an output device interface according to a user selection or adaptive configuration, and the second headphone jack is set as an input device interface.
  • the adjustment module 13 in the foregoing embodiment is configured to:
  • the application scenario is a recording application, select an ambient audio parameter difference point combination to adjust the terminal audio parameter;
  • the application scenario is a voice call application, select a terminal audio parameter difference point combination, for the terminal Adjust the audio parameters;
  • the terminal audio parameter difference point combination and the environment audio parameter difference point combination are simultaneously selected, and the terminal audio parameters are adjusted.
  • the adjustment module 13 in the foregoing embodiment is further configured to: receive a user confirmation operation, and if the user accepts the adjusted audio effect, end, if the user does not accept the adjusted audio effect, re-adjust the terminal audio parameter, Until the user accepts the adjusted audio effect.
  • processing module 12 in the foregoing embodiment is configured to:
  • the terminal audio parameter difference point combination in the foregoing embodiment includes at least one of a terminal noise output level, a frequency response curve, and an ambient sound pressure characteristic parameter; and the ambient audio parameter difference point combination includes a terminal noise output level and a frequency response. At least one of a curve and an ambient sound pressure characteristic parameter; the adjustment module 13 implements adjustment of the terminal audio parameter by one or more of the following manners:
  • the analog gain and digital gain of the audio path are adjusted according to ambient sound pressure characteristic parameters.
  • the processing module 12 obtains the derived audio waveform and the ambient reflected audio waveform according to the external audio waveform by:
  • the echo signal of the external audio waveform is eliminated to obtain the derived audio waveform; and the ambient sound field data is acquired on the echo signal to obtain the ambient reflected audio waveform.
  • the embodiment of the present invention provides a terminal audio parameter management system, which includes a terminal, a transmitter, and a receiver, wherein the terminal is provided with the terminal audio parameter management apparatus provided by the embodiment of the present invention.
  • the terminal audio parameter management method includes:
  • Step S201 The terminal transmits an original audio waveform, and receives an external audio waveform corresponding to the original audio waveform.
  • Step S202 The terminal calculates a difference combination of the terminal audio parameter difference point combination and the environment audio parameter difference point according to the original audio waveform and the external audio waveform;
  • Step S203 The terminal selects a terminal audio parameter difference point combination and/or an environment audio parameter difference point combination according to the application scenario, and adjusts the terminal audio parameter.
  • the terminal in the foregoing embodiment transmits the original audio waveform
  • the external audio waveform corresponding to the original audio waveform includes: the terminal respectively connects the transmitter and the receiver through a wired interface and/or a wireless interface; and the terminal transmits the original through the transmitter.
  • the audio waveform is received by the receiver and the external audio waveform is received.
  • the terminal in the foregoing embodiment includes a first earphone jack and a second, and the terminal respectively connects the transmitter and the receiver through the wired interface, including: connecting the transmitter through the first earphone jack, and the terminal passes through the second earphone jack
  • the receiver sets the first headphone jack as an output device interface and the second headphone jack as an input device interface according to user selection or adaptive configuration.
  • the terminal in the foregoing embodiment selects a terminal audio parameter difference point combination and/or an environment audio parameter difference point combination according to the application scenario, and the terminal audio parameter is adjusted, including:
  • the application scenario is a recording application, select an ambient audio parameter difference point combination to adjust the terminal audio parameter;
  • the terminal audio parameter difference point combination is selected, and the terminal audio parameter is adjusted;
  • the terminal audio parameter difference point combination and the environment audio parameter difference point combination are simultaneously selected, and the terminal audio parameters are adjusted.
  • the method in the foregoing embodiment further includes: receiving a user confirmation operation, if the user accepts the adjusted audio effect, ending, if the user does not accept the adjusted audio effect, re-adjusting the terminal audio parameter until the user accepts Adjusted audio effects.
  • the terminal in the foregoing embodiment calculates the terminal audio parameter difference point combination and the environment audio parameter difference point combination according to the original audio waveform and the external audio waveform, including:
  • the terminal acquires the derived audio waveform and the ambient reflected audio waveform according to the external audio waveform; obtains an initial acoustic characteristic index group according to the original audio waveform, acquires a terminal acoustic characteristic index group according to the derived audio waveform, and obtains an environmental acoustic characteristic index group according to the ambient reflected audio waveform;
  • the terminal audio parameter difference point combination is calculated according to the initial acoustic characteristic index group and the terminal acoustic characteristic index group, and the environmental audio parameter difference point combination is calculated according to the initial acoustic characteristic index group and the environmental acoustic characteristic index group.
  • the terminal audio parameter difference point combination in the foregoing embodiment includes at least one of a terminal noise output level, a frequency response curve, and an ambient sound pressure characteristic parameter; and the ambient audio parameter difference point combination includes a terminal noise output level and a frequency response.
  • At least one of a curve and an ambient sound pressure characteristic parameter; adjusting the terminal audio parameter includes one or more of the following manners:
  • the analog gain and digital gain of the audio path are adjusted according to ambient sound pressure characteristic parameters.
  • the acquiring, by the terminal, the derived audio waveform and the ambient reflected audio waveform according to the external audio waveform includes:
  • the function adjustment algorithm modules of the audio optimization algorithm adopted by the mobile terminal include: echo cancellation, noise suppression, DRC (Dynamic Range Control) and filter (FIR (Finite Impulse Response)/IIR (Infinite Impulse Response)/Qualcomm Filtering, etc.;
  • the audio post-processing algorithms used in multimedia playback scenarios include: EQ (Quantization Equalization), spectrum-based sound enhancement (bass boost), and virtual surround sound (based on the time-delay characteristics of the two-channel sound signal) Adjust) and so on. These algorithms can change the frequency characteristics and energy characteristics of the original sound source signal to provide more comfortable and more user-required music performance and call performance.
  • the related speech optimization algorithms are all concentrated in the terminal development stage. They are all professionally tested and adjusted by the R&D personnel according to the acoustic characteristics. There is no room for the user to operate.
  • the multimedia sound processing post-processing adjustment provides the user with a small adjustable range and has the risk of breaking the sound, which has great damage to the electro-acoustic device; and because the electro-acoustic device increases with the number of uses, the audio characteristics will have some Changes, and in different application environments, the sound effects of the terminal electro-acoustic devices are also different.
  • the optimization of the research and development stage is divided into two parts: 1 voice optimization of the call class; 2 multimedia recording and playback performance optimization.
  • the optimization measures in Part 1 are invisible to the user, so the parameters of this part cannot be updated in the terminal application process, and the optimization of the call performance is also constant; sometimes the performance of the audio components of the terminal fluctuates due to aging. Not only does it not achieve the optimization effect, but even highlights the defects in the sound.
  • the optimization of the HD recording part in Part 2 is similar to the first part and is invisible to the user.
  • the multimedia playback is often the application scene that the user cares most about the sound effect. The user can adjust the sound effect through the EQ adjustment or the bass enhancement function in the post-processing function, or perform some effect enhancement to achieve the desired playback. effect.
  • the acoustic performance optimization scheme of the terminal is either not open to the user or only involves the back.
  • EQ settings in the field or subwoofer enhancements For the post-processing optimization method (EQ setting or subwoofer enhancement, etc.), the user does not adjust according to the actual acoustic performance, there is a great randomness, the probability of the optimization effect is broken, and the risk of the electro-acoustic device is damaged. Surging, and in different playback environments, the requirements for EQ adjustment, bass requirements and noise level will be different, and it is difficult for users to do the right medicine. This phenomenon of fluctuations in sound quality due to different application environments and fluctuations in the acoustic performance of electroacoustic devices can be fully compensated by fine tuning the acoustic parameters. However, due to the user's non-professionality and the complexity of the optimization algorithm parameter adjustment, the ordinary user cannot obtain the parameter adjustment authority, which causes the terminal sound effect to be unstable and even causes quality problems.
  • the embodiment of the invention utilizes the extensible peripheral interface of the terminal to connect the acoustic transmitting and receiving device, cooperates with the internal acoustic analysis software of the terminal, detects the inherent acoustic characteristics of the terminal, or detects the acoustic characteristics of the “terminal + playing environment”; according to the optimized hearing sense
  • the standard will feedback the automatically optimized modification scheme to the terminal, which is convenient for the user to select the optimization scheme according to the specific use environment and listening preferences, and modify the audio parameters of the terminal system after verifying the optimization effect to achieve the most sense of hearing. optimization.
  • the user selection optimization scheme involved in the embodiment of the present invention mainly refers to the following three steps: the user starts the process of adaptively modifying the audio parameters, and selects the acoustics of both the “terminal” and/or the “playing environment” according to the actual usage. Performance measurement; when the application feeds back the optimization scheme for both the "terminal” and the “playing environment” to the terminal, the user is prompted to confirm the modified content; the system will load the optimized solution confirmed by the user onto the terminal. Run the user-selected operation again, prompting the user to confirm the optimized sound effect. If the user's expectation is met, the optimization scheme is modified. Otherwise, the steps of detecting and recommending the optimization scheme are repeated to know that the user is satisfied.
  • the terminal audio parameter management method provided by the embodiment of the present invention includes:
  • Step S301 The terminal externally connects the acoustic transmitting and receiving device by using the expandable peripheral interface;
  • the extensible peripheral interface refers to a signal channel interface for data exchange between an acoustic transmitting device and a terminal that must be provided for performing acoustic detection, and a signal channel interface for data exchange between the acoustic receiving device and the terminal.
  • the signal channel interface of the two data exchanges can be a new type of terminal device with two headphone jacks (as shown in Figure 4); it can also be used with the wired interface of the conventional terminal (including but not limited to the headphone jack + USB (Universal) Serial Bus (Universal Serial Bus) interface); it is also possible to use a wired interface of a general terminal (including but not limited to a headphone interface) in conjunction with an acoustic device that communicates using a wireless transmission interface, or Both data interfaces use the wireless channel interface to perform the necessary acoustic transmission and reception.
  • This part of the device requires an output device and a receiving device according to the general principles of acoustic detection.
  • the terminal provides a professional detection waveform through the transmitting device, and returns to the receiving device again after the acoustic effect of the environment, and the receiving device obtains the measured waveform after the environmental action.
  • Mobile terminal side interface The hardware interface requirement of the mobile terminal side, that is, the extended peripheral interface is a new type of terminal device having two earphone jacks.
  • the novel terminal of the embodiment adds a set of 4-segment earphone jacks and a set of analog switch channels (as shown in FIG. 5), and switches between each set of dedicated signals, and the control signals are output by the processor platform, and the control signals are controlled.
  • FIG. 5 is a block diagram of a mechanism for supporting internal signal switching in a terminal.
  • the processor platform adaptively recognizes through the DET1&DET2 signal, and the processor platform controls the analog switch to perform signal channel switching; or after the error is reported, the upper layer application is fed back, and the user selects through the application program.
  • the processor platform newly configures the analog switch to complete the signal switching.
  • the external jack device is connected to the headphone jack 1 and the headphone jack 2, it can be designated by the user or adaptively selected as an output/input device interface, and the switching is completed by the control signal of the analog switch.
  • S302 The terminal plays the sound, and obtains a difference point combination
  • the embodiment of the present invention performs an acoustic characteristic measurement on the physical environment in which the terminal is located by externally connecting a detecting transmitter and a receiver to the special terminal device, and relies on the terminal.
  • the processing capability is analyzed to obtain the following information: frequency response curve (FR), terminal noise output level (Noise Level), and sound pressure characteristic (SPL) of "terminal + environment”.
  • FR frequency response curve
  • Noise Level terminal noise output level
  • SPL sound pressure characteristic of "terminal + environment”.
  • the acoustic performances involved in the embodiments of the present invention mainly refer to, but are not limited to, a frequency response curve (FR), a noise output level (Noise Level), and a sound pressure characteristic (SPL).
  • the acoustic characteristic analysis steps and principles include: the terminal detecting transmitter emits the original audio waveform Wi, and the receiver receives the external audio waveform W', and the terminal performs echo suppression on W', which is included in W' The echo signal We' is eliminated, and the number of clean derived audio waveforms is obtained.
  • obtaining the ambient sound field data for the echo signal We' obtaining the final ambient reflected audio waveform We, ie the environmental signal
  • performing acoustic analysis on the W obtaining the terminal acoustic characteristic index group X (including but not limited to: FR curve, SPL sound pressure characteristics and noise level Noise-Level, etc.
  • Acoustic analysis of We signal can obtain environmental acoustic characteristic index group Y; obtain initial acoustic characteristic index group Z by analyzing Wi signal; compare Y and Z to find out The environmental audio parameter difference point combination of the indicator is ⁇ ; the X and Z are compared to find the terminal audio parameter difference point combination ⁇ of the indicator.
  • S303 The terminal adjusts the audio parameters.
  • the technical solution of the embodiment of the invention not only optimizes the voice call effect of the terminal, but also optimizes the sound quality of the terminal multimedia play and recording; the optimization of the voice call effect of the terminal mainly refers to the acoustic performance of the “terminal” itself, and the multimedia play of the terminal.
  • the optimization of the sound quality of the recording requires the comprehensive consideration of the acoustic performance of the "terminal” itself and the acoustic performance of the "playing environment”.
  • the frequency response curve (FR) of the “terminal+environment” is used to compensate the filter parameters in the application scenarios such as playing, recording or talking, that is, the parameters of the measured FR curve concave portion are performed.
  • Parameter adjustment of the filter including but not limited to: modifying the gain value for the recess depth, setting the cutoff frequency point (Fh) according to the recessed position, and setting the Q value (quality factor) according to the recessed bandwidth, and finally using the filter to compensate the FR curve The depression on the upper.
  • the noise suppression parameter in the call audio parameter is modified by using the measured value of the terminal noise output level (Noise Level), including but not limited to: the threshold value of the noise detection and the parameters of the noise filter.
  • Noise Level the measured value of the terminal noise output level
  • the final loudness indication measurement value obtained by the terminal after ambient sound reflection and reverberation after a certain sound source is emitted is described, and the power amplifier simulation is performed according to the requirements of the actual human ear on the loudness.
  • Modification of the gain-gain (Analog-gain) or digital-gain modification of the digital channel of the audio signal includes, but is not limited to, these several acoustic properties.
  • the embodiment of the present invention distinguishes the influences of the “terminal” and the “environment” on the above acoustic performance, respectively obtains corresponding parameter optimization schemes, and then decides whether to use the two groups of parameters separately according to the user's choice. Program.
  • the recording application selects the difference point combination ⁇
  • the voice call selects the difference point combination ⁇ ; according to the selected difference point combination, the audio parameters (including but not limited to the following parameters: parameter filter Gain value, Fh cutoff frequency point and Q value quality factor, and VAD (Voice Activity Detection) parameters in the noise suppression algorithm module and various levels of analog/digital gain Analog-Gain and Digital-Gain are adaptively adjusted and completed. Sound optimization. Including: optimizing the VAD threshold parameter in the noise suppression algorithm according to the noise level (Noise-Level) in each difference point combination.
  • the professional analysis algorithm intercepts the Wi, W, and We waveforms according to a conventional gate function (optional but not limited to the Hamming window function), and then separately performs Fourier transform to obtain information of the corresponding FR curve.
  • the FR curve difference in the difference point combination can be obtained by comparing the gain value of the parameter filter, the Fh cutoff frequency point and the Q value quality factor in the speech optimization algorithm or the multimedia sound post-processing algorithm, and W'
  • the FR curve trend is adjusted to be as close as possible to the FR curve trend of the Wo waveform, ensuring that the FR curve amplitude difference is less than 3dBSPL over the entire acoustic band (within 8 kHz, multimedia playback within 16 kHz).
  • the SPL sound pressure characteristics in each difference point combination Properly adjust each gain on the audio path, including Analog-Gain and Digital-Gain.
  • the embodiment of the invention provides a terminal audio parameter management method.
  • the terminal transmits an audio waveform, receives an external audio waveform, calculates a difference combination of the terminal audio parameter different point combination and the environmental audio parameter, and selects a corresponding difference point according to the application scenario. Combine and adjust and optimize the terminal audio parameters.
  • the above technical solution can reduce the probability of audio device damage caused by improper operation of the user, and can also implement a flexible solution for adjusting important audio parameters of the terminal in different application environments, and provide a newer audio effect adjustment mode for the user, and solve the problem that the terminal cannot Meet the technical problems of users adjusting audio effects.
  • it is most convenient for users.
  • the embodiment of the invention further provides a computer readable storage medium, wherein the computer readable storage medium stores computer executable instructions, and when the computer executable instructions are executed, the terminal audio parameter management method is implemented.
  • the instructions are related to hardware (eg, a processor) that can be stored in a computer readable storage medium, such as a read only memory, a magnetic disk, or an optical disk.
  • a computer readable storage medium such as a read only memory, a magnetic disk, or an optical disk.
  • all or part of the steps of the above embodiments may also be implemented using one or more integrated circuits.
  • each module/unit in the above embodiment may be implemented in the form of hardware, for example, by implementing an integrated circuit to implement its corresponding function, or may be implemented in the form of a software function module, for example, executing a program stored in the memory by a processor. / instruction to achieve its corresponding function.
  • This application is not limited to any specific combination of hardware and software.
  • a person skilled in the art should understand that the technical solutions of the present application can be modified or equivalent, without departing from the spirit and scope of the technical solutions of the present application, and should be included in the scope of the claims of the present application.
  • the above technical solution reduces the probability of audio device damage caused by improper operation of the user, and can also implement a flexible solution for adjusting important audio parameters of the terminal in different application environments, which can meet the needs of the user to adjust the audio effect and improve the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

一种终端音频参数管理方法，该方法包括：终端发射原始音频波形，接收原始音频波形对应的外放音频波形；根据原始音频波形及外放音频波形计算终端音频参数差异点组合及环境音频参数差异点组合；终端根据应用场景，选择终端音频参数差异点组合和/或环境音频参数差异点组合，对终端音频参数进行调整。通过本发明实施例，终端通过发射音频波形接收外放音频波形，计算得到终端音频参数差异点组合和环境音频参数差异点组合，根据应用场景选择对应的差异点组合，进行调整优化。上述技术方案可以减少因用户不当操作带来的音频器件损伤的概率，也可以实现不同应用环境调整终端重要音频参数的灵活方案，给用户提供一种更新颖的音频效果调节方式。

Description

一种终端音频参数管理方法、装置及系统 技术领域
本文涉及但不限于终端音频应用领域，涉及一种终端音频参数管理方法、装置及系统。
背景技术
终端设备上对声学性能进行的优化部分主要包括研发阶段的优化和用户可控制的后处理领域两部分。研发阶段的优化不对用户开放，但是这部分优化的效果最为明显，当终端设计完成后，这部分优化空间被固定；用户可控制的后处理部分中用户调试的空间有限，仅能在音效均衡(Equalizer)的处理上进行优化，这种优化程度有限，可用度和利用率都非常低。
上述终端的声学性能优化方案，要么是不对用户开放的，要么仅仅涉及后处理领域的EQ设置或者重低音增强等，后处理这种优化方式(EQ设置或者重低音增强等)，用户不是依据实际的声学性能进行调整，有很大的随机性，优化效果产生破音现象的概率很大，损伤电声器件风险激增，而且不同的播放环境中，对EQ的调整、低音的要求以及噪声等级的要求都会不同，用户很难做到对症下药。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本发明实施例提供了一种终端音频参数管理方法、装置及系统，解决了不能满足用户调节音频效果需求的技术问题。
本发明实施例提供了一种终端音频参数管理方法，包括：
终端发射原始音频波形，接收所述原始音频波形对应的外放音频波形；
所述终端根据所述原始音频波形及所述外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合；
所述终端根据应用场景，选择所述终端音频参数差异点组合和/或所述环 境音频参数差异点组合，对终端音频参数进行调整。
可选地，所述终端发射原始音频波形，接收所述原始音频波形对应的外放音频波形包括：所述终端通过有线接口和/或无线接口分别连接发射器和接收器；所述终端通过所述发射器发射所述原始音频波形，通过所述接收器接收所述外放音频波形。
可选地，所述终端包括第一耳机插孔和第二耳机插孔，所述终端通过有线接口分别连接发射器和接收器包括：所述终端通过所述第一耳机插孔连接发射器，通过所述第二耳机插孔接收器；根据用户选择或者自适应配置，将所述第一耳机插孔设置为输出设备接口，将所述第二耳机插孔设置为输入设备接口。
可选地，所述终端根据应用场景，选择终端音频参数差异点组合和/或所述环境音频参数差异点组合，对终端音频参数进行调整包括：
若所述应用场景为录音应用，则选择所述环境音频参数差异点组合，对终端音频参数进行调整；
若所述应用场景为语音通话应用，则选择所述终端音频参数差异点组合，对终端音频参数进行调整；
若所述应用场景为多媒体播放应用，则同时选择所述终端音频参数差异点组合和环境音频参数差异点组合，对所述终端音频参数进行调整。
可选地，所述方法还包括：接收用户确认操作，若用户接受调整后的音频效果，则结束；若用户不接受调整后的音频效果，则重新调整所述终端音频参数，直至用户接受调整后的音频效果。
可选地，所述终端根据所述原始音频波形及所述外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合包括：
所述终端根据所述外放音频波形获取衍生音频波形及环境反射音频波形；根据所述原始音频波形获取初始声学特性指标组；根据所述衍生音频波形获取终端声学特性指标组，根据所述环境反射音频波形获取环境声学特性指标组；
根据所述初始声学特性指标组及所述终端声学特性指标组计算所述终端 音频参数差异点组合，根据所述初始声学特性指标组及所述环境声学特性指标组计算所述环境音频参数差异点组合。
可选地，所述终端音频参数差异点组合括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；环境音频参数差异点组合包括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；
所述对终端音频参数进行调整包括以下方式中的一种或多种：
根据所述终端的噪声输出等级，对噪声抑制算法内的语音激活检测门限参数进行调整；
根据所述频率响应曲线，配置语音优化算法或多媒体音效后处理算法中的参数滤波器的增益值、上限截止频率点和Q值品质因数；
根据所述环境声压特性参数调整音频通路的模拟增益和数字增益。
可选地，所述终端根据所述外放音频波形获取衍生音频波形及环境反射音频波形包括：
对所述外放音频波形进行回声抑制，将所述外放音频波形的回声信号消除，获得所述衍生音频波形；对所述回声信号进行环境声场数据获取，获得所述环境反射音频波形。本发明实施例提供一种终端音频参数管理装置，包括：
音频模块，设置为发射原始音频波形，接收所述原始音频波形对应的外放音频波形；
处理模块，设置为根据所述原始音频波形及所述外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合；
调整模块，设置为根据应用场景，选择终端音频参数差异点组合和/或环境音频参数差异点组合，对终端音频参数进行调整。
可选地，所述音频模块是设置为通过有线接口和/或无线接口分别连接发射器和接收器，通过所述发射器发射所述原始音频波形，通过所述接收器接收所述外放音频波形。
可选地，所述音频模块包括第一耳机插孔和第二耳机插孔，所述音频模块通过如下方式实现通过有线接口分别连接发射器和接收器：通过所述第一 耳机插孔连接发射器，通过所述第二耳机插孔接收器，根据用户选择或者自适应配置，将所述第一耳机插孔设置为输出设备接口，将所述第二耳机插孔设置为输入设备接口。
可选地，所述调整模块是设置为：
若所述应用场景为录音应用，则选择所述环境音频参数差异点组合，对终端音频参数进行调整；
若所述应用场景为语音通话应用，则选择所述终端音频参数差异点组合，对终端音频参数进行调整；
若所述应用场景为多媒体播放应用，则同时选择所述终端音频参数差异点组合和环境音频参数差异点组合，对所述终端音频参数进行调整。
可选地，所述调整模块还设置为：接收用户确认操作；若用户接受调整后的音频效果，则结束；若用户不接受调整后的音频效果，则重新调整终端音频参数，直至用户接受调整后的音频效果。
可选地，所述处理模块是设置为：
根据所述外放音频波形获取衍生音频波形及环境反射音频波形；根据所述原始音频波形获取初始声学特性指标组，根据所述衍生音频波形获取终端声学特性指标组，
根据所述环境反射音频波形获取环境声学特性指标组；根据所述初始声学特性指标组及所述终端声学特性指标组计算所述终端音频参数差异点组合，根据所述初始声学特性指标组及所述环境声学特性指标组计算所述环境音频参数差异点组合。
可选地，所述终端音频参数差异点组合括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；环境音频参数差异点组合包括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；
所述调整模块通过如下方式中的一种或多种实现对终端音频参数进行调整：
根据所述终端的噪声输出等级，对噪声抑制算法内的语音激活检测门限参数进行调整；
根据所述频率响应曲线配置语音优化算法或多媒体音效后处理算法中的参数滤波器的增益值、上限截止频率点和Q值品质因数；
根据所述环境声压特性参数调整音频通路的模拟增益和数字增益。
可选地，所述处理模块通过如下方式实现根据所述外放音频波形获取衍生音频波形及环境反射音频波形：
为对所述外放音频波形进行回声抑制，将所述外放音频波形的回声信号消除，获得所述衍生音频波形；对所述回声信号进行环境声场数据获取，获得所述环境反射音频波形。
本发明实施例一种终端音频参数管理系统，包括终端及发射器、接收器，所述终端设置有发明实施例提供的终端音频参数管理装置。
本发明实施例还提供一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机可执行指令，所述计算机可执行指令被执行时实现终端音频参数管理方法。
本发明实施例的有益效果：
本发明实施例提供了一种终端音频参数管理方法，终端通过发射音频波形，接收外界音频波形，计算得到终端和环境音频参数差异点组合，根据应用场景选择对应的差异点组合，对终端音频参数进行调整优化。上述技术方案可以减少因用户不当操作带来的音频器件损伤的概率，也可以实现不同应用环境调整终端重要音频参数的灵活方案，给用户提供了更加新颖的音频效果调节方式，解决了终端不能满足用户调节音频效果需求的技术问题。同时可以对可扩展外设接口进行更加灵活的设置，最大程度的方便于用户使用。在阅读并理解了附图和详细描述后，可以明白其它方面。
附图说明
图1为本发明第一实施例中的终端音频参数管理装置的结构示意图；
图2为本发明第二实施例中的终端音频参数管理方法的流程图；
图3为本发明第三实施例中的终端音频参数管理方法的流程图；
图4为本发明第三实施例中的双耳机插孔终端的示意图；
图5为本发明第三实施例中的终端控制双耳机插孔的示意图；
图6为本发明第三实施例中的声学特性测量示意图。
具体实施方式
现通过实施例结合附图的方式对本申请做出进一步的诠释说明。
第一实施例：
图1为本发明第一实施例提供的终端音频参数管理装置的结构示意图，由图1可知，在本实施例中，本发明实施例提供的终端音频参数管理装置1包括：
音频模块11，设置为发射原始音频波形，接收原始音频波形对应的外放音频波形；
处理模块12，设置为根据原始音频波形及外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合；
调整模块13，设置为根据应用场景.选择终端音频参数差异点组合和/或环境音频参数差异点组合，对终端音频参数进行调整。
可选地，上述实施例中的音频模块11设置为通过有线接口和/或无线接口分别连接发射器和接收器，通过发射器发射原始音频波形，通过接收器接收外放音频波形。
可选地，上述实施例中的音频模块11包括第一耳机插孔和第二耳机插孔，所述音频模块通过如下方式实现通过有线接口分别连接发射器和接收器：通过第一耳机插孔连接发射器，通过第二耳机插孔接收器，根据用户选择或者自适应配置，将第一耳机插孔设置为输出设备接口，将第二耳机插孔设置为输入设备接口。
可选地，上述实施例中的调整模块13是设置为：
若应用场景为录音应用，则选择环境音频参数差异点组合，对终端音频参数进行调整；
若应用场景为语音通话应用，则选择终端音频参数差异点组合，对终端 音频参数进行调整；
若应用场景为多媒体播放应用，则同时选择终端音频参数差异点组合和环境音频参数差异点组合，对终端音频参数进行调整。
可选地，上述实施例中的调整模块13还设置为：接收用户确认操作，若用户接受调整后的音频效果，则结束，若用户不接受调整后的音频效果，则重新调整终端音频参数，直至用户接受调整后的音频效果。
可选地，上述实施例中的处理模块12是设置为：
根据外放音频波形获取衍生音频波形及环境反射音频波形；根据原始音频波形获取初始声学特性指标组，根据衍生音频波形获取终端声学特性指标组，
根据环境反射音频波形获取环境声学特性指标组；根据初始声学特性指标组及终端声学特性指标组计算终端音频参数差异点组合，根据初始声学特性指标组及环境声学特性指标组计算环境音频参数差异点组合。
可选地，上述实施例中的终端音频参数差异点组合括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；环境音频参数差异点组合包括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；调整模块13通过如下方式中的一种或多种实现对终端音频参数进行调整：
根据终端噪声输出等级，对噪声抑制算法内的语音激活检测门限参数进行调整；
根据频率响应曲线配置语音优化算法或多媒体音效后处理算法中参数滤波器的增益值、上限截止频率点和Q值品质因数；
根据环境声压特性参数调整音频通路的模拟增益和数字增益。
可选地，所述处理模块12通过如下方式实现根据所述外放音频波形获取衍生音频波形及环境反射音频波形：
为对所述外放音频波形进行回声抑制，将所述外放音频波形的回声信号消除，获得所述衍生音频波形；对所述回声信号进行环境声场数据获取，获得所述环境反射音频波形。
本发明实施例提供了一种终端音频参数管理系统，其包括终端及发射器、接收器，其中，所述终端设置有本发明实施例提供的终端音频参数管理装置。
第二实施例：
图2为本发明第二实施例提供的终端音频参数管理方法的流程图，由图2可知，在本实施例中，本发明实施例提供的终端音频参数管理方法包括：
步骤S201：终端发射原始音频波形，接收原始音频波形对应的外放音频波形；
步骤S202：终端根据原始音频波形及外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合；
步骤S203：终端根据应用场景，选择终端音频参数差异点组合和/或环境音频参数差异点组合，对终端音频参数进行调整。
可选地，上述实施例中的终端发射原始音频波形，接收原始音频波形对应的外放音频波形包括：终端通过有线接口和/或无线接口分别连接发射器和接收器；终端通过发射器发射原始音频波形，通过接收器接收外放音频波形。
可选地，上述实施例中的终端包括第一耳机插孔和第二，终端通过有线接口分别连接发射器和接收器包括:通过第一耳机插孔连接发射器，终端通过第二耳机插孔接收器，根据用户选择或者自适应配置，将第一耳机插孔设置为输出设备接口，将第二耳机插孔设置为输入设备接口。
可选地，上述实施例中的终端根据应用场景，选择终端音频参数差异点组合和/或环境音频参数差异点组合，对终端音频参数进行调整包括：
若应用场景为录音应用，则选择环境音频参数差异点组合，对终端音频参数进行调整；
若应用场景为语音通话应用，则选择终端音频参数差异点组合，对终端音频参数进行调整；
若应用场景为多媒体播放应用，则同时选择终端音频参数差异点组合和环境音频参数差异点组合，对终端音频参数进行调整。
可选地，上述实施例中的方法还包括:接收用户确认操作，若用户接受调整后的音频效果，则结束，若用户不接受调整后的音频效果，则重新调整终端音频参数，直至用户接受调整后的音频效果。
可选地，上述实施例中的终端根据原始音频波形及外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合包括：
终端根据外放音频波形获取衍生音频波形及环境反射音频波形；根据原始音频波形获取初始声学特性指标组，根据衍生音频波形获取终端声学特性指标组，根据环境反射音频波形获取环境声学特性指标组；根据初始声学特性指标组及终端声学特性指标组计算终端音频参数差异点组合，根据初始声学特性指标组及环境声学特性指标组计算环境音频参数差异点组合。
可选地，上述实施例中的终端音频参数差异点组合括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；环境音频参数差异点组合包括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；对终端音频参数进行调整包括以下方式中的一种或多种：
根据终端的噪声输出等级，对噪声抑制算法内的语音激活检测门限参数进行调整；
根据频率响应曲线配置语音优化算法或多媒体音效后处理算法中参数滤波器的增益值、上限截止频率点和Q值品质因数；
根据环境声压特性参数调整音频通路的模拟增益和数字增益。
可选地，所述终端根据所述外放音频波形获取衍生音频波形及环境反射音频波形包括：
对所述外放音频波形进行回声抑制，将所述外放音频波形的回声信号消除，获得所述衍生音频波形；对所述回声信号进行环境声场数据获取，获得所述环境反射音频波形。
第三实施例：
下面结合具体应用场景对本发明实施例的技术方案做进一步的诠释说明。
智能终端对音效的要求越来越高，不论在语音通话场景下还是在多媒体播放场景下，都要求尽可能的改善用户的听感体验。目前使用更加优秀的电声转化器件，在多媒体播放场景下集成更加复杂的音频后处理算法，以及在语音通话场景下使用语音优化算法已经成为必需。这些后处理算法和语音优化算法可以提供诸如噪声抑制(NS)，音效增强((AAE)，回声消除(EC)以及语音增强等专用功能(AVE)。这些技术的加入，优化了终端的音频效果，提升了用户体验。
目前移动终端采用的音频优化算法的功能调整算法模块包括：回声消除\噪声抑制、DRC(动态范围控制，Dynamic Range Control)和滤波器(FIR(Finite Impulse Response)/IIR(Infinite Impulse Response)/高通滤波等)；多媒体播放场景下采用的音频后处理算法的包括：EQ(量化均衡技术)、基于频谱的音效加强(低音增强)以及虚拟环绕声功能(基于双通道声音信号时间轴的延时特性调整)等。这些算法可以改变原声源信号的频率特性和能量特性，提供更加舒适和更加贴合消费者要求的音乐性能和通话性能。
相关语音优化算法，都集中在终端研发阶段，都是经过专业测试，由研发人员按照声学特性进行调整，对用户而言没有任何可操作的空间。多媒体音效后处理调整，给用户提供的可调范围很小，且有产生破音的风险，对电声器件有很大的损伤；又因为电声器件随着使用次数增加，音频特性会有所变化，而且在不同的应用环境中，对终端电声器件的音效影响也有不同。
因此就需要对音频参数进行微调，这样才能提供更好的用户体验。研发阶段的优化分为两部分：①通话类的语音优化；②多媒体类的录音和播放性能优化。第①部分的优化措施，对用户不可见，因此该部分的参数无法在终端应用过程中得到更新，对通话性能的优化程度也是恒定不变的；有时在终端的音频部件因老化发生性能波动后，不但达不到优化效果，甚至凸显声音上的缺陷。第②部分中高清录音部分的优化也和第①部分类似，对于用户是不可见的。第②部分中多媒体播放往往是用户对音效最为关心的应用场景，用户可以通过后处理功能中的EQ调整或低音增强等功能，对音效进行调整，或进行一些效果增强，达到自己想要的播放效果。
终端的声学性能优化方案，要么是不对用户开放的，要么仅仅涉及后处 理领域的EQ设置或者重低音增强等。对于后处理这种优化方式(EQ设置或者重低音增强等)，用户不是依据实际的声学性能进行调整，有很大的随机性，优化效果产生破音现象的概率很大，损伤电声器件风险激增，而且不同的播放环境中，对EQ的调整，低音的要求以及噪声等级的要求都会不同，而用户很难做到对症下药。这种因应用环境不同，以及由于电声器件声学性能波动而引起的音质波动的现象，完全可以通过微调声学参数进行补偿。但由于用户的非专业性和优化算法参数调整的复杂性，普通用户无法得到参数调整的权限，造成终端音效的不稳定，甚至产生质量问题。
本发明实施例利用终端的可扩展外设接口外接声学发射和接收装置，配合终端内部声学分析软件，检测终端固有的声学特性，或探测“终端+播放环境”的声学特性；根据最优化听感的标准，将自动优化的修改方案反馈到终端上，方便用户根据具体的使用环境和听音喜好进行优化方案选择，并在验证优化效果后对终端系统的音频参数进行修改，达到听感的最优化。
本发明实施例涉及的用户选择优化方案，主要是指以下三个步骤：用户开启自适应修改音频参数的进程，根据实际的使用情况选择完成“终端”和/或“播放环境”两者的声学性能测量；当应用程序将针对“终端”和“播放环境”两者的优化方案反馈到终端上显示后，经提示用户需要确认修改的内容；系统会将经用户确认的优化方案加载到终端上，再次运行用户所选的操作，提示用户确认优化后的音效，若符合用户期望，则优化方案完成修改，否则重复探测和推荐优化方案的步骤，知道用户满意为止。
如图3所示，本发明实施例提供的终端音频参数管理方法包括：
步骤S301：终端利用可扩展外设接口外接声学发射和接收装置；
本发明实施例涉及的可扩展外设接口，指的是为完成声学探测必须具备的声学发射设备与终端进行数据交换的信号通道接口，以及声学接收设备与终端进行数据交换的信号通道接口，这两个数据交换的信号通道接口可以采用拥有两个耳机插孔的新型终端设备(如图4所示)；也可以采用常规终端的有线接口进行配合使用(包含但不限于耳机接口+USB(Universal Serial Bus，通用串行总线)接口这种组合)；还可以采用一般终端的有线接口(包含但不限于耳机接口)配合利用无线传输接口进行通信的声学设备的方案，又或 者两个数据接口全部使用无线通道接口来完成必要的声学发射和接收。
外部设备：这部分设备根据声学探测的一般原理，需要一部输出设备和一部接收设备。终端经发射设备提供专业的探测波形，经由环境的声学作用后，再次返回到接收设备上，由接收设备得到经环境作用过后的测量波形。
移动终端侧接口：移动终端侧硬件接口需求，即可扩展外设接口是拥有两个耳机插孔的新型终端设备。本实施例的新型终端增加一组4段式耳机插孔，以及一组模拟开关通道(如图5所示)，在每组专用信号之间进行切换，控制信号由处理器平台输出，控制的来源有两种：一种是用户在收到系统提示后做的选择，一种是终端提供的自适应插入检测机制。
新型终端侧模拟开关功能：在原有4段式耳机插孔1的基础上，再增加1个4段式耳机插孔2，倍增了信号通道，为外接外部设备提供了条件。这一设计的核心在于增加的耳机插孔与原来的耳机插孔功能完全兼容，这个是通过模拟开关和检测信号(DET1&DET2)实现的。图5是终端内部支持信号切换的机制框图。当外部输出/输入设备插入耳机插孔，处理器平台通过DET1&DET2信号进行自适应识别，处理器平台控制模拟开关进行信号通道切换；或识别报错后反馈上层应用程序，由用户通过应用程序进行选择，处理器平台从新对模拟开关进行配置，完成信号切换。耳机插孔1和耳机插孔2在外接外部设备的时候，可以由用户指定或者自适应选配成输出/输入设备接口，靠模拟开关的控制信号完成切换.
S302：终端放音，获取差异点组合；
在如图6所示的场景中，本发明实施例通过在特殊终端设备上外接一个探测发射器和一个接收器，利用声学探测原理，对终端所在的物理环境进行声学特性的测量，并依靠终端处理能力进行分析，得到如下信息：“终端+环境”的频率响应曲线(FR)、终端噪声输出等级(Noise Level)和声压特性(SPL)。本发明实施例涉及的声学性能主要是指但不限于：频率响应曲线(FR)、噪声输出等级(Noise Level)和声压特性(SPL)等。
在本实施例中，声学特性分析步骤及原理包括：终端探测发射器发出原始音频波形Wi，经接收器接收得到外放音频波形W’，终端对W’进行回声抑制，将W’中包含的回声信号We’消除，得到干净的衍生音频波形数 据W；针对回声信号We’进行环境声场数据的获取，得到最终的环境反射音频波形We，即环境信号；对W进行声学分析，获得终端声学特性指标组X(包括但不限于：FR曲线，SPL声压特性以及噪声等级Noise-Level等)；对We信号进行声学分析，可以得到环境声学特性指标组Y；通过分析Wi信号得到初始声学特性指标组Z；将Y与Z进行对比，找出指标的环境音频参数差异点组合α；将X与Z进行对比，找出指标的终端音频参数差异点组合β。
S303：终端对音频参数进行调整。
本发明实施例的技术方案既有针对终端语音通话效果的优化，也有针对终端多媒体播放和录音的音质优化；对终端语音通话效果的优化主要参考“终端”自身的声学性能，对终端多媒体播放和录音的音质的优化需要将“终端”自身的声学性能和“播放环境”的声学性能综合考虑后才能完成。
在本实施例中，利用“终端+环境”的频率响应曲线(FR)，对播放、录音或通话等应用场景下的滤波器参数进行补偿设置，也就是针对测得的FR曲线凹陷部分进行参数滤波器的参数调整，包括但不限于：针对凹陷深度修改增益(gain)值、根据凹陷位置设置截止频率点(Fh)以及根据凹陷带宽设置Q值(品质因数)，最终利用滤波器补偿FR曲线上的凹陷。
利用终端噪声输出等级(Noise Level)的测量值，修改通话音频参数中的噪声抑制参数，包括但不局限于：噪声探测的门限值以及噪声滤波器的各项参数等。
利用探测器获得的环境声压特性(SPL)，描述了终端在发出一定的探测音源后，经由环境反射和混响得到的最终响度指示测量值，按照实际人耳对响度的要求，进行功放模拟增益参数(Analog-gain)的修改或是音频信号数字通道上数字增益(Digital-gain)的修改。可以预见的是，本发明实施例涉及的音频参数的优化包括但不限于这几种声学性能。同时，本发明实施例会根据声学探测技术，区分“终端”和“环境”对上述声学性能的影响，分别得到相应的参数优化方案，再根据用户的选择，决定分开使用还是联合使用两组参数优化方案。
根据用户场景不同，选择不同的差异点组合，包括：多媒体播放选用差 异点组合α+差异点组合β，录音应用选择差异点组合α，语音通话选择差异点组合β；根据选择的差异点组合，对音频参数(包含但不限于以下几个参数：参数滤波器的gain值、Fh截止频率点和Q值品质因数以及噪声抑制算法模块中的VAD(Voice Activity Detection，语音检测)参数和各级模拟/数字增益Analog-Gain和Digital-Gain)进行自适应调整，完成音效优化。包括：根据每个差异点组合中噪声等级(Noise-Level)，对噪声抑制算法中的VAD门限参数进行优化。当Noise-Level值提升，需要提升VAD门限，这样可以更好地抑制噪声，同时也会损失更多的有用信号，因此提升的幅度按照经验选择。为了获得FR曲线信息，专业分析算法将Wi、W和We波形按照常规门函数(可选但不限于汉明窗函数)进行截取，再分别进行傅里叶变化，获得相应的FR曲线的信息，然后进行对比可以获得差异点组合中的FR曲线差异，通过配置语音优化算法或多媒体音效后处理算法中的参数滤波器的gain值、Fh截止频率点和Q值品质因数的大小，将W’的FR曲线趋势调整到尽量靠近Wo波形的FR曲线趋势，保证在整个声学频段(通话8kHz以内，多媒体播放16kHz以内)FR曲线幅值差小于3dBSPL。根据各个差异点组合中SPL声压特性。适当调节音频通路上的每个增益，包括Analog-Gain和Digital-Gain。
综上可知，通过本发明实施例，至少存在以下有益效果：
本发明实施例提供了一种终端音频参数管理方法，终端通过发射音频波形，接收外放音频波形，计算得到终端音频参数异点组合和环境音频参数差异点组合，根据应用场景选择对应的差异点组合，对终端音频参数进行调整优化。上述技术方案可以减少因用户不当操作带来的音频器件损伤的概率，也可以实现不同应用环境调整终端重要音频参数的灵活方案，给用户提供一种更新颖的音频效果调节方式，解决了终端不能满足用户调节音频效果需求的技术问题。同时以更加灵活的可扩展外设接口设置，最大程度上便于用户使用。
本发明实施例还提供一种计算机可读存储介质，所述计算机可读存储介质中存储有计算机可执行指令，所述计算机可执行指令被执行时实现终端音频参数管理方法。
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序 来指令相关硬件(例如处理器)完成，所述程序可以存储于计算机可读存储介质中，如只读存储器、磁盘或光盘等。可选地，上述实施例的全部或部分步骤也可以使用一个或多个集成电路来实现。相应地，上述实施例中的各模块/单元可以采用硬件的形式实现，例如通过集成电路来实现其相应功能，也可以采用软件功能模块的形式实现，例如通过处理器执行存储于存储器中的程序/指令来实现其相应功能。本申请不限制于任何特定形式的硬件和软件的结合。本领域的普通技术人员应当理解，可以对本申请的技术方案进行修改或者等同替换，而不脱离本申请技术方案的精神和范围，均应涵盖在本申请的权利要求范围当中。
工业实用性
上述技术方案减少了因用户不当操作带来的音频器件损伤的概率，也可以实现不同应用环境调整终端重要音频参数的灵活方案，可以满足用户调节音频效果的需求，提高了用户使用体验。

Claims (17)

  1. 一种终端音频参数管理方法，包括：
    终端发射原始音频波形，接收所述原始音频波形对应的外放音频波形；
    所述终端根据所述原始音频波形及所述外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合；
    所述终端根据应用场景，选择所述终端音频参数差异点组合和/或所述环境音频参数差异点组合，对终端音频参数进行调整。
  2. 如权利要求1所述的终端音频参数管理方法，其中，所述终端发射原始音频波形，接收所述原始音频波形对应的外放音频波形包括：所述终端通过有线接口和/或无线接口分别连接发射器和接收器；所述终端通过所述发射器发射所述原始音频波形，通过所述接收器接收所述外放音频波形。
  3. 如权利要求2所述的终端音频参数管理方法，其中，所述终端包括第一耳机插孔和第二耳机插孔，所述终端通过有线接口分别连接发射器和接收器包括：所述终端通过所述第一耳机插孔连接发射器，通过所述第二耳机插孔接收器；根据用户选择或者自适应配置，将所述第一耳机插孔设置为输出设备接口，将所述第二耳机插孔设置为输入设备接口。
  4. 如权利要求1所述的终端音频参数管理方法，其中，所述终端根据应用场景，选择终端音频参数差异点组合和/或所述环境音频参数差异点组合，对终端音频参数进行调整包括：
    若所述应用场景为录音应用，则选择所述环境音频参数差异点组合，对终端音频参数进行调整；
    若所述应用场景为语音通话应用，则选择所述终端音频参数差异点组合，对终端音频参数进行调整；
    若所述应用场景为多媒体播放应用，则同时选择所述终端音频参数差异点组合和环境音频参数差异点组合，对所述终端音频参数进行调整。
  5. 如权利要求1所述的终端音频参数管理方法，所述方法还包括：接收用户确认操作，若用户接受调整后的音频效果，则结束；若用户不接受调整后的音频效果，则重新调整所述终端音频参数，直至用户接受调整后的音频 效果。
  6. 如权利要求1至5任一项所述的终端音频参数管理方法，其中，所述终端根据所述原始音频波形及所述外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合包括：
    所述终端根据所述外放音频波形获取衍生音频波形及环境反射音频波形；根据所述原始音频波形获取初始声学特性指标组；根据所述衍生音频波形获取终端声学特性指标组，根据所述环境反射音频波形获取环境声学特性指标组；
    根据所述初始声学特性指标组及所述终端声学特性指标组计算所述终端音频参数差异点组合，根据所述初始声学特性指标组及所述环境声学特性指标组计算所述环境音频参数差异点组合。
  7. 如权利要求6所述的终端音频参数管理方法，其中，所述终端音频参数差异点组合括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；所述环境音频参数差异点组合包括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；
    所述对终端音频参数进行调整包括以下方式中的一种或多种：
    根据所述终端的噪声输出等级，对噪声抑制算法内的语音激活检测门限参数进行调整；
    根据所述频率响应曲线，配置语音优化算法或多媒体音效后处理算法中的参数滤波器的增益值、上限截止频率点和Q值品质因数；
    根据所述环境声压特性参数调整音频通路的模拟增益和数字增益。
  8. 如权利要求6所述的终端音频参数管理方法，其中，所述终端根据所述外放音频波形获取衍生音频波形及环境反射音频波形包括：
    对所述外放音频波形进行回声抑制，将所述外放音频波形的回声信号消除，获得所述衍生音频波形；对所述回声信号进行环境声场数据获取，获得所述环境反射音频波形。
  9. 一种终端音频参数管理装置，包括：
    音频模块，设置为发射原始音频波形，接收所述原始音频波形对应的外 放音频波形；
    处理模块，设置为根据所述原始音频波形及所述外放音频波形计算终端音频参数差异点组合和环境音频参数差异点组合；
    调整模块，设置为根据应用场景，选择终端音频参数差异点组合和/或环境音频参数差异点组合，对终端音频参数进行调整。
  10. 如权利要求9所述的终端音频参数管理装置，其中，所述音频模块是设置为通过有线接口和/或无线接口分别连接发射器和接收器，通过所述发射器发射所述原始音频波形，通过所述接收器接收所述外放音频波形。
  11. 如权利要求10所述的终端音频参数管理装置，其中，所述音频模块包括第一耳机插孔和第二耳机插孔，所述音频模块通过如下方式实现通过有线接口分别连接发射器和接收器：通过所述第一耳机插孔连接发射器，通过所述第二耳机插孔接收器，根据用户选择或者自适应配置，将所述第一耳机插孔设置为输出设备接口，将所述第二耳机插孔设置为输入设备接口。
  12. 如权利要求9所述的终端音频参数管理装置，其中，所述调整模块是设置为：
    若所述应用场景为录音应用，则选择所述环境音频参数差异点组合，对终端音频参数进行调整；
    若所述应用场景为语音通话应用，则选择所述终端音频参数差异点组合，对终端音频参数进行调整；
    若所述应用场景为多媒体播放应用，则同时选择所述终端音频参数差异点组合和环境音频参数差异点组合，对所述终端音频参数进行调整。
  13. 如权利要求9所述的终端音频参数管理装置，其中，所述调整模块还设置为：接收用户确认操作；若用户接受调整后的音频效果，则结束；若用户不接受调整后的音频效果，则重新调整终端音频参数，直至用户接受调整后的音频效果。
  14. 如权利要求9至13任一项所述的终端音频参数管理装置，其中，所述处理模块是设置为：
    根据所述外放音频波形获取衍生音频波形及环境反射音频波形；根据所 述原始音频波形获取初始声学特性指标组，根据所述衍生音频波形获取终端声学特性指标组，
    根据所述环境反射音频波形获取环境声学特性指标组；根据所述初始声学特性指标组及所述终端声学特性指标组计算所述终端音频参数差异点组合，根据所述初始声学特性指标组及所述环境声学特性指标组计算所述环境音频参数差异点组合。
  15. 如权利要求14所述的终端音频参数管理装置，其中，所述终端音频参数差异点组合括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；环境音频参数差异点组合包括终端噪声输出等级、频率响应曲线、环境声压特性参数中的至少一种；
    所述调整模块通过如下方式中的一种或多种实现对终端音频参数进行调整：
    根据所述终端的噪声输出等级，对噪声抑制算法内的语音激活检测门限参数进行调整；
    根据所述频率响应曲线配置语音优化算法或多媒体音效后处理算法中的参数滤波器的增益值、上限截止频率点和Q值品质因数；
    根据所述环境声压特性参数调整音频通路的模拟增益和数字增益。
  16. 如权利要求14所述的终端音频参数管理装置，其中，所述处理模块通过如下方式实现根据所述外放音频波形获取衍生音频波形及环境反射音频波形：
    为对所述外放音频波形进行回声抑制，将所述外放音频波形的回声信号消除，获得所述衍生音频波形；对所述回声信号进行环境声场数据获取，获得所述环境反射音频波形。
  17. 一种终端音频参数管理系统，包括终端及发射器、接收器，所述终端设置有如权利要求9至16任一项所述的终端音频参数管理装置。
PCT/CN2016/083687 2016-03-15 2016-05-27 一种终端音频参数管理方法、装置及系统 WO2017156880A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP16894042.7A EP3416357A4 (en) 2016-03-15 2016-05-27 Terminal audio parameter management method, apparatus and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610147410.8 2016-03-15
CN201610147410.8A CN107197403B (zh) 2016-03-15 2016-03-15 一种终端音频参数管理方法、装置及系统

Publications (1)

Publication Number Publication Date
WO2017156880A1 true WO2017156880A1 (zh) 2017-09-21

Family

ID=59851852

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/083687 WO2017156880A1 (zh) 2016-03-15 2016-05-27 一种终端音频参数管理方法、装置及系统

Country Status (3)

Country Link
EP (1) EP3416357A4 (zh)
CN (1) CN107197403B (zh)
WO (1) WO2017156880A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110534079A (zh) * 2019-08-22 2019-12-03 广州番禺巨大汽车音响设备有限公司 一种用于多声效卡拉ok的方法及系统
CN112947886A (zh) * 2019-12-11 2021-06-11 荣耀终端有限公司 保护用户听力的方法、装置和电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742178A (zh) * 2009-12-14 2010-06-16 广东威创视讯科技股份有限公司 音视频终端播放效果优化方法、装置及音视频播放系统
CN103841495A (zh) * 2014-03-03 2014-06-04 联想(北京)有限公司 一种音频参数调整方法及装置
CN104281432A (zh) * 2014-09-18 2015-01-14 小米科技有限责任公司 调节音效的方法及装置
JP5723148B2 (ja) * 2010-12-28 2015-05-27 日本放送協会 符号化装置
CN104966522A (zh) * 2015-06-30 2015-10-07 广州酷狗计算机科技有限公司 音效调节方法、云端服务器、音响设备及系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1167213C (zh) * 2000-03-01 2004-09-15 中兴通讯股份有限公司 一种回声抵消功能的测试方法
JP4568439B2 (ja) * 2001-01-22 2010-10-27 パナソニック株式会社 エコー抑圧装置
US8036879B2 (en) * 2007-05-07 2011-10-11 Qnx Software Systems Co. Fast acoustic cancellation
CN101478614A (zh) * 2009-01-19 2009-07-08 深圳华为通信技术有限公司 自适应音量调节的方法、装置及通信终端
US8155330B2 (en) * 2009-03-31 2012-04-10 Apple Inc. Dynamic audio parameter adjustment using touch sensing
TWI469650B (zh) * 2012-11-29 2015-01-11 Quanta Comp Inc 回音消除系統
US9495951B2 (en) * 2013-01-17 2016-11-15 Nvidia Corporation Real time audio echo and background noise reduction for a mobile device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742178A (zh) * 2009-12-14 2010-06-16 广东威创视讯科技股份有限公司 音视频终端播放效果优化方法、装置及音视频播放系统
JP5723148B2 (ja) * 2010-12-28 2015-05-27 日本放送協会 符号化装置
CN103841495A (zh) * 2014-03-03 2014-06-04 联想(北京)有限公司 一种音频参数调整方法及装置
CN104281432A (zh) * 2014-09-18 2015-01-14 小米科技有限责任公司 调节音效的方法及装置
CN104966522A (zh) * 2015-06-30 2015-10-07 广州酷狗计算机科技有限公司 音效调节方法、云端服务器、音响设备及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3416357A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110534079A (zh) * 2019-08-22 2019-12-03 广州番禺巨大汽车音响设备有限公司 一种用于多声效卡拉ok的方法及系统
CN110534079B (zh) * 2019-08-22 2023-01-13 广州番禺巨大汽车音响设备有限公司 一种用于多声效卡拉ok的方法及系统
CN112947886A (zh) * 2019-12-11 2021-06-11 荣耀终端有限公司 保护用户听力的方法、装置和电子设备

Also Published As

Publication number Publication date
CN107197403A (zh) 2017-09-22
EP3416357A4 (en) 2018-12-26
EP3416357A1 (en) 2018-12-19
CN107197403B (zh) 2021-03-16

Similar Documents

Publication Publication Date Title
US20230111715A1 (en) Fitting method and apparatus for hearing earphone
EP3128767B1 (en) System and method to enhance speakers connected to devices with microphones
KR102196012B1 (ko) 트랜스듀서 상태의 검출에 기초하여 오디오 트랜스듀서의 성능을 향상시키는 방법들 및 시스템들
US9299333B2 (en) System for adaptive audio signal shaping for improved playback in a noisy environment
US8682002B2 (en) Systems and methods for transducer calibration and tuning
US8699742B2 (en) Sound system and a method for providing sound
US20090016540A1 (en) Auditory perception controlling device and method
JP2017055406A (ja) ラウドネスに基づくオーディ信号補償
CN108476256A (zh) 一种音量调节方法及终端
WO2019033438A1 (zh) 音频信号调节方法、装置、存储介质及终端
US20100142719A1 (en) Acoustic apparatus and method of controlling an acoustic apparatus
RU2424632C2 (ru) Устройство радиосвязи с двусторонним аудиосигналом
CN104604254A (zh) 声音处理装置、方法和程序
US11627421B1 (en) Method for realizing hearing aid function based on bluetooth headset chip and a bluetooth headset
US9491306B2 (en) Signal processing control in an audio device
JP6873549B2 (ja) オーディオ装置およびコンピュータで読み取り可能なプログラム
WO2017156880A1 (zh) 一种终端音频参数管理方法、装置及系统
CN114223219B (zh) 音频处理方法和装置
CN116506785B (zh) 一种封闭空间自动调音系统
CN114071220B (zh) 音效调节方法、装置、存储介质及电子设备
US11206502B1 (en) System and method for evaluating an ear seal using normalization
CN113689890A (zh) 多声道信号的转换方法、装置及存储介质
US11463809B1 (en) Binaural wind noise reduction
WO2020255601A1 (ja) 出力音制御装置、および出力音制御方法、並びにプログラム
JP5022459B2 (ja) 収音装置、収音方法及び収音プログラム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2016894042

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2016894042

Country of ref document: EP

Effective date: 20180911

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16894042

Country of ref document: EP

Kind code of ref document: A1