CN115297404A - Audio processing system and method and vehicle - Google Patents
Audio processing system and method and vehicle Download PDFInfo
- Publication number
- CN115297404A CN115297404A CN202210931628.8A CN202210931628A CN115297404A CN 115297404 A CN115297404 A CN 115297404A CN 202210931628 A CN202210931628 A CN 202210931628A CN 115297404 A CN115297404 A CN 115297404A
- Authority
- CN
- China
- Prior art keywords
- audio signal
- audio
- vehicle
- signal
- processing module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 328
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000005236 sound signal Effects 0.000 claims abstract description 767
- 238000005070 sampling Methods 0.000 claims abstract description 93
- 238000012952 Resampling Methods 0.000 claims abstract description 46
- 238000012937 correction Methods 0.000 claims abstract description 29
- 238000003672 processing method Methods 0.000 claims abstract description 10
- 238000006243 chemical reaction Methods 0.000 claims description 64
- 230000005540 biological transmission Effects 0.000 claims description 59
- 239000000126 substance Substances 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 40
- 238000010586 diagram Methods 0.000 description 21
- 239000010410 layer Substances 0.000 description 17
- 230000001360 synchronised effect Effects 0.000 description 14
- 230000003321 amplification Effects 0.000 description 11
- 238000003199 nucleic acid amplification method Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 9
- 230000002457 bidirectional effect Effects 0.000 description 6
- 230000004044 response Effects 0.000 description 3
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 2
- 229910052802 copper Inorganic materials 0.000 description 2
- 239000010949 copper Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009413 insulation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000011241 protective layer Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/02—Spatial or constructional arrangements of loudspeakers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The embodiment of the invention discloses an audio processing system, an audio processing method and a vehicle. The system comprises: a vehicle infotainment device, a vehicle microphone, a speaker and a power amplifier; the vehicle-mounted information entertainment device comprises an audio processing module and an echo processing module; the vehicle-mounted microphone collects a first audio signal and sends the first audio signal to the audio processing module; the power amplifier processes the audio signal and sends a second audio signal to the loudspeaker and the audio processing module; the audio processing module performs time correction and resampling on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and sends the third audio signal and the fourth audio signal to the echo processing module through the same channel; the echo processing module performs echo cancellation processing on the third audio signal based on the fourth audio signal, and determines a user audio signal in the third audio signal, so that accuracy of user audio identification is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of vehicles, in particular to an audio processing system, an audio processing method and a vehicle.
Background
With the continuous development of automobile technology, the requirements of drivers and passengers in automobiles on vehicle-mounted voice recognition quality and vehicle-mounted voice call quality are also continuously improved.
At present, the audio of a user in a vehicle can be collected through a microphone in the vehicle, and the audio collected by the microphone not only has the audio of the user, but also is doped with sound output by a loudspeaker, so that the audio of the user cannot be accurately collected by the vehicle, and further the voice interaction or the call quality of the user can be influenced.
Disclosure of Invention
The embodiment of the invention provides an audio processing system, an audio processing method and a vehicle, which are used for accurately identifying user audio so as to improve the voice interaction or conversation quality of a user.
In a first aspect, an embodiment of the present invention provides an audio processing system, where the system includes: a vehicle infotainment device, a vehicle microphone, a speaker and a power amplifier; the vehicle-mounted information entertainment device comprises an audio processing module and an echo processing module;
the vehicle-mounted microphone is used for collecting a first audio signal in a vehicle and sending the first audio signal to the audio processing module;
the power amplifier is used for processing an audio signal to be output and sending an obtained second audio signal to the loudspeaker and the audio processing module;
the audio processing module is configured to perform time correction and resampling on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and send the third audio signal and the fourth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission manner;
the echo processing module is configured to perform echo cancellation processing on the third audio signal based on the fourth audio signal, and determine a user audio signal in the third audio signal.
In a second aspect, an embodiment of the present invention provides an audio processing method, which is applied to an audio processing system, where the audio processing system includes: a vehicle infotainment device, a vehicle microphone, a speaker and a power amplifier; the method comprises the following steps:
acquiring a first audio signal in a vehicle through the vehicle-mounted microphone, and sending the first audio signal to an audio processing module in the vehicle-mounted information entertainment device;
processing an audio signal to be output through the power amplifier, and sending an obtained second audio signal to the loudspeaker and the audio processing module;
the first audio signal and the second audio signal are subjected to time correction and resampling processing through the audio processing module to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and the third audio signal and the fourth audio signal are sent to an echo processing module in the vehicle-mounted information entertainment device through the same channel based on a time division multiplexing transmission mode;
and performing echo cancellation processing on the third audio signal based on the fourth audio signal through the echo processing module, and determining a user audio signal in the third audio signal.
In a third aspect, embodiments of the present invention provide a vehicle including an audio processing system provided in any of the embodiments of the present invention.
According to the technical scheme of the embodiment of the invention, the vehicle-mounted microphone can be used for collecting the first audio signal in the vehicle and sending the first audio signal to the audio processing module in the vehicle-mounted information entertainment device. The power amplifier can be used for processing the audio signal to be output and sending the obtained second audio signal to the loudspeaker and the audio processing module. The audio processing module is used for carrying out time correction and resampling processing on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and the third audio signal and the fourth audio signal are sent to the echo processing module through the same channel based on a time division multiplexing transmission mode, so that synchronous transmission of the third audio signal and the fourth audio signal is guaranteed, time deviation does not exist, and then the echo processing module can accurately carry out echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal to identify a user audio signal in the third audio signal, so that the accuracy of user audio identification is improved, and the conversation quality can be improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an audio processing system according to an embodiment of the present invention;
FIG. 2 is a diagram of an exemplary architecture of an audio processing system according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating an exemplary architecture of another audio processing system according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating an exemplary architecture of another audio processing system according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating an exemplary architecture of another audio processing system according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating an exemplary architecture of another audio processing system according to an embodiment of the present invention;
FIG. 7 is a diagram illustrating an exemplary architecture of another audio processing system according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an audio processing system according to a second embodiment of the present invention;
FIG. 9 is a diagram illustrating an exemplary architecture of an audio processing system according to a second embodiment of the present invention;
FIG. 10 is a diagram of an exemplary architecture of an audio processing system according to another embodiment of the present invention;
fig. 11 is a flowchart of an audio processing method according to a third embodiment of the present invention;
fig. 12 is a schematic structural diagram of a vehicle according to a fourth embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a schematic structural diagram of an audio processing system according to an embodiment of the present invention. The audio processing system provided by the embodiment can be suitable for performing echo cancellation processing on the collected user voice. As shown in fig. 1, the audio processing system may include: the in-vehicle infotainment device 10, the in-vehicle microphone 20, the speaker 30, and the power amplifier 40; the in-vehicle infotainment device 10 includes, among other things, an audio processing module 101 and an echo processing module 102.
The vehicle-mounted microphone 20 is configured to collect a first audio signal in a vehicle, and send the first audio signal to the audio processing module 101; the power amplifier 40 is configured to process an audio signal to be output, and send an obtained second audio signal to the speaker 30 and the audio processing module 101; the audio processing module 101 is configured to perform time correction and resampling on the first audio signal and the second audio signal, obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and send the third audio signal and the fourth audio signal to the echo processing module 102 through the same channel based on a time division multiplexing transmission manner; the echo processing module 102 is configured to perform echo cancellation processing on the third audio signal based on the fourth audio signal, and determine a user audio signal in the third audio signal.
The in-vehicle infotainment device 10 includes, among other things, an audio processing module 101 and an echo processing module 102. For example, the In-Vehicle Infotainment device 10 may be referred to as an IVI (In-Vehicle Infotainment). The first audio signal may refer to a user audio signal doped with sound emitted by the speaker 30. The audio signal to be output may refer to an audio signal obtained by an audio response module in the in-vehicle infotainment device 10 in response to a user's voice, that is, an audio signal requiring power amplification. For example, the audio signal to be output may refer to an audio signal such as a media sound, a navigation sound, an alarm sound, or the like to be output. The second audio signal may be an audio signal obtained by performing power amplification, sound effect processing, and the like on the audio signal to be output through the power amplifier 40. For example, the power amplifier 40 may be referred to as an in-vehicle DSP (Digital Signal Processing, audio processor). The time correction may refer to a timing adjustment operation performed on a plurality of signals based on a uniform time-scale point. For example, the timestamp point may refer to a timestamp. The resampling process may refer to a process of changing the number of sampling points of the original audio signal based on a preset sampling rate to generate a new audio signal. For example, the resampling may resample an audio signal with a sampling rate of 16k to an audio signal with a sampling rate of 48k. The resampling ratio may be, but is not limited to, 16k or 48k. The third audio signal may refer to an audio signal obtained by the audio processing module 101 performing resampling processing on the time-corrected first audio signal based on the same sampling rate. The fourth audio signal may refer to an audio signal obtained by the audio processing module 101 performing resampling processing on the time-corrected second audio signal based on the same sampling rate. The third audio signal and the fourth audio signal may refer to homologous audio signals, i.e. the third audio signal and the fourth audio signal have the same sampling rate. The time-division multiplexing (TDM) mode may refer to a communication mode in which different signals are interleaved in different time periods, transmitted along the same channel, and signals in each time period are extracted and restored to original signals at a receiving end. The time division multiplexing transmission scheme can transmit multiple signals on the same channel. The same channel ensures that data is transmitted synchronously, i.e. no time difference occurs during transmission. The Echo processing module may be referred to as ECNR (Echo Cancellation & Noise Reduction, echo Cancellation + Noise Reduction). The user audio signal may refer to an audio signal emitted by the user himself, that is, an audio signal not doped with the output audio of the speaker 30.
Specifically, the in-vehicle microphone 20 may capture a first audio signal within the vehicle and transmit the first audio signal to the audio processing module 101 in the in-vehicle infotainment device 10. The power amplifier 40 may process the audio signal to be output and send the obtained second audio signal to the speaker 30 and the audio processing module 101. The audio processing module 101 performs time correction and resampling on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and sends the third audio signal and the fourth audio signal to the echo processing module 102 through the same channel based on a time division multiplexing transmission manner, so as to ensure that the third audio signal and the fourth audio signal after time correction are transmitted synchronously, that is, no time difference occurs during transmission. The echo processing module 102 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite party can hear the user music more clearly in the process of passing through the third audio signal, thereby improving the communication quality.
It should be noted that there may be multiple sets of speakers 30 in the vehicle, and each set of speakers 30 may include one or more speakers 30. Accordingly, the power amplifier 40 outputs a plurality of second audio signals, and the number of the output second audio signals is the same as the number of the sets of the speakers 30, that is, each second audio signal output by the power amplifier 40 is input to the corresponding set of the speakers 30, so that the sound in the vehicle appears in surround sound. The in-vehicle surround sound may be formed by a plurality of sounds emitted by the in-vehicle plurality of sets of speakers 30 based on the plurality of second audio signals. In this regard, all the second audio signals output by the power amplifier 40 are subjected to time correction and resampling processing in the audio processing module 101, so as to further improve the accuracy of user audio recognition.
Illustratively, the audio processing module 101 is specifically configured to: performing time alignment on the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal to obtain a fifth audio signal and a sixth audio signal after the time alignment; the fifth audio signal and the sixth audio signal are resampled based on a preset sampling rate to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and the third audio signal and the fourth audio signal are sent to the echo processing module 102 through the same channel based on a time division multiplexing transmission mode.
Wherein the time stamp may be used to identify the time of generation of each audio signal to distinguish between audio signals generated at different times. The time stamp may be used to time correct the plurality of data information. The fifth audio signal may refer to the time-aligned first audio signal. The sixth audio signal may refer to the time-aligned second audio signal. The preset sampling rate may refer to a pre-set resampling rate that meets the signal transmission requirements. For example, the preset resampling ratio may refer to 48k.
Specifically, the audio processing module 101 in the in-vehicle infotainment device 10 may time-align the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after time-aligning, so as to implement synchronous processing of the fifth audio signal and the sixth audio signal. The audio processing module 101 in the in-vehicle infotainment device 10 may perform resampling processing on the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, so as to ensure that the sampling rates of the third audio signal and the fourth audio signal are consistent, and further achieve accurate echo cancellation processing at the same sampling rate. The audio processing module 101 in the in-vehicle infotainment device 10 may send the third audio signal and the fourth audio signal to the echo processing module 102 through the same channel based on a time division multiplexing transmission manner, so as to ensure that the echo processing module 102 receives the third audio signal and the fourth audio signal without time difference, and thus may accurately perform echo cancellation, and identify the user audio signal in the third audio signal.
According to the technical scheme of the embodiment of the invention, the vehicle-mounted microphone 20 can be used for collecting the first audio signal in the vehicle and sending the first audio signal to the audio processing module 101 in the vehicle-mounted information entertainment device 10. The audio signal to be output may be processed by the power amplifier 40 and the obtained second audio signal may be sent to the speaker 30 and the audio processing module 101. The audio processing module 101 is used for performing time correction and resampling processing on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and the third audio signal and the fourth audio signal are sent to the echo processing module 102 through the same channel based on a time division multiplexing transmission mode, so that synchronous transmission of the third audio signal and the fourth audio signal is guaranteed, time deviation does not exist, and then the echo processing module 102 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal to identify a user audio signal in the third audio signal, so that accuracy of user audio identification is improved, and call quality can be improved.
On the basis of the above technical solution, the vehicle-mounted microphone 20 is a vehicle-mounted analog microphone or a vehicle-mounted digital microphone; the power amplifier 40 is an internal analog power amplifier located within the in-vehicle infotainment device 10, or the power amplifier 40 is an external analog power amplifier or an external digital power amplifier located outside the in-vehicle infotainment device 10.
Specifically, the in-vehicle microphone 20 in the vehicle may be an in-vehicle analog microphone whose output signal is in the form of an analog signal, or may be an in-vehicle digital microphone whose output signal is in the form of a digital signal. The power amplifier 40 in the vehicle may be a built-in analog power amplifier that is located in the in-vehicle infotainment device 10 and outputs a signal in the form of an analog signal, an external analog power amplifier that is located outside the in-vehicle infotainment device 10 and outputs a signal in the form of an analog signal, or an external digital power amplifier that is located outside the in-vehicle infotainment device 10 and outputs a signal in the form of a digital signal. Typically, no built-in digital power amplifier is present in the vehicle.
Illustratively, for the different forms of the on-board microphone 20 and the power amplifier 40 given above, the audio processing system may implement the audio processing operation by the following six system architectures:
as a first implementation, fig. 2 shows an exemplary diagram of an architecture of an audio processing system. As shown in FIG. 2, the in-vehicle microphone 20 is an in-vehicle analog microphone 201, and the power amplifier 40 is a built-in analog power amplifier 401 located in the in-vehicle infotainment device 10. The vehicle-mounted analog microphone 201 is specifically configured to: the first audio signal in the form of an analog signal in the vehicle is collected, and the first audio signal in the form of an analog signal is sent to the audio processing module 101 through the analog twisted pair. The built-in analog power amplifier 401 is specifically configured to: the audio signal to be output is processed, and the obtained second audio signal in the form of an analog signal is sent to the speaker 30 and the audio processing module 101 through the analog twisted pair.
The analog twisted pair may be a data transmission line composed of two copper wires with insulation protection layers. Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine, through a sound Source (Source) module in the in-vehicle infotainment device 10, that the sound signal is a navigation sound audio signal, and send the navigation sound audio signal to an audio thrower: the process tracker (Track) module allows the Navigation Audio signal to be transmitted to the Audio Hardware Abstraction Layer (Audio HAL) module through the synchronous Remote Control Mixer Thread (SRC Mixer Thread) and applies for the Navi tts. The Android controller (System on Chip Android) can call Navi tts.pcm (navigation Text to speech pulse Code Modulation recording, which is a speech synthesis pulse Code Modulation recording of a vehicle with a speech electronic navigation System) in a lightweight library (Tiny Advanced Linux Architecture, tiny alsa) to generate an audio signal to be output, and send the audio signal to be output to a built-in analog power amplifier 401 located in the vehicle-mounted information entertainment device 10. The built-in analog power amplifier 401 performs power amplification processing on the audio signal to be output, obtains a second audio signal in the form of an analog signal, and sends the second audio signal in the form of an analog signal with the original sampling rate of 48k to the speaker 30 and the audio processing module 101 in the in-vehicle infotainment device 10 through the analog twisted pair. The vehicle-mounted analog microphone 201 may collect a first audio signal in the form of an analog signal in the vehicle, and send the first audio signal in the form of an analog signal with an original sampling rate of 16k to the audio processing module 101 in the vehicle-mounted infotainment device 10 through the analog twisted pair. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after time-alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may perform resampling processing on the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and based on a time division multiplexing transmission manner, pass the third audio signal and the fourth audio signal through the lightweight library, the audio hardware abstraction layer module, and the audio thrower through the same channel: the progress recorder (Record) module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the time-corrected third Audio signal and the time-corrected fourth Audio signal are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the device with the opposite side, so that the communication quality is improved.
As a second implementation, fig. 3 shows an exemplary diagram of an architecture of another audio processing system. As shown in FIG. 3, in-vehicle microphone 20 is in-vehicle digital microphone 202 and power amplifier 40 is a built-in analog power amplifier 401 located in-vehicle infotainment device 10. Wherein the in-vehicle infotainment device 10 further comprises: a first digital-to-analog conversion module 501; the in-vehicle digital microphone 202 is specifically configured to: acquiring a first audio signal in a form of a digital signal in a vehicle, and sending the first audio signal in the form of the digital signal to a first digital-to-analog conversion module 501 through a vehicle-mounted audio bus; the first digital-to-analog conversion module 501 is configured to: the first audio signal in the form of a digital signal is subjected to signal conversion, and the obtained first audio signal in the form of an analog signal is sent to the audio processing module 101.
The car Audio Bus may be referred to as A2B (automatic Audio Bus). The A2B bus is a vehicle-mounted high-bandwidth, bidirectional and digital audio bus and adopts a daisy chain structure. The A2B bus supports 11 nodes (10 slave nodes) at most, the distance between the nodes is 15 meters at most, and the length of the whole daisy chain is 40 meters at most.
Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine the sound signal as a navigation sound audio signal by a sound source module in the in-vehicle infotainment device 10, and send the navigation sound audio signal to an audio thrower: and the process tracking module is used for transmitting the navigation audio signal to the audio hardware abstraction layer module through the synchronous remote control mixer thread and applying for Navi TTS. The android controller may invoke Navi tts.pcm in the lightweight library to generate an audio signal to be output, and send the audio signal to be output to the built-in analog power amplifier 401 located in the in-vehicle infotainment device 10. The built-in analog power amplifier 401 performs power amplification processing on the audio signal to be output, obtains a second audio signal in the form of an analog signal, and sends the second audio signal in the form of an analog signal with an original sampling rate of 48k to the speaker 30 and the audio processing module 101 in the in-vehicle information entertainment apparatus 10 through an analog twisted pair. The vehicle-mounted digital microphone 202 may collect a first audio signal in the form of a digital signal in the vehicle, and send the first audio signal in the form of a digital signal with an original sampling rate of 16k to the first digital-to-analog conversion module 501 in the vehicle-mounted infotainment device 10 through the vehicle-mounted audio bus, so that the first digital-to-analog conversion module 501 in the vehicle-mounted infotainment device 10 may perform signal conversion on the first audio signal in the form of a digital signal, and send the obtained first audio signal in the form of an analog signal to the audio processing module 101. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after time-alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may perform resampling processing on the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and based on a time division multiplexing transmission manner, pass the third audio signal and the fourth audio signal through the lightweight library, the audio hardware abstraction layer module, and the audio thrower through the same channel: the progress recording module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the time-corrected third audio signal and the time-corrected fourth audio signal are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the third audio signal, so that the communication quality is improved.
As a third implementation, fig. 4 shows an exemplary diagram of an architecture of another audio processing system. As shown in FIG. 4, the in-vehicle microphone 20 is an in-vehicle analog microphone 201, and the power amplifier 40 is an external analog power amplifier 402 located outside the in-vehicle infotainment device 10.
Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine the sound signal as the navigation sound audio signal through a sound source module in the in-vehicle infotainment device 10, and send the navigation sound audio signal to the audio thrower: and the process tracking module is used for transmitting the navigation audio signal to the audio hardware abstraction layer module through the synchronous remote control mixer thread and applying for Navi TTS. The android controller can call Navi TTS.pcm in the lightweight library to generate an audio signal to be output, and send the audio signal to be output to an external analog power amplifier 402 located outside the vehicle-mounted information entertainment device 10. The external analog power amplifier 402 located outside the in-vehicle infotainment device 10 may perform power amplification processing on the audio signal to be output, obtain a second audio signal in the form of an analog signal, and send the second audio signal in the form of an analog signal with the original sampling rate of 48k to the speaker 30 and the audio processing module 101 in the in-vehicle infotainment device 10 through the analog twisted pair. The vehicle-mounted analog microphone 201 may collect a first audio signal in the form of an analog signal in the vehicle, and send the first audio signal in the form of an analog signal with an original sampling rate of 16k to the audio processing module 101 in the vehicle-mounted infotainment device 10 through the analog twisted pair. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after time-alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may resample and process the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and pass the third audio signal and the fourth audio signal through the lightweight class library, the audio hardware abstraction layer module, and the audio thrower through the same channel based on a time division multiplexing transmission manner: the progress recording module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the time-corrected third audio signal and the time-corrected fourth audio signal are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the third audio signal, so that the communication quality is improved.
As a fourth implementation, fig. 5 shows an exemplary diagram of an architecture of another audio processing system. As shown in FIG. 5, the in-vehicle microphone 20 is the in-vehicle digital microphone 202, and the power amplifier 40 is an external analog power amplifier 402 located outside the in-vehicle infotainment device 10.
Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine the sound signal as a navigation sound audio signal by a sound source module in the in-vehicle infotainment device 10, and send the navigation sound audio signal to an audio thrower: and the process tracking module is used for transmitting the navigation audio signal to the audio hardware abstraction layer module through the synchronous remote control mixer thread and applying for Navi TTS. The android controller may invoke Navi tts.pcm in the lightweight library to generate an audio signal to be output, and send the audio signal to be output to an external analog power amplifier 402 located outside the vehicle-mounted information entertainment device 10. The external analog power amplifier 402 located outside the in-vehicle infotainment device 10 may perform power amplification processing on the audio signal to be output, obtain a second audio signal in the form of an analog signal, and send the second audio signal in the form of an analog signal with the original sampling rate of 48k to the speaker 30 and the audio processing module 101 in the in-vehicle infotainment device 10 through the analog twisted pair. The vehicle-mounted digital microphone 202 may collect a first audio signal in the form of a digital signal in a vehicle, and send the first audio signal in the form of a digital signal with an original sampling rate of 16k to the first digital-to-analog conversion module 501 in the vehicle-mounted infotainment device 10 through the vehicle-mounted audio bus, so that the first digital-to-analog conversion module 501 in the vehicle-mounted infotainment device 10 may perform signal conversion on the first audio signal in the form of a digital signal, and send the obtained first audio signal in the form of an analog signal to the audio processing module 101. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the first audio signal and the second audio signal based on the first timestamp corresponding to the first audio signal and the second timestamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after the time alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may resample and process the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and pass the third audio signal and the fourth audio signal through the lightweight class library, the audio hardware abstraction layer module, and the audio thrower through the same channel based on a time division multiplexing transmission manner: the progress recording module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the time-corrected third audio signal and the time-corrected fourth audio signal are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the third audio signal, so that the communication quality is improved.
As a fifth implementation manner, fig. 6 shows an exemplary diagram of the architecture of another audio processing system. As shown in FIG. 6, the in-vehicle microphone 20 is an in-vehicle analog microphone 201, and the power amplifier 40 is an external digital power amplifier 403 located outside the in-vehicle infotainment device 10. Wherein the in-vehicle infotainment device 10 further comprises: a second digital-to-analog conversion module 502; the external digital power amplifier 403 is specifically configured to: the audio signal to be output is processed, and the obtained second audio signal in the form of a digital signal is sent to the second digital-to-analog conversion module 502 through the vehicle-mounted audio bus; the second digital-to-analog conversion module 502 is configured to: the second audio signal in the form of a digital signal is subjected to signal conversion, and the obtained second audio signal in the form of an analog signal is sent to the audio processing module 101.
Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine the sound signal as the navigation sound audio signal through a sound source module in the in-vehicle infotainment device 10, and send the navigation sound audio signal to the audio thrower: and the process tracking module is used for transmitting the navigation audio signal to the audio hardware abstraction layer module through the synchronous remote control mixer thread and applying for Navi TTS. The android controller may invoke Navi tts.pcm in the lightweight library to generate an audio signal to be output, and send the audio signal to be output to an external digital power amplifier 403 located outside the vehicle-mounted information entertainment device 10. The external digital power amplifier 403 located outside the in-vehicle infotainment device 10 may process the audio signal to be output, and send the second audio signal in the form of a digital signal with an original sampling rate of 48k to the second digital-to-analog conversion module 502 located in the in-vehicle infotainment device 10 through the in-vehicle audio bus, so that the second digital-to-analog conversion module 502 located in the in-vehicle infotainment device 10 may perform signal conversion on the second audio signal in the form of a digital signal, and send the obtained second audio signal in the form of an analog signal to the audio processing module 101. The vehicle-mounted analog microphone 201 may collect a first audio signal in the form of an analog signal in the vehicle, and send the first audio signal in the form of an analog signal with an original sampling rate of 16k to the audio processing module 101 in the vehicle-mounted infotainment device 10 through the analog twisted pair. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after time-alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may perform resampling processing on the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and based on a time division multiplexing transmission manner, pass the third audio signal and the fourth audio signal through the lightweight library, the audio hardware abstraction layer module, and the audio thrower through the same channel: the progress recording module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the time-corrected third audio signal and the time-corrected fourth audio signal are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the device with the opposite side, so that the communication quality is improved.
Fig. 7 shows an exemplary architecture diagram of another audio processing system as a sixth implementation manner. As shown in FIG. 7, the in-vehicle microphone 20 is the in-vehicle digital microphone 202 and the power amplifier 40 is an external digital power amplifier 403 located external to the in-vehicle infotainment device 10.
Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine the sound signal as a navigation sound audio signal by a sound source module in the in-vehicle infotainment device 10, and send the navigation sound audio signal to an audio thrower: and the process tracking module is used for transmitting the navigation audio signal to the audio hardware abstraction layer module through the synchronous remote control mixer thread and applying for Navi TTS. The android controller may invoke Navi tts.pcm in the lightweight library to generate an audio signal to be output, and send the audio signal to be output to an external digital power amplifier 403 located outside the in-vehicle infotainment device 10. The external digital power amplifier 403 located outside the in-vehicle infotainment device 10 may process the audio signal to be output, and send the second audio signal in the form of a digital signal with the original sampling rate of 48k to the second digital-to-analog conversion module 502 located in the in-vehicle infotainment device 10 through the in-vehicle audio bus, so that the second digital-to-analog conversion module 502 located in the in-vehicle infotainment device 10 may perform signal conversion on the second audio signal in the form of a digital signal, and send the obtained second audio signal in the form of an analog signal to the audio processing module 101. The vehicle-mounted digital microphone 202 may collect a first audio signal in the form of a digital signal in a vehicle, and send the first audio signal in the form of a digital signal with an original sampling rate of 16k to the first digital-to-analog conversion module 501 in the vehicle-mounted infotainment device 10 through the vehicle-mounted audio bus, so that the first digital-to-analog conversion module 501 in the vehicle-mounted infotainment device 10 may perform signal conversion on the first audio signal in the form of a digital signal, and send the obtained first audio signal in the form of an analog signal to the audio processing module 101. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the first audio signal and the second audio signal based on the first timestamp corresponding to the first audio signal and the second timestamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after the time alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may perform resampling processing on the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and based on a time division multiplexing transmission manner, pass the third audio signal and the fourth audio signal through the lightweight library, the audio hardware abstraction layer module, and the audio thrower through the same channel: the progress recording module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the time-corrected third audio signal and the time-corrected fourth audio signal are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the third audio signal, so that the communication quality is improved.
Illustratively, the second digital-to-analog conversion module 502 is connected with the external digital power amplifier 403 through a target car audio bus; the second digital-to-analog conversion module 502 is further configured to: acquiring an audio signal to be output, and sending the audio signal to be output to the external digital power amplifier 403 through the target vehicle-mounted audio bus; the external digital power amplifier 403 is specifically configured to: the audio signal to be output is processed, and the obtained second audio signal in the form of a digital signal is sent to the second digital-to-analog conversion module 502 through the target vehicle-mounted audio bus.
The target car audio bus may be a car audio bus A2B used for connecting the second digital-to-analog conversion module 502 and the external digital power amplifier 403 and performing bidirectional data transmission, so that the second digital-to-analog conversion module 502 receives the audio signal to be output first, and the target car audio bus forwards the audio signal to be output to the external digital power amplifier 403, so that the external digital power amplifier 403 may also return the determined second audio signal to the second digital-to-analog conversion module 502 through the target car audio bus, and for the external digital power amplifier 403, the same target car audio bus may be used for bidirectional data transmission, thereby saving transmission cost.
Example two
Fig. 8 is a schematic structural diagram of an audio processing system according to a second embodiment of the present invention. The embodiment further optimizes the audio processing system on the basis of the scheme of the embodiment. As shown in fig. 8, the system further includes: an external microphone 60; the external microphone 60 is configured to collect a seventh audio signal in the vehicle, and send the seventh audio signal to the audio processing module 101 in a wireless connection manner; the audio processing module 101 is configured to perform time correction and resampling on the seventh audio signal and the second audio signal, obtain an eighth audio signal and a ninth audio signal that correspond to the same sampling rate, and send the eighth audio signal and the ninth audio signal to the echo processing module 102 through the same channel based on a time division multiplexing transmission manner; the echo processing module 102 is configured to perform echo cancellation processing on the eighth audio signal based on the ninth audio signal, and determine a user audio signal in the eighth audio signal.
The external microphone 60 may be a microphone connected to the vehicle through a USB interface. For example, when using the karaoke application, the external microphone 60 may be connected to the vehicle. The external microphone 60 may be an external analog microphone whose output signal is in the form of an analog signal, or may be an external digital microphone whose output signal is in the form of a digital signal. The wireless connection mode may refer to, but is not limited to, a bluetooth connection mode. For example, a bluetooth connection may be performed between a bluetooth module in the USB interface of the external microphone 60 and a bluetooth module in the audio processing module 101, so that the external microphone 60 may transmit the seventh audio signal to the audio processing module 101 through the bluetooth connection. The seventh audio signal may refer to a user audio signal doped with sound emitted by the speaker 30. The eighth audio signal may be an audio signal obtained by the audio processing module 101 performing resampling processing on the seventh audio signal after time correction based on the same sampling rate. The ninth audio signal may refer to an audio signal obtained by the audio processing module 101 performing resampling processing on the time-corrected second audio signal based on the same sampling rate.
Illustratively, for the different forms of the external microphone 60 given above, the audio processing system may implement audio processing operations by two system architectures:
fig. 9 shows an exemplary architecture of an audio processing system as a first implementation. As shown in fig. 9, the external microphone 60 is an external analog microphone 601. The external analog microphone 601 may collect a seventh audio signal in the form of an analog signal in the vehicle, and send the seventh audio signal in the form of an analog signal to the audio processing module 101 in a wireless connection manner. The power amplifier 40 may process the audio signal to be output and send the obtained second audio signal to the speaker 30 and the audio processing module 101.
Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine the sound signal as a navigation sound audio signal by a sound source module in the in-vehicle infotainment device 10, and send the navigation sound audio signal to an audio thrower: and the process tracking module is used for transmitting the navigation audio signal to the audio hardware abstraction layer module through the synchronous remote control mixer thread and applying for Navi TTS. The android controller can call Navi tts.pcm in the lightweight library to generate an audio signal to be output, and send the audio signal to be output to the power amplifier 40. The power amplifier 40 performs power amplification processing on the audio signal to be output to obtain a second audio signal in the form of an analog signal, and sends the second audio signal in the form of an analog signal with the original sampling rate of 48k to the speaker 30 and the audio processing module 101 in the in-vehicle infotainment device 10 through the analog twisted pair. The external analog microphone 601 may collect a seventh audio signal in the form of an analog signal in the vehicle, and send the seventh audio signal in the form of an analog signal with an original sampling rate of 16k to the audio processing module 101 in the in-vehicle infotainment device 10 in a wireless connection manner. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the seventh audio signal and the second audio signal based on the first timestamp corresponding to the seventh audio signal and the second timestamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after the time-alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may resample and process the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, obtain an eighth audio signal and a ninth audio signal corresponding to the preset sampling rate, and pass the eighth audio signal and the ninth audio signal through the lightweight class library, the audio hardware abstraction layer module, and the audio thrower through the same channel based on a time division multiplexing transmission manner: the progress recording module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the eighth audio signal and the ninth audio signal after time correction are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the eighth audio signal based on the ninth audio signal transmitted synchronously, so that the user audio signal in the eighth audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the in-vehicle infotainment device, and the conversation quality is improved.
As a second implementation, fig. 10 shows an exemplary diagram of an architecture of another audio processing system. As shown in fig. 10, the external microphone 60 is an external digital microphone 602. The external digital microphone 602 may collect a seventh audio signal in the form of a digital signal in the vehicle, and send the seventh audio signal in the form of a digital signal to the first digital-to-analog conversion module 501 in a wireless connection manner; the first digital-to-analog conversion module 501 may perform signal conversion on the seventh audio signal in the form of a digital signal, and send the obtained seventh audio signal in the form of an analog signal to the audio processing module 101. The power amplifier 40 may process the audio signal to be output and send the obtained second audio signal to the speaker 30 and the audio processing module 101.
Specifically, for the navigation sound, the in-vehicle infotainment device 10 may determine the sound signal as a navigation sound audio signal by a sound source module in the in-vehicle infotainment device 10, and send the navigation sound audio signal to an audio thrower: and the process tracking module is used for transmitting the navigation audio signal to the audio hardware abstraction layer module through the synchronous remote control mixer thread and applying for Navi TTS. The android controller may invoke Navi tts.pcm in the lightweight library to generate an audio signal to be output, and send the audio signal to be output to the power amplifier 40. The power amplifier 40 performs power amplification processing on the audio signal to be output to obtain a second audio signal in the form of an analog signal, and sends the second audio signal in the form of an analog signal with an original sampling rate of 48k to the speaker 30 and the audio processing module 101 in the in-vehicle infotainment device 10 through an analog twisted pair. The external digital microphone 602 may collect a seventh audio signal in the form of a digital signal in the vehicle, and send the seventh audio signal in the form of a digital signal with an original sampling rate of 16k to the first digital-to-analog conversion module 501 in the in-vehicle infotainment device 10 in a wireless connection manner, so that the seventh digital-to-analog conversion module 501 in the in-vehicle infotainment device 10 may perform signal conversion on the seventh audio signal in the form of a digital signal, and send the obtained seventh audio signal in the form of an analog signal to the audio processing module 101. The audio processing module 101 in the in-vehicle infotainment device 10 may time-align the seventh audio signal and the second audio signal based on the first time stamp corresponding to the seventh audio signal and the second time stamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after the time-alignment. The audio processing module 101 in the in-vehicle infotainment device 10 may perform resampling processing on the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate, for example, the preset sampling rate is 48k, to obtain an eighth audio signal and a ninth audio signal corresponding to the preset sampling rate, and based on a time division multiplexing transmission manner, pass the eighth audio signal and the ninth audio signal through the lightweight library, the audio hardware abstraction layer module, and the audio thrower through the same channel: the progress recording module is finally sent to the echo processing module 102 in the in-vehicle infotainment device 10 to ensure that the eighth audio signal and the ninth audio signal after time correction are transmitted synchronously, i.e. no time difference occurs during transmission. The echo processing module 102 in the in-vehicle infotainment device 10 can accurately perform echo cancellation processing on the eighth audio signal based on the ninth audio signal transmitted synchronously, so that the user audio signal in the eighth audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can hear the user music more clearly in the process of passing through the in-vehicle infotainment device, and the conversation quality is improved.
It should be noted that the power amplifier 40 in this embodiment may also be an internal analog power amplifier located in the in-vehicle infotainment device 10, or an external analog power amplifier or an external digital power amplifier located outside the in-vehicle infotainment device 10, and generally, there is no internal digital power amplifier in the vehicle, and the specific processing flow thereof is the same as that in the above-mentioned embodiment, and is not described here again.
According to the technical scheme of the embodiment of the invention, an external microphone 60 is used for collecting a seventh audio signal in a vehicle, and the seventh audio signal is sent to an audio processing module 101 in a wireless connection mode; if the external microphone 60 acquires that the seventh audio signal in the vehicle is in a digital signal form, before the seventh audio signal is sent to the audio processing module 101, the seventh audio signal in the digital signal form acquired by the external microphone 60 in the vehicle needs to be sent to the first digital-to-analog conversion module 501, so that the first digital-to-analog conversion module 501 converts the seventh audio signal in the digital signal form into the seventh audio signal in an analog signal form, and the converted seventh audio signal is sent to the audio processing module 101. The seventh audio signal and the second audio signal can be time-corrected and resampled by the audio processing module 101 to obtain an eighth audio signal and a ninth audio signal corresponding to the same sampling rate, and the eighth audio signal and the ninth audio signal are sent to the echo processing module 102 through the same channel based on a time division multiplexing transmission mode, so that the eighth audio signal and the ninth audio signal are ensured to be synchronously transmitted without time deviation, and the echo processing module 102 can accurately perform echo cancellation processing on the eighth audio signal based on the synchronously transmitted ninth audio signal to identify the user audio signal in the eighth audio signal, thereby improving the accuracy of user audio identification and further improving the call quality.
EXAMPLE III
Fig. 11 is a flowchart of an audio processing method according to a third embodiment of the present invention. The audio processing method provided by the embodiment can be suitable for performing echo cancellation processing on the collected user voice. Wherein, the audio processing system includes: an in-vehicle infotainment device, an in-vehicle microphone, a speaker, and a power amplifier. As shown in fig. 11, the audio processing method specifically includes the following steps:
s910, collecting a first audio signal in the vehicle through a vehicle-mounted microphone, and sending the first audio signal to an audio processing module in the vehicle-mounted information entertainment device.
The first audio signal may refer to a user audio signal doped with sound emitted by a speaker. The vehicle-mounted information entertainment device comprises an audio processing module and an echo processing module. For example, an in-vehicle infotainment device may be referred to as an IVI.
Specifically, the vehicle-mounted microphone can collect a first audio signal in the vehicle and send the first audio signal to an audio processing module in the vehicle-mounted infotainment device.
And S920, processing the audio signal to be output through a power amplifier, and sending the obtained second audio signal to a loudspeaker and an audio processing module.
The audio signal to be output may be an audio signal obtained by an audio response module in the vehicle-mounted infotainment device responding to the voice of the user, that is, an audio signal requiring power amplification. For example, the audio signal to be output may refer to an audio signal such as a media sound, a navigation sound, an alarm sound, or the like to be output. The second audio signal may be an audio signal obtained by performing operations such as power amplification and sound effect processing on an audio signal to be output through a power amplifier. For example, the power amplifier may be referred to as an on-board DSP.
Specifically, the power amplifier may perform power amplification processing on the audio signal to be output, and send the obtained second audio signal to the speaker and the audio processing module.
S930, performing time correction and resampling processing on the first audio signal and the second audio signal through the audio processing module to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and sending the third audio signal and the fourth audio signal to an echo processing module in the vehicle-mounted information entertainment device through the same channel based on a time division multiplexing transmission mode.
The time correction may refer to a timing adjustment operation performed on the plurality of signals based on a uniform time index point. For example, the timestamp point may refer to a timestamp. The resampling process may refer to a process of changing the number of sampling points of the original audio signal based on a preset sampling rate to generate a new audio signal. For example, the resampling may resample an audio signal with a sampling rate of 16k to an audio signal with a sampling rate of 48k. The resampling ratio may be, but is not limited to, 16k or 48k. The third audio signal may refer to an audio signal obtained by the audio processing module resampling processing the time-corrected first audio signal based on the same sampling rate. The fourth audio signal may be obtained by resampling, by the audio processing module, the time-corrected second audio signal based on the same sampling rate. The third audio signal and the fourth audio signal may refer to homologous audio signals, i.e. the third audio signal and the fourth audio signal have the same sampling rate. The time division multiplexing transmission mode may refer to a communication mode in which different signals are interleaved in different time periods, transmitted along the same channel, and the signals in each time period are extracted and restored to the original signals at the receiving end. The time division multiplexing transmission method can transmit multiple signals on the same channel. The same channel ensures that data is transmitted synchronously, i.e. no time difference occurs during transmission.
Specifically, the audio processing module performs time correction and resampling on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and sends the third audio signal and the fourth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission mode, so as to ensure that the third audio signal and the fourth audio signal after the time correction are transmitted synchronously, that is, a time difference does not occur during transmission.
And S940, the echo processing module performs echo cancellation processing on the third audio signal based on the fourth audio signal, and determines the user audio signal in the third audio signal.
Wherein, the echo processing module may be referred to as ECNR. The user audio signal may refer to an audio signal emitted by the user himself, that is, an audio signal not doped with the output audio of the speaker.
Specifically, the echo processing module can accurately perform echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then in the process of passing through with the opposite party, the opposite party can hear user music more clearly, so that the call quality is improved.
It should be noted that there may be multiple sets of speakers in the vehicle, and each set of speakers may include one or more speakers. Correspondingly, the power amplifier outputs a plurality of second audio signals, and the number of the output second audio signals is the same as the number of the sets of the speakers, that is, each second audio signal output by the power amplifier is input to the corresponding set of the speakers, so that the sound in the vehicle presents surround sound. The surround sound in the vehicle may be formed by a plurality of sounds emitted by a plurality of sets of speakers in the vehicle based on the plurality of second audio signals. In view of this, the power amplifier performs time correction and resampling processing on all the output second audio signals in the audio processing module, so as to further improve the accuracy of user audio identification.
According to the technical scheme of the embodiment of the invention, the first audio signal in the vehicle can be collected through the vehicle-mounted microphone, and the first audio signal is sent to the audio processing module in the vehicle-mounted information entertainment device. The power amplifier can process the audio signal to be output and send the obtained second audio signal to the loudspeaker and the audio processing module. The audio processing module performs time correction and resampling processing on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and sends the third audio signal and the fourth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission mode to ensure synchronous transmission of the third audio signal and the fourth audio signal after time correction, namely, no time difference occurs during transmission. The echo processing module can accurately perform echo cancellation processing on the third audio signal based on the fourth audio signal transmitted synchronously, so that the user audio signal in the third audio signal can be accurately identified, the accuracy of user audio identification is improved, and then the opposite side can more clearly hear the user music in the process of passing through the third audio signal, so that the conversation quality is improved.
On the basis of the above technical solution, the audio processing module may include: performing time alignment on the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal to obtain a fifth audio signal and a sixth audio signal after the time alignment; and on the basis of a preset sampling rate, resampling the fifth audio signal and the sixth audio signal respectively to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and on the basis of a time division multiplexing transmission mode, sending the third audio signal and the fourth audio signal to the echo processing module through the same channel.
Wherein the time stamp may be used to identify the time of generation of each audio signal to distinguish between audio signals generated at different times. The time stamp may be used to time correct the plurality of data information. The fifth audio signal may refer to the time-aligned first audio signal. The sixth audio signal may refer to the time-aligned second audio signal. The preset sampling rate may refer to a preset resampling rate that meets the signal transmission requirement. For example, the preset resampling ratio may refer to 48k.
Specifically, the audio processing module in the in-vehicle infotainment device may perform time alignment on the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal, and obtain a fifth audio signal and a sixth audio signal after the time alignment, so as to implement synchronous processing of the fifth audio signal and the sixth audio signal. The audio processing module in the vehicle-mounted information entertainment device can resample and process the fifth audio signal and the sixth audio signal respectively based on a preset sampling rate to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, so that the sampling rates of the third audio signal and the fourth audio signal are consistent, and accurate echo cancellation processing with the same sampling rate is realized. The audio processing module in the vehicle-mounted information entertainment device can send the third audio signal and the fourth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission mode, so that the echo processing module is ensured to receive the third audio signal and the fourth audio signal without time difference, echo cancellation can be accurately carried out, and the user audio signal in the third audio signal can be identified.
Illustratively, the vehicle microphone may include: a vehicle-mounted analog microphone or a vehicle-mounted digital microphone; the power amplifier may comprise an internal analog power amplifier located within the in-vehicle infotainment device, or an external analog power amplifier located external to the in-vehicle infotainment device, or an external digital power amplifier located external to the in-vehicle infotainment device.
For example, when the vehicle-mounted microphone is a vehicle-mounted analog microphone, the vehicle-mounted analog microphone may collect a first audio signal in the form of an analog signal in the vehicle, and send the first audio signal in the form of the analog signal to the audio processing module through the analog twisted pair.
The analog twisted pair may be a line for data transmission, which is composed of two copper wires with an insulation protective layer.
Illustratively, when the vehicle microphone is a vehicle digital microphone, the vehicle infotainment device may further include: a first digital-to-analog conversion module; the vehicle-mounted digital microphone can acquire a first audio signal in a digital signal form in a vehicle and sends the first audio signal in the digital signal form to the first digital-to-analog conversion module through the vehicle-mounted audio bus; the first digital-to-analog conversion module can perform signal conversion on the first audio signal in the form of a digital signal and send the obtained first audio signal in the form of an analog signal to the audio processing module.
Wherein, the car audio bus can be referred to as A2B. The A2B bus is a vehicle-mounted high-bandwidth, bidirectional and digital audio bus and adopts a daisy chain structure. The A2B bus supports at most 11 nodes (10 slave nodes), the distance between the nodes is at most 15 meters, and the whole daisy chain is at most 40 meters.
For example, when the power amplifier is an internal analog power amplifier or an external analog power amplifier, the internal analog power amplifier or the external analog power amplifier may process an audio signal to be output, and send the obtained second audio signal in the form of an analog signal to the speaker and the audio processing module through the analog twisted pair.
Illustratively, when the power amplifier is an external digital power amplifier, the in-vehicle infotainment device further includes: a second digital-to-analog conversion module; the external digital power amplifier can process the audio signal to be output and send the obtained second audio signal in the form of a digital signal to the second digital-to-analog conversion module through the vehicle-mounted audio bus; the second digital-to-analog conversion module may perform signal conversion on the second audio signal in the form of a digital signal, and send the obtained second audio signal in the form of an analog signal to the audio processing module.
Exemplarily, the second digital-to-analog conversion module is connected with the external digital power amplifier through a target vehicle-mounted audio bus; the second digital-to-analog conversion module can also acquire an audio signal to be output and send the audio signal to be output to the external digital power amplifier through the target vehicle-mounted audio bus; the external digital power amplifier can process the audio signal to be output and send the obtained second audio signal in the form of a digital signal to the second digital-to-analog conversion module through the target vehicle-mounted audio bus.
The target vehicle-mounted audio bus may be a vehicle-mounted audio bus A2B used for connecting the second digital-to-analog conversion module and the external digital power amplifier and performing data bidirectional transmission, so that the second digital-to-analog conversion module receives the audio signal to be output first, and the target vehicle-mounted audio bus forwards the audio signal to be output to the external digital power amplifier, so that the external digital power amplifier can also return the determined second audio signal to the second digital-to-analog conversion module through the target vehicle-mounted audio bus, and for the external digital power amplifier, the same target vehicle-mounted audio bus can be used for performing data bidirectional transmission, thereby saving transmission cost.
Illustratively, the system further comprises: an external microphone; the method further comprises the following steps: the external microphone can collect a seventh audio signal in the vehicle and send the seventh audio signal to the audio processing module in a wireless connection mode; the audio processing module can perform time correction and resampling processing on the seventh audio signal and the second audio signal to obtain an eighth audio signal and a ninth audio signal corresponding to the same sampling rate, and send the eighth audio signal and the ninth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission mode; the echo processing module may perform echo cancellation processing on the eighth audio signal based on the ninth audio signal, and determine a user audio signal in the eighth audio signal.
The external microphone may be a microphone connected to the vehicle through a USB interface. For example, when using the karaoke application, an external microphone may be connected to the vehicle. The external microphone may be an external analog microphone whose output signal is in the form of an analog signal, or an external digital microphone whose output signal is in the form of a digital signal. The wireless connection mode may refer to, but is not limited to, a bluetooth connection mode. For example, the bluetooth module in the USB interface connected to the external microphone may be bluetooth connected to the bluetooth module in the audio processing module, so that the external microphone may send the seventh audio signal to the audio processing module by means of bluetooth connection. The seventh audio signal may refer to a user audio signal doped with sound emitted by a speaker. The eighth audio signal may be an audio signal obtained by resampling the seventh audio signal after time correction by the audio processing module based on the same sampling rate. The ninth audio signal may be an audio signal obtained by the audio processing module performing resampling processing on the time-corrected second audio signal based on the same sampling rate.
Specifically, a seventh audio signal in the vehicle is collected based on an external microphone, and the seventh audio signal is sent to an audio processing module in a wireless connection mode; if the external microphone acquires that the seventh audio signal in the vehicle is in a digital signal form, before the seventh audio signal is sent to the audio processing module, the seventh audio signal in the digital signal form acquired by the external microphone in the vehicle needs to be sent to the first digital-to-analog conversion module, so that the first digital-to-analog conversion module converts the seventh audio signal in the digital signal form into the seventh audio signal in an analog signal form, and the converted seventh audio signal is sent to the audio processing module. The seventh audio signal and the second audio signal can be subjected to time correction and resampling processing based on the audio processing module, an eighth audio signal and a ninth audio signal corresponding to the same sampling rate are obtained, and the eighth audio signal and the ninth audio signal are sent to the echo processing module through the same channel based on a time division multiplexing transmission mode, so that synchronous transmission of the eighth audio signal and the ninth audio signal is guaranteed, time deviation does not exist, and then the eighth audio signal can be accurately subjected to echo cancellation processing based on the ninth audio signal synchronously transmitted by the echo processing module, so that a user audio signal in the eighth audio signal is identified, the accuracy of user audio identification is further improved, and the conversation quality can be further improved.
Example four
Fig. 12 is a schematic structural diagram of a vehicle according to a fourth embodiment of the present invention. The vehicle may include an audio processing system 70. The audio processing system 70 may be the audio processing system provided in any of the above embodiments, and is configured to perform the audio processing method provided in any of the above embodiments. For example, the audio processing system 70 may include: the system comprises a vehicle-mounted information entertainment device, a vehicle-mounted microphone, a loudspeaker and a power amplifier; the vehicle-mounted information entertainment device comprises an audio processing module and an echo processing module;
the vehicle-mounted microphone is used for acquiring a first audio signal in a vehicle and sending the first audio signal to the audio processing module; the power amplifier is used for processing the audio signal to be output and sending the obtained second audio signal to the loudspeaker and the audio processing module; the audio processing module is used for carrying out time correction and resampling processing on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and sending the third audio signal and the fourth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission mode; the echo processing module is used for performing echo cancellation processing on the third audio signal based on the fourth audio signal and determining a user audio signal in the third audio signal.
According to the technical scheme of the embodiment of the invention, the vehicle-mounted microphone can be used for collecting the first audio signal in the vehicle and sending the first audio signal to the audio processing module in the vehicle-mounted information entertainment device. The power amplifier can be used for processing the audio signal to be output and sending the obtained second audio signal to the loudspeaker and the audio processing module. The audio processing module is used for carrying out time correction and resampling processing on the first audio signal and the second audio signal to obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and the third audio signal and the fourth audio signal are sent to the echo processing module through the same channel based on a time division multiplexing transmission mode, so that the third audio signal and the fourth audio signal are ensured to be synchronously transmitted, no time deviation exists, and then the echo processing module can accurately carry out echo cancellation processing on the third audio signal based on the synchronously transmitted fourth audio signal to identify the user audio signal in the third audio signal, so that the accuracy of user audio identification is improved, and the conversation quality can be improved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (11)
1. An audio processing system, the system comprising: the system comprises a vehicle-mounted information entertainment device, a vehicle-mounted microphone, a loudspeaker and a power amplifier; the vehicle-mounted information entertainment device comprises an audio processing module and an echo processing module; wherein the content of the first and second substances,
the vehicle-mounted microphone is used for collecting a first audio signal in a vehicle and sending the first audio signal to the audio processing module;
the power amplifier is used for processing an audio signal to be output and sending an obtained second audio signal to the loudspeaker and the audio processing module;
the audio processing module is configured to perform time correction and resampling on the first audio signal and the second audio signal, obtain a third audio signal and a fourth audio signal corresponding to the same sampling rate, and send the third audio signal and the fourth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission manner;
the echo processing module is configured to perform echo cancellation processing on the third audio signal based on the fourth audio signal, and determine a user audio signal in the third audio signal.
2. The system of claim 1, wherein the audio processing module is specifically configured to:
performing time alignment on the first audio signal and the second audio signal based on a first time stamp corresponding to the first audio signal and a second time stamp corresponding to the second audio signal to obtain a fifth audio signal and a sixth audio signal after time alignment;
and on the basis of a preset sampling rate, the fifth audio signal and the sixth audio signal are respectively subjected to resampling processing to obtain a third audio signal and a fourth audio signal corresponding to the preset sampling rate, and on the basis of a time division multiplexing transmission mode, the third audio signal and the fourth audio signal are sent to the echo processing module through the same channel.
3. The system of claim 1, wherein the in-vehicle microphone is an in-vehicle analog microphone or an in-vehicle digital microphone;
the power amplifier is an internal analog power amplifier positioned in the vehicle-mounted information entertainment device, or the power amplifier is an external analog power amplifier or an external digital power amplifier positioned outside the vehicle-mounted information entertainment device.
4. The system of claim 3, wherein when the in-vehicle microphone is an in-vehicle analog microphone, the in-vehicle analog microphone is specifically configured to: the method comprises the steps of collecting a first audio signal in the form of an analog signal in a vehicle, and sending the first audio signal in the form of the analog signal to the audio processing module through an analog twisted pair.
5. The system of claim 3, wherein when the in-vehicle microphone is an in-vehicle digital microphone, the in-vehicle infotainment device further comprises: a first digital-to-analog conversion module;
the vehicle-mounted digital microphone is specifically configured to: acquiring a first audio signal in a digital signal form in a vehicle, and sending the first audio signal in the digital signal form to the first digital-to-analog conversion module through a vehicle-mounted audio bus;
the first digital-to-analog conversion module is used for performing signal conversion on the first audio signal in the digital signal form and sending the obtained first audio signal in the analog signal form to the audio processing module.
6. The system of claim 3, wherein when the power amplifier is an internal analog power amplifier or an external analog power amplifier, the internal analog power amplifier or the external analog power amplifier is specifically configured to: and processing the audio signal to be output, and sending the obtained second audio signal in the analog signal form to the loudspeaker and the audio processing module through the analog twisted pair.
7. The system of claim 3, wherein when the power amplifier is an external digital power amplifier, the in-vehicle infotainment device further comprises: a second digital-to-analog conversion module;
the external digital power amplifier is specifically configured to: processing the audio signal to be output, and sending the obtained second audio signal in the form of a digital signal to the second digital-to-analog conversion module through a vehicle-mounted audio bus;
the second digital-to-analog conversion module is configured to: and performing signal conversion on the second audio signal in the digital signal form, and sending the obtained second audio signal in the analog signal form to the audio processing module.
8. The system of claim 7, wherein the second digital-to-analog conversion module is connected with the external digital power amplifier through a target car audio bus;
the second digital-to-analog conversion module is further configured to: acquiring an audio signal to be output, and sending the audio signal to be output to the external digital power amplifier through the target vehicle-mounted audio bus;
the external digital power amplifier is specifically configured to: and processing the audio signal to be output, and sending the obtained second audio signal in the form of a digital signal to the second digital-to-analog conversion module through the target vehicle-mounted audio bus.
9. The system of claim 1, further comprising: an external microphone;
the external microphone is used for acquiring a seventh audio signal in the vehicle and sending the seventh audio signal to the audio processing module in a wireless connection mode;
the audio processing module is configured to perform time correction and resampling on the seventh audio signal and the second audio signal, obtain an eighth audio signal and a ninth audio signal that correspond to the same sampling rate, and send the eighth audio signal and the ninth audio signal to the echo processing module through the same channel based on a time division multiplexing transmission manner;
the echo processing module is configured to perform echo cancellation processing on the eighth audio signal based on the ninth audio signal, and determine a user audio signal in the eighth audio signal.
10. An audio processing method applied to an audio processing system, the audio processing system comprising: the system comprises a vehicle-mounted information entertainment device, a vehicle-mounted microphone, a loudspeaker and a power amplifier; the method comprises the following steps:
acquiring a first audio signal in a vehicle through the vehicle-mounted microphone, and sending the first audio signal to an audio processing module in the vehicle-mounted information entertainment device;
processing an audio signal to be output through the power amplifier, and sending an obtained second audio signal to the loudspeaker and the audio processing module;
time correction and resampling are carried out on the first audio signal and the second audio signal through the audio processing module, a third audio signal and a fourth audio signal which correspond to the same sampling rate are obtained, and the third audio signal and the fourth audio signal are sent to an echo processing module in the vehicle-mounted information entertainment device through the same channel based on a time division multiplexing transmission mode;
and performing echo cancellation processing on the third audio signal based on the fourth audio signal through the echo processing module, and determining a user audio signal in the third audio signal.
11. A vehicle, characterized in that the vehicle comprises an audio processing system according to any of claims 1-9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210931628.8A CN115297404A (en) | 2022-08-04 | 2022-08-04 | Audio processing system and method and vehicle |
| PCT/CN2023/110751 WO2024027760A1 (en) | 2022-08-04 | 2023-08-02 | Audio processing system and method, and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210931628.8A CN115297404A (en) | 2022-08-04 | 2022-08-04 | Audio processing system and method and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115297404A true CN115297404A (en) | 2022-11-04 |
Family
ID=83825939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210931628.8A Pending CN115297404A (en) | 2022-08-04 | 2022-08-04 | Audio processing system and method and vehicle |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115297404A (en) |
| WO (1) | WO2024027760A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024027760A1 (en) * | 2022-08-04 | 2024-02-08 | 中国第一汽车股份有限公司 | Audio processing system and method, and vehicle |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106910510A (en) * | 2017-02-16 | 2017-06-30 | 智车优行科技（北京）有限公司 | Vehicle-mounted power amplifying device, vehicle and its audio play handling method |
| CN107610713B (en) * | 2017-10-23 | 2022-02-01 | 科大讯飞股份有限公司 | Echo cancellation method and device based on time delay estimation |
| KR20200033617A (en) * | 2018-09-20 | 2020-03-30 | 현대자동차주식회사 | In-vehicle apparatus for recognizing voice and method of controlling the same |
| CN109817238B (en) * | 2019-03-14 | 2021-08-24 | 百度在线网络技术（北京）有限公司 | Audio signal acquisition device, audio signal processing method and device |
| CN111883158B (en) * | 2020-07-30 | 2024-04-16 | 广州易点智慧出行科技有限公司 | Echo cancellation method and device |
| CN112309416B (en) * | 2020-10-20 | 2022-11-29 | 中国第一汽车股份有限公司 | Vehicle-mounted voice echo eliminating method, system, vehicle and storage medium |
| CN115297404A (en) * | 2022-08-04 | 2022-11-04 | 中国第一汽车股份有限公司 | Audio processing system and method and vehicle |
-
2022
- 2022-08-04 CN CN202210931628.8A patent/CN115297404A/en active Pending
-
2023
- 2023-08-02 WO PCT/CN2023/110751 patent/WO2024027760A1/en unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024027760A1 (en) * | 2022-08-04 | 2024-02-08 | 中国第一汽车股份有限公司 | Audio processing system and method, and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024027760A1 (en) | 2024-02-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11871176B2 (en) | Far-field pickup device and method for collecting voice signal in far-field pickup device | |
| CN109192203B (en) | Multi-sound-zone voice recognition method, device and storage medium | |
| WO2016031673A1 (en) | Acoustic processing device and information provision method | |
| WO2024027760A1 (en) | Audio processing system and method, and vehicle | |
| JP2009300537A (en) | Speech actuation system, speech actuation method and in-vehicle device | |
| CN109817214B (en) | Interaction method and device applied to vehicle | |
| CN102640522A (en) | Audio data processing device, audio device, audio data processing method, program, and recording medium that has recorded said program | |
| CN113409808B (en) | Echo cancellation time delay estimation method and echo cancellation method | |
| US4109104A (en) | Vocal timing indicator device for use in voice recognition | |
| JP2012208218A (en) | Electronic apparatus | |
| CN101523483A (en) | Method for the rendition of text information by speech in a vehicle | |
| JP2017212750A (en) | Reproduction system, terminal device, information providing method, operation method of terminal device, and program | |
| CN213123757U (en) | Car fills and K sings system in car | |
| US11735187B2 (en) | Hybrid routing for hands-free voice assistant, and related systems and methods | |
| JP2009200535A (en) | Serial data transmission device | |
| CN210075216U (en) | Signal transmitting/receiving device and vehicle-mounted audio system | |
| CN100508057C (en) | Audio playing device and audio playing method | |
| US10080252B2 (en) | Synchronous recording of audio using wireless data transmission | |
| JP4845249B2 (en) | Method for wirelessly transmitting information between a communication system in a vehicle and a central computer outside the vehicle | |
| JPH0937397A (en) | Method and device for localization of sound image | |
| JP6596144B2 (en) | Information providing method, sound processing apparatus, and program | |
| CN215818639U (en) | Time delay compensation system | |
| CN114420146A (en) | Audio data processing method and device, electronic equipment and storage medium | |
| WO2020144990A1 (en) | Array microphone and sensor system | |
| JP2019169949A (en) | Speech processing system and speech processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |