TWM615237U - Two-channel audio processing system - Google Patents

Abstract

The present application is a two-channel audio processing system. The audio processing system is configured to a head-mounted device. The audio processing system includes at least a head-related impulse response function unit and a positioning mixing unit. The head-related position impulse response function unit is used to generate a head-related pulse function signal according to the inertial measurement signal of the head-mounted device, and the positioning mixing unit is used to generate a head-related pulse function signal according to the multi-channel input audio signal and the head-related pulse The function signal performs audio positioning to generate a multi-channel output audio, and performs down-mixing on the multi-channel output audio to obtain a two-channel output audio, thereby enhancing the user's realization of multi-channel audio processing systems. Convenience of channel audio data.

Description

Two-channel audio processing system

This application relates to an audio processing system, especially a two-channel audio processing system.

With the mature development of consumer electronic products and the changing needs of users, various products are constantly being introduced and new, such as earphones, head-mounted displays and other electronic devices. Users can choose suitable electronic devices according to their needs.

At the same time, users have a higher demand for audio and video experience. Generally speaking, users can get a better audio experience by selecting multi-channel audio data. However, two-channel audio data is commonly used at present, and multi-channel audio data is not popular. In addition, multi-channel audio data is preset fixed audio data, so its multi-channel audio data cannot be based on real-time basis. The user's environment conditions when listening to make corresponding sound field adjustments.

Therefore, in order for users to have a better sound experience, it is indeed necessary to propose a better solution.

In view of the above-mentioned shortcomings of the prior art, the main purpose of this application is to provide a dual-channel audio processing system that adjusts the sound field positioning of multi-channel audio data based on the displacement information sensed by the user's headset. Channel audio data is converted into two-channel audio data for output, thereby realizing the sound effects of multi-channel audio data with two-channel audio data, allowing users to have a better audio experience, and enhancing the user’s use of two-channel audio data. The audio processing system realizes the convenience of multi-channel audio data.

The main technical means adopted to achieve the above objective is the aforementioned dual-channel audio processing system, and the audio processing system is configured in a head-mounted device. The audio processing system includes: A head-related position impulse response function unit for generating a head-related impulse function signal according to the inertial measurement signal of the head-mounted device; and A positioning mixing unit is electrically connected to the impulse response function unit at the relative position of the head, Wherein, the positioning mixing unit is used to obtain a multi-channel input audio and the head-related pulse function signal, and perform audio positioning accordingly to generate a multi-channel output audio, and perform a reduction on the multi-channel output audio. Mix to get a two-channel output audio.

With the above structure, the positioning mixing unit obtains the multi-channel input audio and the head-related pulse function signal, and then performs audio positioning to generate the corresponding multi-channel output audio, and converts the multi-channel output audio It outputs audio in two channels, so that the structure can respond to the displacement state of the user's head in real time, produce corresponding sound field changes, and realize the sound effect of multi-channel audio data with two-channel audio data, so that you can use it. It has a better sound experience and enhances the convenience for users to implement multi-channel audio data with a dual-channel audio processing system.

Regarding the embodiment of the dual-channel audio processing system of this application, please refer to FIG. 1. The audio processing system 100 is a processing system configured in a head-mounted device and includes at least one head-related position impulse response function unit 110 and a positioning mixing unit 130.

The head-related position impulse response function unit 110 is used for generating a head-related impulse function signal according to the inertial measurement signal of the head-mounted device. The positioning mixing unit 130 and the head-related position impulse response function unit 110 are electrically connected. Connected to obtain a multi-channel input audio S _mi and the head-related impulse function signal, and _{perform audio localization on the received multi-channel input audio S mi} according to the head-related impulse function signal, and generate a corresponding Multi-channel output audio, and downmix the multi-channel output audio to obtain a dual-channel output audio.

Because the audio processing system 100 of the present application can instantly reflect the displacement state of the user’s head according to the inertial measurement signal, and the head related pulse function signal defines the real-time multi-channel sound field change corresponding to the user Therefore, the present application can instantly generate corresponding sound field changes according to the displacement state of the user’s head, and output two-channel output audio suitable for existing headsets, which not only allows users to have a better sound experience, but also improves The user realizes the convenience of multi-channel audio data with a dual-channel audio processing system.

For another embodiment of the dual-channel audio processing system of the present application, please refer to FIG. 2. The audio processing system 100 may further include a spatial processing unit 150, an up-mixing unit 170, and an inertia correction unit 190 .

The spatial processing unit 150 is used for receiving a two-channel input audio S _si , and processing the two-channel input audio S _si with spatial sound effects, that is, using reverb and equalizer to enhance the spatial sense and distance of the sound source Sense, and output the corresponding two-channel adjustment audio S _sa . The up-mixing unit 170 is electrically connected to the spatial processing unit 150 to receive the two-channel adjustment audio S _sa , and generate a virtual multi-channel output according to the two-channel adjustment audio S _{sa, and separate the corresponding} Multi-channel multi-channel input audio S _mi . The inertial correction unit 190 is used to receive the inertial measurement signal S _axis from the multi-axis sensor of the head-mounted device, and use Kalman Filter or an attitude analysis algorithm (MahonyAHRS) to measure the inertial measurement. S _axis correction signal, and generates the corresponding Euler coordinate (Eulerian coordinates) inertia correction signal S _c.

Further, the position of the head related impulse response function unit 110 for receiving the inertia correcting signal S _c, and calculates the three-dimensional positioning or to obtain the desired audio head related impulse function based on the inertia correction signal S _c, and generates the corresponding The head-related pulse function signal S _HRIR .

Furthermore, the positioning sound mixing unit 130 further includes a three-dimensional positioning unit 131 and a down mixing unit 133. The three-dimensional positioning unit 131 is electrically connected to the upmix unit 170 and the head related position impulse response function unit 110, and is used for receiving the multi-channel input audio S _mi and according to the head related impulse function signal S _{The HRIR} and the corresponding spatial position (channel) configure the audio, and generate the corresponding multi-channel output audio S _mo . The downmix unit 133 is electrically connected to the three-dimensional positioning unit 131 to receive the multi-channel output audio S _{mo , and generate a two-channel output audio S so} including sound field positioning through the mixing gain operation of each channel .

The multi-channel referred to in this embodiment is 5.1 channels, and the present application is not limited by this, and a channel system with more than the number of two-channel channels can be the multi-channel referred to in this application.

In one embodiment, the head related position impulse response function unit 110, the positioning mixing unit 130, the spatial processing unit 150, the upmixing unit 170, and the inertia correction unit 190 may be one or more microprocessors The circuit unit is implemented, and this application is not limited thereto.

In one embodiment, the two-channel input audio S _si comes from an electronic device that is communicatively connected with the headset, such as a smart phone, a tablet computer, or a notebook computer, and this application is not limited thereto.

In one embodiment, the inertial measurement signal S _axis includes the sensing results of a multi-axis gyroscope, a multi-axis accelerometer, and a multi-axis magnetometer, and the application is not limited thereto.

To further illustrate the spatial processing unit 150, please refer to FIG. 3. The spatial processing unit 150 includes a reverberator unit 151, a distance adjuster unit 153, an echo control unit 155, an equalizer unit 157, and a volume gain. Unit 159. The reverberator unit 151 is used to receive the two-channel input audio S _si , and edit and adjust the two-channel input audio Ssi to have an echo effect, so as to create a sense of spatial sound of the multi-channel audio. The distance adjuster unit 153 is used to receive the two-channel input audio S _si edited and output by the reverberator unit 151, and stretch the direct sound in the two-channel input audio S _si to achieve a sense of distance. The echo control unit 155 is used to receive the two-channel input audio S _si edited and output by the distance adjuster unit 153, and adjust the echo to improve sound solidity and sound effect. The equalizer unit 157 is used to receive the two-channel input audio S _si edited and output by the echo control unit 155 and used to enhance the low-frequency effect of the two-channel input audio S _si. The volume gain unit 159 is used for receiving the two-channel input audio S _si edited and output by the equalizer unit 157, and used for adjusting the gain of the received audio, and outputting the two-channel adjustment audio S _sa .

In an embodiment, the equalizer unit 157 is, for example, a shelf filter, and the application is not limited thereto.

In this way, the spatial processing unit 150 can perform pre-processing such as sound effect adjustment and editing _{on the received two-channel input audio S si.}

Therefore, when the user wears the headset, the headset can instantly change the sound field of the two-channel input audio according to the displacement state of the user, and realize the multi-channel audio with two-channel audio. Sound effects, allowing users to experience stereo sound field effects with different two-channel audio at any time.

Thereby, the audio processing system 100 of the present application can instantly reflect the displacement state of the user's head according to the inertial measurement signal, and the head-related pulse function signal defines the real-time multi-channel sound corresponding to the user Therefore, the present application can instantly generate corresponding sound field changes according to the displacement state of the user’s head, and output two-channel output audio suitable for existing headsets, which not only allows users to have a better sound experience, It also enhances the convenience for users to realize multi-channel audio data with a dual-channel audio processing system.

The operation method of a dual-channel audio processing system can be summarized from the above-mentioned embodiments and application methods of this application, and the audio processing system (as shown in FIG. 1 or FIG. 2) is configured in a head-mounted device, as shown in FIG. 4 As shown, the method includes the following steps: The audio processing system 100 obtains a multi-channel input audio and a head related pulse function signal (S107); The audio processing system 100 uses the head-related impulse function signal to perform audio localization on the multi-channel input audio and generate a multi-channel output audio (S109); and The audio processing system 100 performs downmixing on the multi-channel output audio and obtains a two-channel output audio (S111).

Further, please refer to FIG. 2 and FIG. 5 at the same time. The method further includes the following steps: Obtain two-channel input audio S _si (S101); Perform sound effect processing to generate a two-channel adjustment audio S _sa (S103); The audio processing The spatial processing unit 150 of the device system 1 is used to receive the two-channel input audio S _si , perform spatial sound processing on the two-channel input audio S _si , and output the corresponding two-channel adjustment audio S _sa ; Mixing to obtain a multi-channel input audio (S105); the up-mixing unit 170 of the audio processing system 100 is used to receive the two-channel adjustment audio S _sa and separate the two-channel adjustment audio S _sa into the corresponding multi-channel Channel multi-channel input audio S _mi ; obtain the multi-channel input audio S _mi and a head-related impulse function signal S _HRIR (S107); perform audio localization and generate a multi-channel output audio (S109); the The three-dimensional positioning unit 131 of the audio processing system 100 receives the multi-channel input audio S _mi , and adjusts and configures the audio according to the head-related impulse function signal S _HRIR and the corresponding spatial position, and generates a corresponding multi-channel output Audio S _mo ; and perform downmixing and obtain a two-channel output audio (S111); the downmix unit 133 of the audio processing system 100 receives the multi-channel output audio S _mo and generates the two-channel output audio S _so .

In the preferred embodiment, when the above steps are performed to the step of "the audio processing system 100 obtains the multi-channel input audio and a head-related impulse function signal (S107)", as shown in FIG. 6, the method further It includes the following sub-steps: Obtain an inertia measurement signal S _axis (S1071); The audio processing system 100 receives the inertia measurement signal S _axis from the multi-axis sensor of the head-mounted device; Generates an inertia correction signal S _c ( S1073); the inertia correction unit 190 of the audio processing system 100 receives the inertia measurement signal S _axis and performs corresponding adjustment and correction to generate the inertia correction signal S _c ; generates the head related pulse function signal S _HRIR (S1075 ); position of head related audio processing system 100 of the pulse response function of unit 110 for receiving the inertia correcting signal S _c, and generates the corresponding head related impulse function signal based on the S _HRIR inertia correction signal S _c; and the resulting Multi-channel input audio S _mi and the head-related impulse function signal S _HRIR (S1077), the positioning mixing unit 130 of the audio processing system 100 obtains the multi-channel input audio S _mi from an up-mixing unit 170 and the Head related pulse function signal S _HRIR .

Therefore, the dual-channel audio processing system of the present application can instantly reflect the displacement state of the user's head according to the inertial measurement signal, and the head-related pulse function signal defines the real-time multi-channel sound corresponding to the user Therefore, the present application can instantly generate corresponding sound field changes according to the displacement state of the user’s head, and output two-channel output audio suitable for existing headsets, which not only allows users to have a better sound experience, It also enhances the convenience for users to realize multi-channel audio data with a dual-channel audio processing system.

100: Audio processing system 110: Head related position impulse response function unit 130: Positioning mixing unit 131: Three-dimensional positioning unit 133: Downmixing unit 150: Spatial processing unit 151: Reverberator unit 153: Distance adjuster unit 155 : Echo control unit 157: Equalizer unit 159: Volume gain unit 170: Upmix unit 190: Inertia correction unit S _axis : Inertia measurement signal S _c : Inertia correction signal S _HRIR : Head-related impulse function signal S _mi : Multi-channel input audio S _mo : Multi-channel output audio S _sa : Two-channel adjustment audio S _si : Two-channel input audio S _so : Two-channel output audio S101, S103, S105, S107, S109, S111, S1071, S1073, S1075, S1077: steps

Fig. 1 is a schematic diagram of a system architecture according to an embodiment of the present application; Figure 2 is a schematic diagram of another system architecture according to an embodiment of the present application; FIG. 3 is a schematic diagram of another system architecture according to an embodiment of the present application; Fig. 4 is a schematic diagram of a step flow according to an embodiment of the present application; Fig. 5 is a schematic diagram of another step flow according to an embodiment of the present application; and Fig. 6 is a schematic flowchart of another step according to an embodiment of the present application.

100: Audio processing system

110: head related position impulse response function unit

130: Positioning mixing unit

S _mi : Multi-channel input audio

S _so : Two-channel output audio

Claims (6)

A dual-channel audio processing system, the audio processing system is configured in a head-mounted device, and includes: A head-related position impulse response function unit for generating a head-related impulse function signal according to the inertial measurement signal of the head-mounted device; and A positioning mixing unit is electrically connected to the impulse response function unit at the relative position of the head, Wherein, the positioning mixing unit is used to obtain a multi-channel input audio and the head-related pulse function signal, and perform audio positioning accordingly to generate a multi-channel output audio, and perform a reduction on the multi-channel output audio. Mix to get a two-channel output audio. The dual-channel audio processing system according to claim 1, wherein the positioning audio mixing unit further includes: A three-dimensional positioning unit for generating the multi-channel output audio signal according to the multi-channel input audio signal and the head related pulse function signal; and A down-mixing unit is electrically connected to the three-dimensional positioning unit for performing down-mixing of the multi-channel output audio to obtain the two-channel output audio. The dual-channel audio processing system according to claim 2, wherein the audio processor system further includes: A spatial processing unit for receiving a two-channel input audio, and performing spatial audio processing on the two-channel input audio to output corresponding two-channel adjustment audio; An up-mixing unit, electrically connected to the spatial processing unit, for receiving the two-channel adjustment audio, and generating the multi-channel input audio corresponding to the multi-channel according to the two-channel adjustment audio; and An inertia correction unit is electrically connected to the impulse response function unit of the related position of the head to receive the inertia measurement signal, correct the inertia measurement signal, and generate a corresponding inertia correction signal. The dual-channel audio processing system according to claim 3, wherein the head-related position impulse response function unit is used to receive the inertial correction signal and generate the corresponding head-related impulse function signal. The dual-channel audio processing system according to claim 3, wherein the spatial processing unit includes: A reverberator unit for receiving the two-channel input audio; A distance adjuster unit, electrically connected to the reverberator unit, for receiving the two-channel input audio output from the reverberator unit; An echo control unit, electrically connected to the distance adjuster unit, for receiving two-channel input audio output from the distance adjuster unit; The first equalizer unit is electrically connected to the echo control unit for receiving the two-channel input audio output from the echo control unit; and A volume gain unit is electrically connected with the equalizer unit to receive the two-channel input audio output from the equalizer unit, and output the two-channel adjustment audio accordingly. The dual-channel audio processing system according to claim 5, wherein the equalizer unit is a shelving filter.

Images