CN117476014A - Audio processing methods, devices, storage media and equipment - Google Patents

Abstract

This application discloses an audio processing method, device, storage medium and equipment. The method includes: obtaining the near-field audio of the speaker; obtaining the audio configuration parameters of the target virtual space, and the audio configuration parameters are used to simulate the spatial sound effects of the target virtual space; According to the audio configuration parameters of the target virtual space, the near-field audio is mixed to obtain the first target audio, and the first target audio has the spatial sound effect of the target virtual space. The embodiment of the present application mixes the near-field audio through the pre-constructed audio configuration parameters of the target virtual space to obtain audio with spatial sound effects of the target virtual space, thereby improving the audio effect and user experience.

Description

Audio processing methods, devices, storage media and equipment

Technical field

This application relates to the field of virtual reality technology, and specifically to an audio processing method, device, storage medium and equipment.

Background technique

The audio collection location for motion capture audio is the motion capture studio. However, the environment of the motion capture studio is relatively simple. It is impossible to record a concert this time, so you need to specifically look for a motion capture studio set up in a concert. The motion capture studio is generally set up in a fixed place. The audio collection method in the motion capture studio generally uses a near-field microphone close to the speaker's mouth. The audio collected by the near-field microphone can also be called near-field audio. . Near-field audio is relatively monotonous, has no echo, and the audio effect is not ideal.

Contents of the invention

Embodiments of the present application provide an audio processing method, device, storage medium, equipment and program product, which can perform mixing processing on near-field audio based on the pre-constructed audio configuration parameters of the target virtual space to obtain a space with the target virtual space. The audio of the sound effects improves the audio effect and enhances the user experience.

On the one hand, embodiments of the present application provide an audio processing method, which includes:

Get the near-field audio of the speaker;

Obtain the audio configuration parameters of the target virtual space, the audio configuration parameters being used to simulate the spatial sound effects of the target virtual space;

According to the audio configuration parameters of the target virtual space, the near-field audio is mixed to obtain the first target audio, and the first target audio has the spatial sound of the target virtual space.

In some embodiments, the audio configuration parameters of the target virtual space include audio reflection parameters of the target virtual space, attenuation parameters of audio propagation, and background audio of the target virtual space.

In some embodiments, mixing the near-field audio according to the audio configuration parameters of the target virtual space to obtain the first target audio includes:

Perform a first audio adjustment process on the near-field audio and the background audio according to the audio reflection parameter and the attenuation parameter;

The near-field audio and the background audio that have been subjected to the first audio adjustment processing are mixed to obtain the first target audio.

In some embodiments, the method further includes:

Obtain the first position of the virtual speaking object corresponding to the speaker in the target virtual space, and the second position of the virtual listening object corresponding to the listener in the target virtual space;

Performing a first audio adjustment process on the near-field audio and the background audio according to the audio reflection parameter and the attenuation parameter includes:

According to the audio reflection parameter, the attenuation parameter, the first position and the second position, a first audio adjustment process is performed on the near-field audio and the background audio.

In some embodiments, the method further includes:

When it is detected that the relative positional relationship between the first position and the second position changes, the near-field audio and the relative positional relationship between the first position and the second position are compared. The background audio is subjected to a second audio adjustment process;

The near-field audio and the background audio after the second audio adjustment processing are mixed to obtain a second target audio. The second target audio has the spatial sound effect of the target virtual space and represents the target virtual space. The sound effect changes when the relative positional relationship between the first position and the second position changes.

In some embodiments, the relative position relationship includes a distance relationship, and when a change in the relative position relationship between the first position and the second position is detected, based on the first position and the The relative positional relationship between the second positions is used to perform a second audio adjustment process on the near-field audio and the background audio, including:

When it is detected that the distance relationship between the first position and the second position changes, the near-field audio and the background audio are compared according to the distance between the first position and the second position. Perform second audio adjustment processing.

In some embodiments, the relative position relationship includes an orientation relationship, and when a change in the relative position relationship between the first position and the second position is detected, the relative position relationship between the first position and the second position is determined based on the first position and the second position. The relative positional relationship between the second positions is used to perform a second audio adjustment process on the near-field audio and the background audio, including:

When it is detected that the orientation relationship between the first position and the second position changes, the near-field audio and the background are compared according to the relative orientation between the first position and the second position. The audio undergoes a second audio adjustment process.

In some embodiments, the relative position relationship includes a distance relationship and an orientation relationship, and when a change in the relative position relationship between the first position and the second position is detected, based on the first position Performing a second audio adjustment process on the near-field audio and the background audio based on the relative positional relationship with the second position, including:

When it is detected that the distance relationship and the azimuth relationship between the first position and the second position change, based on the distance and relative azimuth between the first position and the second position, the near The field audio and the background audio undergo a second audio adjustment process.

In some embodiments, the method further includes:

When the head swing of the listener is detected, the left ear orientation and the right ear orientation of the listener during the head swing are obtained;

Perform a third audio adjustment process on the near-field audio and the background audio according to the listener's left ear orientation and right ear orientation;

The near-field audio and the background audio after the third audio adjustment processing are mixed to obtain a third target audio. The third target audio has the spatial sound effect of the target virtual space and represents the target virtual space. Describes the sound effect changes produced when the listener's head moves.

In some embodiments, the method further includes:

Different types of virtual spaces are preset according to different virtual scenes, where each type of virtual space has corresponding audio configuration parameters;

The obtaining the audio configuration parameters of the target virtual space includes:

In response to a selection instruction for a virtual space, the target virtual space is determined from the different types of virtual spaces, and audio configuration parameters of the target virtual space are obtained.

On the other hand, embodiments of the present application provide an audio processing device, which includes:

The first acquisition unit is used to acquire the near-field audio of the speaker;

The second acquisition unit is used to acquire the audio configuration parameters of the target virtual space, where the audio configuration parameters are used to simulate the spatial sound effects of the target virtual space;

A processing unit configured to perform mixing processing on the near-field audio according to the audio configuration parameters of the target virtual space to obtain a first target audio, where the first target audio has a spatial sound effect of the target virtual space.

On the other hand, embodiments of the present application provide a computer-readable storage medium that stores a computer program, and the computer program is suitable for loading by a processor to execute the steps described in any of the above embodiments. Audio processing methods.

On the other hand, embodiments of the present application provide a virtual reality device. The virtual reality device includes a processor and a memory. A computer program is stored in the memory. The processor invokes the computer program stored in the memory. Program, used to execute the audio processing method described in any of the above embodiments.

On the other hand, embodiments of the present application provide a server. The server includes a processor and a memory. A computer program is stored in the memory. The processor calls the computer program stored in the memory. Execute the audio processing method as described in any of the above embodiments.

On the other hand, embodiments of the present application provide a computer program product, which includes a computer program. When the computer program is executed by a processor, the audio processing method as described in any of the above embodiments is implemented.

The embodiment of the present application obtains the near-field audio of the speaker; obtains the audio configuration parameters of the target virtual space, and the audio configuration parameters are used to simulate the spatial sound effects of the target virtual space; and mixes the near-field audio according to the audio configuration parameters of the target virtual space. Sound processing is performed to obtain the first target audio, which has the spatial sound effect of the target virtual space. The embodiment of the present application mixes the near-field audio through the pre-constructed audio configuration parameters of the target virtual space to obtain audio with spatial sound effects of the target virtual space, thereby improving the audio effect and user experience.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

Figure 1 is a schematic flowchart of an audio processing method provided by an embodiment of the present application.

Figure 2 is a schematic diagram of an application scenario of the audio processing method provided by the embodiment of the present application.

Figure 3 is a schematic structural diagram of an audio processing device provided by an embodiment of the present application.

Figure 4 is a first structural schematic diagram of a virtual reality device provided by an embodiment of the present application.

Figure 5 is a second structural schematic diagram of a virtual reality device provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts fall within the scope of protection of this application.

Embodiments of the present application provide an audio processing method, device, computer-readable storage medium, virtual reality device, server and computer program product. Specifically, the audio processing method in the embodiment of the present application can be executed by a virtual reality device or a server.

The embodiments of the present application can be applied to various application scenarios such as extended reality (eXtended Reality, XR), virtual reality (Virtual Reality, VR), augmented reality (Augmented Reality, AR), and mixed reality (Mixed Reality, MR).

First, some nouns or terms that appear in the description of the embodiments of this application are explained as follows:

Extended reality (eXtend ed Reality, Connected environments, technologies that enable users to interact with that environment in real time.

Virtual Reality (VR), a technology for creating and experiencing virtual worlds, calculates and generates a virtual environment, which is a kind of multi-source information (the virtual reality mentioned in this article at least includes visual perception, and can also include auditory perception, Tactile perception, motion perception, and even taste perception, smell perception, etc.), realizing the integration of virtual environment, interactive three-dimensional dynamic vision and simulation of entity behavior, allowing users to immerse themselves in the simulated virtual reality environment and realize Applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair, etc.

Augmented Reality (AR) is a method that calculates the camera's posture parameters in the real world (or three-dimensional world, real world) in real time during the process of camera collecting images. A technique for adding virtual elements to images. Virtual elements include, but are not limited to: images, videos, and three-dimensional models. The goal of AR technology is to connect the virtual world to the real world on the screen for interaction.

Mixed Reality (MR), a simulated set that integrates computer-created sensory input (e.g., virtual objects) with sensory input from the physical set or its representation. In some MR sets, the computer-created sensory input can be adapted to the sensory input from the physical set. Changes in sensory input to the physical set. Additionally, some electronic systems used to render the MR scenery may monitor orientation and/or position relative to the physical scenery to enable virtual objects to interact with real objects (i.e., physical elements from the physical scenery or representations thereof). For example, the system can monitor motion so that virtual plants appear stationary relative to physical buildings.

Augmented Virtuality (AV): AV scenery refers to a computer-created scenery or a simulated scenery that incorporates at least one sensory input from a physical scenery. The one or more sensory inputs from the physical setting may be a representation of at least one feature of the physical setting. For example, a virtual object may take on the color of a physical element captured by one or more imaging sensors. As another example, virtual objects may exhibit characteristics consistent with actual weather conditions in the physical scene, as identified via weather-related imaging sensors and/or online weather data. In another example, an augmented reality forest can have virtual trees and structures, but the animals can have features accurately recreated from images taken of physical animals.

Virtual field of view refers to the area in the virtual environment that the user can perceive through the lens in the virtual reality device. The field of view (Field Of View, FOV) of the virtual field of view is used to represent the perceived area.

Virtual reality equipment, a terminal that realizes virtual reality effects, can usually be provided in the form of glasses, helmet-mounted displays (HMD), and contact lenses to achieve visual perception and other forms of perception. Of course, virtual reality equipment realizes The form is not limited to this, and can be further miniaturized or enlarged as needed.

The virtual reality devices described in the embodiments of this application may include but are not limited to the following types:

Computer-side virtual reality (PCVR) equipment uses the PC side to perform calculations and data output related to virtual reality functions. The external computer-side virtual reality equipment uses the data output from the PC side to achieve virtual reality effects.

Mobile virtual reality equipment supports setting up a mobile terminal (such as a smartphone) in various ways (such as a head-mounted display with a special card slot), and through a wired or wireless connection with the mobile terminal, the mobile terminal performs virtual reality Function-related calculations and output data to mobile virtual reality devices, such as viewing virtual reality videos through mobile terminal APPs.

The all-in-one virtual reality device has a processor for performing calculations related to virtual functions, so it has independent virtual reality input and output functions. It does not need to be connected to a PC or mobile terminal, and has a high degree of freedom in use.

Each is explained in detail below. It should be noted that the description order of the following embodiments is not used to limit the priority order of the embodiments.

Each embodiment of the present application provides an audio processing method, which can be executed by a terminal or a server, or jointly by a terminal and a server; the embodiments of this application take the audio processing method being executed by a terminal (virtual reality device) as an example. Be explained.

Please refer to Figures 1 to 2. Figure 1 is a schematic flow chart of an audio processing method provided by an embodiment of the present application. Figure 2 is a schematic diagram of a related application scenario provided by an embodiment of the present application. The blank background in Figure 2 can be a virtual reality space layer. The method includes:

Step 110: Obtain the near-field audio of the speaker.

For example, the near-field audio of the speaker can be collected in advance through a near-field microphone in the motion capture studio. The speaker can be a celebrity idol, performer, speaker, host, teacher, etc. After collecting the near-field audio of the speaker, the near-field audio can be uploaded to a computer device, which can be a virtual reality device or a server.

Step 120: Obtain the audio configuration parameters of the target virtual space. The audio configuration parameters are used to simulate the spatial sound effects of the target virtual space.

In some embodiments, the method further includes:

Different types of virtual spaces are preset according to different virtual scenes, where each type of virtual space has corresponding audio configuration parameters;

The obtaining the audio configuration parameters of the target virtual space includes:

In response to a selection instruction for a virtual space, the target virtual space is determined from the different types of virtual spaces, and audio configuration parameters of the target virtual space are obtained.

The virtual environment may include a virtual scene and at least one virtual object active in the virtual scene. The virtual object may include a player character controlled by the user (or player) or a non-player character (NPC) controlled by the system. Non-Player Character). For example, the virtual object may also include one or more character attributes, such as skill attributes, character status attributes, etc., to provide help to the player, provide virtual services, increase points related to the player's performance, etc. For example, the virtual environment takes a game as an example. The virtual scene of the game may also include one or more virtual obstacles, such as railings, ravines, walls, etc., to limit the movement of virtual objects. Restricted to specific areas within the VR scene. In addition, one or more indicators may be presented in the virtual scene to provide instructions to the player. For example, the virtual environment is an audio-visual experience game. The virtual scene of the audio-visual experience game may be a virtual concert hall, or the virtual scene may be a virtual studio, and the virtual scene may be a virtual beach concert. Or the virtual scene may be a virtual sports field, etc. The virtual space corresponding to the virtual scene may also include one or more virtual items, such as a stage, performance props, auditoriums, tables and chairs, etc.

For example, an object (such as a user or a real player) can log in and access the virtual scene in the virtual environment by using the current account in the virtual reality device. The virtual object corresponding to the current account is the player character controlled by the user through the virtual reality device.

For example, a virtual scene may be created in the computer device in advance, the virtual scene may be a virtual concert hall, or the virtual scene may be a virtual studio, the virtual scene may be a virtual beach concert, or the virtual scene may be a virtual sports field and more. Different types of virtual spaces can be preset according to different virtual scenes, and the audio configuration parameters corresponding to each type of virtual space can be set.

In some embodiments, the audio configuration parameters of the target virtual space include audio reflection parameters of the target virtual space, attenuation parameters of audio propagation, and background audio of the target virtual space.

For example, taking the virtual space corresponding to the virtual concert hall as an example, when constructing the virtual space, the angles of the surrounding walls of the virtual concert hall are set at fixed angles. Then, set the audio configuration parameters of the virtual space. For example, set the audio reflection parameters of the virtual space. The audio reflection parameters may include the reflection amount of the virtual space and the audio frequency band that the virtual space can reflect. For example, set the audio reflection parameters of the walls of the virtual concert hall, such as: What is the reflection amount of the walls of the virtual concert hall? Set which frequency bands of this audio can be reflected by the walls of the virtual concert hall. For example, the attenuation parameters of audio propagation are also set; for example, when building a virtual space, the current air density of the walls of the virtual concert hall is set, and the attenuation parameters of audio propagation are set according to the set air density. For example, the currently set air density corresponds to What is the attenuation parameter of audio propagation. For example, you also need to set the background audio of the virtual space. The virtual spaces corresponding to different virtual scenes have different background audio.

Step 130: Mix the near-field audio according to the audio configuration parameters of the target virtual space to obtain a first target audio, where the first target audio has a spatial sound effect of the target virtual space.

In the embodiment of the present application, the spatial sound effect of the target virtual space can be simulated in the computer device.

For example, the speaker is a celebrity idol, and the virtual vocal object corresponding to the speaker can also be called a virtual idol. The virtual idol performs in a virtual scene during the performance. For example, if the virtual scene is a beach and is an open virtual scene, the target virtual space corresponding to the open virtual scene may not involve audio reflection parameters, and the audio reflection parameters may be set to empty. When the listener has an audio-visual experience, they need to feel that this virtual idol is really singing in a beach music scene, and they need to simulate the performance audio of the beach music scene. Specifically, a three-dimensional virtual space corresponding to the beach music scene will be created in the computer device, and then the collected near-field audio will be placed in the target virtual space corresponding to the beach music scene for mixing processing. During the mixing process , make corresponding audio adjustments based on the audio configuration parameters of the target virtual space, and finally obtain the first target audio with spatial sound effects of the target virtual space.

For example, if a virtual idol performs in a virtual concert or virtual concert hall, the target virtual space corresponding to the virtual scene can involve audio reflection parameters, and the audio that can produce a reverberation effect for different locations can be set according to the constructed target virtual space. Configuration parameters. When the listener has an audio-visual experience, they need to feel that the virtual idol is really singing in a concert hall scene, and they need to simulate the performance audio of the concert hall scene. Specifically, a three-dimensional virtual space corresponding to the concert hall scene will be created in the computer device, and then the collected near-field audio will be placed in the target virtual space corresponding to the concert hall scene for mixing processing. During the mixing process , make corresponding audio adjustments based on the audio configuration parameters of the target virtual space, and finally obtain the first target audio with spatial sound effects of the target virtual space.

In some embodiments, mixing the near-field audio according to the audio configuration parameters of the target virtual space to obtain the first target audio includes:

Perform a first audio adjustment process on the near-field audio and the background audio according to the audio reflection parameter and the attenuation parameter;

The near-field audio and the background audio that have been subjected to the first audio adjustment processing are mixed to obtain the first target audio.

For example, first, perform a first audio adjustment process on the near-field audio and background audio according to the audio reflection parameter and attenuation parameter. For example, the first audio adjustment process may be: adjusting the volume of the near-field audio and the background audio, and adjusting the volume of the near-field audio and the background audio according to the determined near-field audio and background audio. The audio frequency band that can be reflected in the field audio (filter out the audio frequency band that cannot be reflected in the near-field audio) adjusts the near-field audio, adjusts the near-field audio according to the determined attenuation of the near-field audio, etc.; then, perform the first audio The adjusted near-field audio and background audio are mixed to obtain the first target audio.

In some embodiments, the method further includes:

Obtain the first position of the virtual speaking object corresponding to the speaker in the target virtual space, and the second position of the virtual listening object corresponding to the listener in the target virtual space;

Performing a first audio adjustment process on the near-field audio and the background audio according to the audio reflection parameter and the attenuation parameter includes:

According to the audio reflection parameter, the attenuation parameter, the first position and the second position, a first audio adjustment process is performed on the near-field audio and the background audio.

For example, in order to further improve the sound effects of spatial sound effects, during the audio adjustment process, in addition to the audio configuration parameters of the target virtual space, it is also necessary to combine the first position of the virtual vocal object corresponding to the speaker in the target virtual space. and perform the second audio adjustment process at the second position of the virtual listening object corresponding to the listener in the target virtual space.

For example, calculate the distance between the first position and the second position, determine the volume of the near-field audio and background audio based on the distance, and determine the audio that can be reflected in the near-field audio based on the correspondence between the distance and the audio reflection parameter. frequency band, and determine the attenuation amount of near-field audio in the air based on the correspondence between distance and attenuation parameters. When performing the first audio adjustment process, adjust the volume of the near-field audio and background audio, and filter out the near-field audio. The audio frequency band that cannot be reflected in the audio frequency band, and adjust the near-field audio according to the attenuation of the near-field audio in the air. Then, the near-field audio and the background audio that have been subjected to the first audio adjustment processing are mixed to obtain the first target audio.

For example, in the target virtual space, when the distance between the first position of the virtual speaking object and the second position of the virtual listening object is 1 meter, the listener can clearly hear all sounds in all frequency bands emitted by the speaker. . In the target virtual space, when the distance between the first position of the virtual speaking object and the second position of the virtual listening object is 100 meters, the high-frequency sound and low-frequency sound of the speaker will be virtualized by the current target. If the air in the space is filtered out, the listener can only hear the mid-frequency sound of the speaker. In this application, such an ambient and spatial reverberation audio can be simulated in a computer.

In some embodiments, the method further includes:

When it is detected that the relative positional relationship between the first position and the second position changes, the near-field audio and the relative positional relationship between the first position and the second position are compared. The background audio is subjected to a second audio adjustment process;

The near-field audio and the background audio after the second audio adjustment processing are mixed to obtain a second target audio. The second target audio has the spatial sound effect of the target virtual space and represents the target virtual space. The sound effect changes when the relative positional relationship between the first position and the second position changes.

For example, the speaker is a celebrity idol, and the virtual vocal object corresponding to the speaker can also be called a virtual idol. As shown in Figure 2, the target virtual space 10 in the concert hall scene has four interactive fields, specifically one on-stage interactive field 101 and three off-stage interactive fields 102 (including the first off-stage interactive field 102A , the second off-stage interactive field 102B, the second off-stage interactive field 102C). For example, the on-stage interactive field 101 can be a stage, and the off-stage interactive field 102 can be an audience area. The first position of the virtual speaking object 11 corresponding to the speaker is located in the on-stage interactive field 101, and the virtual listening object 12 corresponding to the listener is located in the on-stage interactive field 101. The second location is located in the first off-stage interactive field 102A.

For example, if the virtual vocal object 11 (virtual idol) walks from the position A on the left side of the interactive field 101 to the position B on the right side of the interactive field 101 during the performance, at this time, actually from the perspective of the listener's sense of hearing, it is expected that The point of articulation of this sung music moves from left to right. Therefore, when it is detected that the relative positional relationship between the first position where the virtual sound-emitting object is located and the second position where the virtual listening object is located changes, the near-field audio is processed according to the relative positional relationship between the first position and the second position. Perform a second audio adjustment process with the background audio, for example, adjust the volume of the near-field audio and the background audio, adjust the near-field audio according to the determined audio frequency band that can be reflected in the near-field audio and the determined attenuation of the near-field audio, etc. ; Then, mix the near-field audio and background audio after the second audio adjustment processing to obtain the second target audio. The second target audio has the spatial sound effect of the target virtual space and represents the first position and the second The sound effect changes when the relative positional relationship between positions changes. The audio adjustment processing and mixing processing can be performed in real time, so the second target audio is obtained, which has the spatial sound effect of the target virtual space, and can represent the sound effect produced when the relative positional relationship between the first position and the second position changes. Change effect.

In some embodiments, the relative position relationship includes a distance relationship, and when a change in the relative position relationship between the first position and the second position is detected, based on the first position and the The relative positional relationship between the second positions is used to perform a second audio adjustment process on the near-field audio and the background audio, including:

When it is detected that the distance relationship between the first position and the second position changes, the near-field audio and the background audio are compared according to the distance between the first position and the second position. Perform second audio adjustment processing.

For example, when the relative position relationship is mainly a distance relationship, when a change in the distance relationship between the first position and the second position is detected, the near-field audio and the background audio are compared according to the distance between the first position and the second position. Perform a second audio adjustment process. For example, before the distance relationship changes, the first audio adjustment process has been performed on the near-field audio and background audio according to the audio configuration parameters of the target virtual space; based on the first audio adjustment process, perform a second audio adjustment process. During the second audio adjustment process, the volume of the near-field audio and background audio is mainly adjusted; for example, the volume of the background audio can remain unchanged. If the distance between the first position and the second position becomes smaller, the volume of the near-field audio is adjusted. Large; if the distance between the first position and the second position becomes larger, reduce the volume of the near-field audio. If the distance between the first position and the second position changes greatly, the audio frequency band that can be reflected in the near-field audio can also be determined based on the correspondence between the distance and the audio reflection parameters, and based on the distance and attenuation parameters. The corresponding relationship determines the attenuation of near-field audio in the air. When performing the second audio adjustment process, adjust the volume of the near-field audio and background audio, and filter out the audio frequency bands in the near-field audio that cannot be reflected. And adjust the near-field audio according to the attenuation of the near-field audio in the air.

In some embodiments, the relative position relationship includes an orientation relationship, and when a change in the relative position relationship between the first position and the second position is detected, the relative position relationship between the first position and the second position is determined based on the first position and the second position. The relative positional relationship between the second positions is used to perform a second audio adjustment process on the near-field audio and the background audio, including:

When it is detected that the orientation relationship between the first position and the second position changes, the near-field audio and the background are compared according to the relative orientation between the first position and the second position. The audio undergoes a second audio adjustment process.

For example, when the relative position relationship is mainly an orientation relationship, when a change in the orientation relationship between the first position and the second position is detected, the near-field audio and background are compared based on the relative orientation between the first position and the second position. The audio undergoes a second audio adjustment process. For example, before the orientation relationship changes, the first audio adjustment process is performed on the near-field audio and background audio according to the audio configuration parameters of the target virtual space; on the basis of the first audio adjustment process, During the second audio adjustment process, the channel volume of the near-field audio and background audio is mainly adjusted; for example, the channel volume of the background audio can remain unchanged, if the relative orientation is that the virtual speaking object 11 is located on the left side of the virtual listening object 12 When , the volume of the left channel of the near-field audio is turned up, and the volume of the right channel of the near-field audio is turned down; if the relative orientation is that the virtual speaking object 11 is in front of the virtual listening object 12, the volume of the left channel of the near-field audio is equal to the volume of the left channel of the near-field audio. The volume of the audio channels can be adjusted to the same volume; if the relative orientation is that the virtual speaking object 11 is located on the right side of the virtual listening object 12, the volume of the left channel of the near-field audio is turned down, and the volume of the right channel of the near-field audio is turned up.

In some embodiments, the relative position relationship includes a distance relationship and an orientation relationship, and when a change in the relative position relationship between the first position and the second position is detected, based on the first position Performing a second audio adjustment process on the near-field audio and the background audio based on the relative positional relationship with the second position, including:

When it is detected that the distance relationship and the azimuth relationship between the first position and the second position change, based on the distance and relative azimuth between the first position and the second position, the near The field audio and the background audio undergo a second audio adjustment process.

For example, when the relative position relationship includes a distance relationship and an orientation relationship, and when it is detected that the distance relationship and the orientation relationship between the first position and the second position change, based on the distance and relative orientation between the first position and the second position, , perform second audio adjustment processing on near-field audio and background audio.

For example, before the distance relationship and the orientation relationship change, a first audio adjustment process has been performed on the near-field audio and background audio according to the audio configuration parameters of the target virtual space; on the basis of the first audio adjustment process, a second audio adjustment process is performed During processing, first adjust the volume of the near-field audio and background audio according to the distance; for example, the volume of the background audio can remain unchanged. If the distance between the first position and the second position becomes smaller, the volume of the near-field audio can be increased. ; If the distance between the first position and the second position becomes larger, reduce the volume of the near-field audio. If the distance between the first position and the second position changes greatly, the audio frequency band that can be reflected in the near-field audio can also be determined based on the correspondence between the distance and the audio reflection parameters, and based on the distance and attenuation parameters. The corresponding relationship determines the attenuation of near-field audio in the air. When performing the second audio adjustment process, adjust the volume of the near-field audio and background audio, and filter out the audio frequency bands in the near-field audio that cannot be reflected. And adjust the near-field audio according to the attenuation of the near-field audio in the air. Then, after the adjustment according to the distance is completed, the channel volume of the near-field audio and the background audio is adjusted according to the relative orientation; for example, the channel volume of the background audio can remain unchanged, if the relative orientation is that the virtual sounding object 11 is located in the virtual listening position When the object 12 is on the left side, the volume of the left channel of the near-field audio is turned up, and the volume of the right channel of the near-field audio is turned down; if the relative orientation is that the virtual speaking object 11 is in front of the virtual listening object 12, the volume of the near-field audio is turned down. The volume of the left channel and the volume of the sound channel can be adjusted to be the same; if the relative orientation is that the virtual sounding object 11 is located on the right side of the virtual listening object 12, the volume of the left channel of the near-field audio is reduced, and the volume of the right channel of the near-field audio is reduced. Turn up the channel volume.

In some embodiments, the method further includes:

When the head swing of the listener is detected, the left ear orientation and the right ear orientation of the listener during the head swing are obtained;

Perform a third audio adjustment process on the near-field audio and the background audio according to the listener's left ear orientation and right ear orientation;

The near-field audio and the background audio after the third audio adjustment processing are mixed to obtain a third target audio. The third target audio has the spatial sound effect of the target virtual space and represents the target virtual space. Describes the sound effect changes produced when the listener's head moves.

For example, in order to further enhance the user's immersive experience, the corresponding sound effects can be simulated by combining the direction of the listener's left ear and the direction of the right ear during the movement of the listener's head.

When the listener moves his head, because the positions of the listener's two ears are changing, if the listener looks to the right, then the listener's left ear faces forward, then the listener's left ear should hear the speaker's voice. , the speaker's voice heard by the listener's right ear will be smaller, or the speaker's voice cannot be heard by the listener's right ear.

Among them, the listener's 6DoF data can be obtained based on 6DoF tracking of the head-mounted virtual reality device worn by the listener, and the listener's left ear orientation and right ear orientation are determined based on the 6DoF data.

6DoF tracking: Six degrees of freedom tracking. The six degrees of freedom (6DOF) with which an object can move in three-dimensional space. The six angles are (1) forward/backward, (2) up/down, (3) left/right, (4) yaw, (5) pitch and (6) roll. Free movement within a limited space is possible using a VR system that allows for 6DOF, which allows the user to take full advantage of all 6 degrees of freedom: yaw, pitch, roll, forward/backward, up/down and left/right. This makes the view more realistic and realistic.

For example, based on the first audio adjustment process or the second audio adjustment process, when performing the third audio adjustment process, the channel volume of the near-field audio and the background audio is mainly adjusted; for example, the channel volume of the background audio can be unchanged, if the left ear is facing forward and the right ear is facing backward, then the volume of the left channel of the near-field audio is turned up and the volume of the right channel of the near-field audio is turned down; if the left ear is turned to the left, If the right ear is facing to the right, the volume of the left channel of the near-field audio can be adjusted to be the same as the volume of the active channel; if the left ear is facing to the rear, and the right ear is facing to the front, the volume of the left channel of the near-field audio can be adjusted to the same level. Turn down and turn up the right channel volume of near-field audio.

For example, if the target virtual space is created on a virtual reality device used by the listener, the change in the listener's position can be directly obtained through the virtual reality device, that is, the direction of the listener's left ear and right ear can be obtained. And perform a third audio adjustment process on the near-field audio and background audio according to the listener's left ear orientation and right ear orientation; perform a mixing process on the near-field audio and background audio after the third audio adjustment process, and obtain The third target audio has a spatial sound effect of the target virtual space and a sound effect change effect that represents the listener's head swing.

For example, if the target virtual space is created in the cloud, such as the target virtual space may be created in the background of a video cloud, the listener's left ear orientation and right ear orientation are received from the virtual reality device, and based on The listener's left ear orientation and right ear orientation perform third audio adjustment processing on the near field audio and background audio; the near field audio and background audio after the third audio adjustment processing are mixed and processed to obtain the third The target audio and the third target audio have the spatial sound effect of the target virtual space and the sound effect change effect produced when the listener's head swings. The third target audio output from the cloud can be a four-way Dolby sound effect audio. The audio that users usually listen to is generally left and right stereo dual channels. This dual channel can actually only represent two ears, but Dolby sound effects can turn two sound sources into four sound sources. These four sound sources are transmitted to the listening device. When placed in the listener's head-mounted display device, a unique algorithm can be used to turn four sound sources into a three-dimensional sound source, giving the listener the overall feeling that the third target audio will have a front-to-back sequence or a left-to-right sequence of sound effects. .

All the above technical solutions can be combined in any way to form optional embodiments of the present application, and will not be described again one by one.

The embodiment of the present application obtains the near-field audio of the speaker; obtains the audio configuration parameters of the target virtual space, and the audio configuration parameters are used to simulate the spatial sound effects of the target virtual space; and mixes the near-field audio according to the audio configuration parameters of the target virtual space. Sound processing is performed to obtain the first target audio, which has the spatial sound effect of the target virtual space. The embodiment of the present application mixes the near-field audio through the pre-constructed audio configuration parameters of the target virtual space to obtain audio with spatial sound effects of the target virtual space, thereby improving the audio effect and user experience.

In order to facilitate better implementation of the audio processing method in the embodiment of the present application, the embodiment of the present application also provides an audio processing device. Please refer to FIG. 3 , which is a schematic structural diagram of an audio processing device provided by an embodiment of the present application. Wherein, the audio processing device 200 may include:

The first acquisition unit 210 is used to acquire the near-field audio of the speaker;

The second acquisition unit 220 is used to acquire the audio configuration parameters of the target virtual space, where the audio configuration parameters are used to simulate the spatial sound effects of the target virtual space;

The processing unit 230 is configured to perform mixing processing on the near-field audio according to the audio configuration parameters of the target virtual space to obtain a first target audio, where the first target audio has a spatial sound effect of the target virtual space.

In some embodiments, the audio configuration parameters of the target virtual space include audio reflection parameters of the target virtual space, attenuation parameters of audio propagation, and background audio of the target virtual space.

In some embodiments, the processing unit 230 is used to:

Perform a first audio adjustment process on the near-field audio and the background audio according to the audio reflection parameter and the attenuation parameter;

The near-field audio and the background audio that have been subjected to the first audio adjustment processing are mixed to obtain the first target audio.

In some embodiments, the processing unit 230 is also used to:

Obtain the first position of the virtual speaking object corresponding to the speaker in the target virtual space, and the second position of the virtual listening object corresponding to the listener in the target virtual space;

According to the audio reflection parameter, the attenuation parameter, the first position and the second position, a first audio adjustment process is performed on the near-field audio and the background audio.

In some embodiments, the processing unit 230 is also used to:

When it is detected that the relative positional relationship between the first position and the second position changes, the near-field audio and the relative positional relationship between the first position and the second position are compared. The background audio is subjected to a second audio adjustment process;

The near-field audio and the background audio after the second audio adjustment processing are mixed to obtain a second target audio. The second target audio has the spatial sound effect of the target virtual space and represents the target virtual space. The sound effect changes when the relative positional relationship between the first position and the second position changes.

In some embodiments, the relative position relationship includes a distance relationship, and the processing unit 230 is also used to:

When it is detected that the distance relationship between the first position and the second position changes, the near-field audio and the background audio are compared according to the distance between the first position and the second position. Perform second audio adjustment processing.

In some embodiments, the relative position relationship includes an orientation relationship, and the processing unit 230 is also used to:

When it is detected that the orientation relationship between the first position and the second position changes, the near-field audio and the background are compared according to the relative orientation between the first position and the second position. The audio undergoes a second audio adjustment process.

In some embodiments, the relative position relationship includes distance relationship and orientation relationship, and the processing unit 230 is also used to:

When it is detected that the distance relationship and the azimuth relationship between the first position and the second position change, based on the distance and relative azimuth between the first position and the second position, the near The field audio and the background audio undergo a second audio adjustment process.

In some embodiments, the processing unit 230 is also used to:

When the head swing of the listener is detected, the left ear orientation and the right ear orientation of the listener during the head swing are obtained;

Perform a third audio adjustment process on the near-field audio and the background audio according to the listener's left ear orientation and right ear orientation;

The near-field audio and the background audio after the third audio adjustment processing are mixed to obtain a third target audio. The third target audio has the spatial sound effect of the target virtual space and represents the target virtual space. Describes the sound effect changes produced when the listener's head moves.

In some embodiments, the audio processing device 200 further includes:

The setting unit is used to pre-set different types of virtual spaces according to different virtual scenes, where each type of virtual space has corresponding audio configuration parameters;

The second acquisition unit 220 is configured to respond to a selection instruction for a virtual space, determine the target virtual space from the different types of virtual spaces, and acquire the audio configuration parameters of the target virtual space.

Each unit in the above-mentioned audio processing device 200 can be implemented in whole or in part by software, hardware, and combinations thereof. Each of the above-mentioned units may be embedded in or independent of the processor in the virtual reality device in the form of hardware, or may be stored in the memory of the virtual reality device in the form of software, so that the processor can call and execute the operations corresponding to the above-mentioned units.

The audio processing device 200 may be integrated into a terminal or server that has a storage and a processor installed and has computing capabilities, or the audio processing device 200 is the terminal or server.

In some embodiments, the present application also provides a virtual reality device, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, it implements the steps in the above method embodiments.

As shown in Figure 4, Figure 4 is a schematic structural diagram of a virtual reality device provided by an embodiment of the present application. The virtual reality device 300 can usually be provided in the form of glasses, a helmet-mounted display (HMD), or a contact lens. It is used to realize visual perception and other forms of perception. Of course, the form of virtual reality equipment is not limited to this, and can be further miniaturized or enlarged as needed. The virtual reality device 300 may include but is not limited to the following components:

Detection module 301: Use various sensors to detect the user's operation commands and act on the virtual environment, such as following the user's line of sight to continuously update the image displayed on the display screen to realize the interaction between the user and the virtual scene, for example, based on the detected The rotation direction of the user's head continuously updates the real-life content.

Feedback module 302: receives data from sensors and provides real-time feedback to the user; wherein, the feedback module 302 may be used to display a graphical user interface, such as displaying a virtual environment on the graphical user interface. For example, the feedback module 302 may include a display screen or the like.

Sensor 303: On the one hand, it accepts operation commands from the user and applies them to the virtual environment; on the other hand, it provides the results of the operation to the user in the form of various feedbacks.

Control module 304: Controls sensors and various input/output devices, including obtaining user data (such as actions, voice) and output sensing data, such as images, vibrations, temperature and sound, etc., to the user, virtual environment and real world Have an effect.

Modeling module 305: Constructs a three-dimensional model of the virtual environment, which can also include various feedback mechanisms such as sound and touch in the three-dimensional model.

In the embodiment of the present application, the target virtual space can be constructed through the modeling module 305, and the near-field audio of the speaker can be obtained through the control module 304, and the audio configuration parameters of the target virtual space can be obtained. The audio configuration parameters are To simulate the spatial sound effect of the target virtual space, and perform mixing processing on the near-field audio according to the audio configuration parameters of the target virtual space to obtain the first target audio, the first target audio having the target Spatial sound in virtual space.

In some embodiments, as shown in Figure 5, which is another structural schematic diagram of a virtual reality device provided by an embodiment of the present application, the virtual reality device 300 also includes a processor 310 with one or more processing cores. Or the memory 320 of more than one computer-readable storage medium and the computer program stored on the memory 320 and executable on the processor. Among them, the processor 310 is electrically connected to the memory 320. Those skilled in the art can understand that the structure of the virtual reality device shown in the figures does not constitute a limitation on the virtual reality device, and may include more or less components than shown in the figures, or combine certain components, or arrange different components. .

The processor 310 is the control center of the virtual reality device 300. It uses various interfaces and lines to connect various parts of the entire virtual reality device 300, by running or loading software programs and/or modules stored in the memory 320, and by calling the software programs and/or modules stored in the memory 320. The data in 320 executes various functions of the virtual reality device 300 and processes data, thereby monitoring the virtual reality device 300 as a whole.

In this embodiment of the present application, the processor 310 in the virtual reality device 300 will follow the following steps to load instructions corresponding to the processes of one or more application programs into the memory 320, and the processor 310 will run the instructions stored in the application in memory 320 to implement various functions:

Obtain the near-field audio of the speaker; obtain the audio configuration parameters of the target virtual space, the audio configuration parameters are used to simulate the spatial sound effect of the target virtual space; according to the audio configuration parameters of the target virtual space, the near-field The audio is mixed and processed to obtain the first target audio, which has the spatial sound of the target virtual space.

For the specific implementation of each of the above operations, please refer to the previous embodiments and will not be described again here.

In some embodiments, processor 310 may include detection module 301, control module 304, and modeling module 305.

In some embodiments, as shown in FIG. 5 , the virtual reality device 300 further includes: a radio frequency circuit 306 , an audio circuit 307 and a power supply 308 . Among them, the processor 310 is electrically connected to the memory 320, the feedback module 302, the sensor 303, the radio frequency circuit 306, the audio circuit 307 and the power supply 308 respectively. Those skilled in the art can understand that the structure of the virtual reality device shown in Figure 4 or Figure 5 does not constitute a limitation on the virtual reality device, and may include more or less components than shown, or combine certain components, or Different component arrangements.

The radio frequency circuit 306 can be used to send and receive radio frequency signals to establish wireless communication with network equipment or other virtual reality equipment through wireless communication, and to send and receive signals with network equipment or other virtual reality equipment.

The audio circuit 307 can be used to provide an audio interface between the user and the virtual reality device through speakers and microphones. The audio circuit 307 can transmit the electrical signal converted from the received audio data to the speaker, which converts it into a sound signal and outputs it; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received and converted by the audio circuit 307 The audio data is processed by the audio data output processor 301 and then sent to, for example, another virtual reality device via the radio frequency circuit 306, or the audio data is output to the memory for further processing. Audio circuitry 307 may also include an earbud jack to provide communication between peripheral headphones and the virtual reality device.

The power supply 308 is used to power various components of the virtual reality device 300 .

Although not shown in FIG. 4 or FIG. 5 , the virtual reality device 300 may also include a camera, a wireless fidelity module, a Bluetooth module, an input module, etc., which will not be described again here.

In some embodiments, this application also provides a server, which includes a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, it implements the steps in the above method embodiments.

In some embodiments, the present application also provides a computer-readable storage medium for storing a computer program. The computer-readable storage medium can be applied to a virtual reality device or server, and the computer program causes the virtual reality device or server to execute the corresponding process in the audio processing method in the embodiment of the present application. For the sake of brevity, details will not be repeated here.

In some embodiments, the present application also provides a computer program product, the computer program product includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of the virtual reality device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, causing the virtual reality device to execute the corresponding process in the audio processing method in the embodiment of the present application. For the sake of simplicity, this is not mentioned here. Again.

The application also provides a computer program, the computer program includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of the virtual reality device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, causing the virtual reality device to execute the corresponding process in the audio processing method in the embodiment of the present application. For the sake of simplicity, this is not mentioned here. Again.

It should be understood that the processor in the embodiment of the present application may be an integrated circuit chip and has signal processing capabilities. During the implementation process, each step of the above method embodiment can be completed through an integrated logic circuit of hardware in the processor or instructions in the form of software. The above-mentioned processor can be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other programmable processors. Logic devices, discrete gate or transistor logic devices, discrete hardware components. Each method, step and logical block diagram disclosed in the embodiment of this application can be implemented or executed. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module can be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other mature storage media in this field. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

It can be understood that the memory in the embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically removable memory. Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory. The volatile memory may be random access memory (RAM), which is used as an external cache. By way of illustration, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (Dynamic RAM, DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synchlink DRAM, SLDRAM) and direct memory bus random access memory (DirectRambus RAM, DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

It should be understood that the above memory is illustrative but not restrictive. For example, the memory in the embodiment of the present application can also be static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), Synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous connection Dynamic random access memory (synch link DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM) and so on. That is, memories in embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiment of the present application can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.

If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a virtual reality device (which may be a personal computer or a server) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application. should be covered by the protection scope of this application. Therefore, the protection scope of this application should be determined by the protection scope of the claims.

Claims (15)

1. A method of audio processing, the method comprising:

acquiring near-field audio of a sounder;

acquiring audio configuration parameters of a target virtual space, wherein the audio configuration parameters are used for simulating the space sound effect of the target virtual space;

and mixing the near-field audio according to the audio configuration parameters of the target virtual space to obtain a first target audio, wherein the first target audio has the space sound effect of the target virtual space.

2. The audio processing method of claim 1, wherein the audio configuration parameters of the target virtual space include an audio reflection parameter of the target virtual space, an attenuation parameter of audio propagation, and a background audio of the target virtual space.

3. The audio processing method according to claim 2, wherein the performing audio mixing processing on the near-field audio according to the audio configuration parameters of the target virtual space to obtain a first target audio includes:

according to the audio reflection parameter and the attenuation parameter, performing first audio adjustment processing on the near-field audio and the background audio;

and mixing the near-field audio after the first audio adjustment processing with the background audio to obtain a first target audio.

4. The audio processing method of claim 3, wherein the method further comprises:

acquiring a first position of a virtual sounding object corresponding to the sounder in the target virtual space and a second position of a virtual listening object corresponding to a listener in the target virtual space;

and performing a first audio adjustment process on the near-field audio and the background audio according to the audio reflection parameter and the attenuation parameter, including:

and according to the audio reflection parameters and the attenuation parameters, the first position and the second position perform first audio adjustment processing on the near-field audio and the background audio.

5. The audio processing method of claim 4, wherein the method further comprises:

when the relative position relation between the first position and the second position is detected to be changed, performing second audio adjustment processing on the near-field audio and the background audio according to the relative position relation between the first position and the second position;

and mixing the near-field audio subjected to the second audio adjustment processing with the background audio to obtain second target audio, wherein the second target audio has a spatial sound effect of the target virtual space and a sound effect change effect generated when the relative position relation between the first position and the second position is represented.

6. The audio processing method according to claim 5, wherein the relative positional relationship includes a distance relationship, and the performing a second audio adjustment process on the near-field audio and the background audio according to the relative positional relationship between the first position and the second position when the relative positional relationship between the first position and the second position is detected to change, includes:

and when the distance relation between the first position and the second position is detected to change, performing second audio adjustment processing on the near-field audio and the background audio according to the distance between the first position and the second position.

7. The audio processing method according to claim 5, wherein the relative positional relationship includes an azimuth relationship, and the performing, when detecting that the relative positional relationship between the first position and the second position changes, second audio adjustment processing on the near-field audio and the background audio according to the relative positional relationship between the first position and the second position includes:

and when detecting that the azimuth relation between the first position and the second position changes, performing second audio adjustment processing on the near-field audio and the background audio according to the relative azimuth between the first position and the second position.

8. The audio processing method according to claim 5, wherein the relative positional relationship includes a distance relationship and an azimuth relationship, and wherein when a change in the relative positional relationship between the first position and the second position is detected, performing a second audio adjustment process on the near-field audio and the background audio according to the relative positional relationship between the first position and the second position includes:

when the change of the distance relation and the azimuth relation between the first position and the second position is detected, performing second audio adjustment processing on the near-field audio and the background audio according to the distance and the relative azimuth between the first position and the second position.

9. The audio processing method of claim 4, wherein the method further comprises:

when the head swing of the listener is detected, acquiring a left ear orientation direction and a right ear orientation direction of the listener in the head swing process;

performing third audio adjustment processing on the near-field audio and the background audio according to the left ear orientation direction and the right ear orientation direction of the listener;

and mixing the near-field audio subjected to the third audio adjustment processing with the background audio to obtain third target audio, wherein the third target audio has a spatial sound effect of the target virtual space and a sound effect change effect generated when the head of the listener swings.

10. The audio processing method according to any one of claims 1 to 9, characterized in that the method further comprises:

according to different virtual scenes, presetting different types of virtual spaces, wherein each type of virtual space has corresponding audio configuration parameters;

the obtaining the audio configuration parameters of the target virtual space includes:

and responding to a selection instruction aiming at the virtual space, determining the target virtual space from the different types of virtual spaces, and acquiring audio configuration parameters of the target virtual space.

11. An audio processing apparatus, the apparatus comprising:

the first acquisition unit is used for acquiring near-field audio of a sounder;

the second acquisition unit is used for acquiring audio configuration parameters of the target virtual space, wherein the audio configuration parameters are used for simulating the space sound effect of the target virtual space;

and the processing unit is used for carrying out audio mixing processing on the near-field audio according to the audio configuration parameters of the target virtual space to obtain first target audio, wherein the first target audio has the space sound effect of the target virtual space.

12. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program, which is adapted to be loaded by a processor for performing the audio processing method according to any of claims 1-10.

13. A virtual reality device comprising a processor and a memory, the memory having stored therein a computer program for executing the audio processing method of any of claims 1-10 by invoking the computer program stored in the memory.

14. A server comprising a processor and a memory, the memory having stored therein a computer program for executing the audio processing method according to any one of claims 1-10 by calling the computer program stored in the memory.

15. A computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the audio processing method of any of claims 1-10.