CN109243413B

CN109243413B - 3D sound effect processing method and related product

Info

Publication number: CN109243413B
Application number: CN201811121604.6A
Authority: CN
Inventors: 严锋贵
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-09-25
Filing date: 2018-09-25
Publication date: 2023-02-10
Anticipated expiration: 2038-09-25
Also published as: CN109243413A

Abstract

The embodiment of the application discloses a 3D sound effect processing method and a related product, wherein the method comprises the following steps: acquiring target identity information of a target user, wherein the target identity information at least comprises one of the following items: gender, age, region, server; acquiring a plurality of reference users corresponding to the target identity information from a preset database; determining target reverberation parameters corresponding to the plurality of reference users; and processing the single-sound-channel data to be played according to the target reverberation parameter to obtain reverberation double-sound-channel data. By adopting the method and the device, the audio playing effect can be improved.

Description

3D sound effect processing method and related product

Technical Field

The application relates to the technical field of electronic equipment, and mainly relates to a 3D sound effect processing method and a related product.

Background

With the development of the diversification of the functions of electronic devices and their portability, more and more people enjoy some entertainment activities through electronic devices. Particularly, the music player can listen to songs and watch videos anytime and anywhere according to the needs of users.

In the existing audio playing mode, the volume set by the user is often used as the basis, and the sound producing body adopts the constant power corresponding to the volume set by the user to play the audio, so that the played sound meets the loudness requirement of the user. However, such a playing mode is too single in form, and often causes sensory fatigue to the user.

Disclosure of Invention

The embodiment of the application provides a 3D sound effect processing method and a related product, which can improve the playing effect of audio data.

In a first aspect, an embodiment of the present application provides a 3D sound effect processing method, including:

acquiring target identity information of a target user, wherein the target identity information at least comprises one of the following items: gender, age, region, server;

acquiring a plurality of reference users corresponding to the target identity information from a preset database;

determining target reverberation parameters corresponding to the plurality of reference users;

and processing the mono-channel data to be played according to the target reverberation parameter to obtain reverberation binaural data.

In a second aspect, an embodiment of the present application provides a 3D sound effect processing apparatus, including:

an obtaining unit, configured to obtain target identity information of a target user, where the target identity information at least includes one of: gender, age, region, server; acquiring a plurality of reference users corresponding to the target identity information from a preset database;

a determining unit, configured to determine target reverberation parameters corresponding to the multiple reference users;

and the processing unit is used for processing the mono data to be played according to the target reverberation parameter to obtain the reverberation binaural data.

In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for some or all of the steps described in the first aspect.

In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, where the computer program causes a computer to perform some or all of the steps as described in the first aspect of the present application.

In a fifth aspect, embodiments of the present application provide a computer program product, where the computer program product comprises a non-transitory computer-readable storage medium storing a computer program, the computer program being operable to cause a computer to perform some or all of the steps as described in the first aspect of embodiments of the present application. The computer program product may be a software installation package.

The embodiment of the application has the following beneficial effects:

the method comprises the steps of obtaining target identity information of a target user, obtaining a plurality of reference users corresponding to the target identity information from a preset database, determining target reverberation parameters corresponding to the reference users, and processing mono data to be played according to the target reverberation parameters to obtain reverberation binaural data. Therefore, the target reverberation parameters corresponding to the multiple reference users are determined according to the identity information of the target users, and the reverberation binaural data are played according to the target reverberation parameters, so that the playing effect of the audio data is improved, and the user experience is improved conveniently.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Wherein:

fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 2A is a schematic flowchart of a 3D sound effect processing method according to an embodiment of the present disclosure;

fig. 2B is a schematic view of a scene of multi-channel binaural data according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a 3D sound effect processing device according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of another electronic device according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions of the present application better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.

The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein may be combined with other embodiments.

The electronic device according to the embodiments of the present disclosure may include various handheld devices (e.g., smart phones), vehicle-mounted devices, virtual Reality (VR)/Augmented Reality (AR) devices, wearable devices, computing devices or other processing devices connected to wireless modems, and various forms of User Equipment (UE), mobile Stations (MS), terminal devices (terminal device), research/development/test platforms, servers, and the like, which have wireless communication functions. For convenience of description, the above-mentioned devices are collectively referred to as electronic devices.

Referring to fig. 1, fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure, where the electronic device includes a control circuit and an input-output circuit, and the input-output circuit is connected to the control circuit.

The control circuitry may include, among other things, storage and processing circuitry. The storage circuit in the storage and processing circuit may be a memory, such as a hard disk drive memory, a non-volatile memory (e.g., a flash memory or other electronically programmable read only memory used to form a solid state drive, etc.), a volatile memory (e.g., a static or dynamic random access memory, etc.), etc., and the embodiments of the present application are not limited thereto. Processing circuitry in the storage and processing circuitry may be used to control the operation of the electronic device. The processing circuitry may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, and the like.

The storage and processing circuitry may be used to run software in the electronic device, such as play incoming call alert ringing application, play short message alert ringing application, play alarm alert ringing application, play media file application, voice Over Internet Protocol (VOIP) phone call application, operating system functions, and so forth. The software may be used to perform some control operations, such as playing an incoming alert ring, playing a short message alert ring, playing an alarm alert ring, playing a media file, making a voice phone call, and performing other functions in the electronic device, and the embodiments of the present application are not limited.

The input-output circuit can be used for enabling the electronic device to input and output data, namely allowing the electronic device to receive data from the external device and allowing the electronic device to output data from the electronic device to the external device.

The input-output circuit may further include a sensor. The sensors may include ambient light sensors, optical and capacitive based infrared proximity sensors, ultrasonic sensors, touch sensors (e.g., optical based touch sensors and/or capacitive touch sensors, where the touch sensors may be part of a touch display screen or may be used independently as a touch sensor structure), acceleration sensors, gravity sensors, and other sensors, etc. The input-output circuit may further include audio components that may be used to provide audio input and output functionality for the electronic device. The audio components may also include a tone generator and other components for generating and detecting sound.

The input-output circuitry may also include one or more display screens. The display screen can comprise one or a combination of a liquid crystal display screen, an organic light emitting diode display screen, an electronic ink display screen, a plasma display screen and a display screen using other display technologies. The display screen may include an array of touch sensors (i.e., the display screen may be a touch display screen). The touch sensor may be a capacitive touch sensor formed by a transparent touch sensor electrode (e.g., an Indium Tin Oxide (ITO) electrode) array, or may be a touch sensor formed using other touch technologies, such as acoustic wave touch, pressure sensitive touch, resistive touch, optical touch, and the like, and the embodiments of the present application are not limited thereto.

The input-output circuitry may further include communications circuitry that may be used to provide the electronic device with the ability to communicate with external devices. The communication circuitry may include analog and digital input-output interface circuitry, and wireless communication circuitry based on radio frequency signals and/or optical signals. The wireless communication circuitry in the communication circuitry may include radio frequency transceiver circuitry, power amplifier circuitry, low noise amplifiers, switches, filters, and antennas. For example, the wireless communication circuitry in the communication circuitry may include circuitry to support Near Field Communication (NFC) by transmitting and receiving near field coupled electromagnetic signals. For example, the communication circuit may include a near field communication antenna and a near field communication transceiver. The communications circuitry may also include cellular telephone transceiver and antennas, wireless local area network transceiver circuitry and antennas, and the like.

The input-output circuit may further include an input-output unit. Input-output units may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, and the like.

The electronic device may further include a battery (not shown), and the battery is used for supplying power to the electronic device.

The following describes embodiments of the present application in detail.

Referring to fig. 2A, an embodiment of the present application provides a flowchart of a 3D sound effect processing method, where the method is applied to an electronic device, and application scenes of the method may include a game-like scene, a live-broadcast application scene, and a panoramic sound recording scene, where the game-like scene may include a virtual reality scene and an augmented reality scene. Specifically, as shown in fig. 2A, a 3D sound effect processing method includes:

s201: and acquiring target identity information of a target user.

In this embodiment of the present application, the target user may be a user corresponding to the electronic device, or may be a user corresponding to the target application, for example: in a game class scene, the target user is an object of a game player in a game application; in a live application scene, the target user is an object of a live user in a live video; in the panoramic recording scene, the target user is a recording object and the like. The target application may be any application installed in the electronic device, may also be an application store of the electronic device, may also be a currently running application, and the like, which is not limited herein.

The target identity information may include identification information for identifying the target user, which may be an account number, a nickname, a phone number, a contact mailbox, etc. registered in a certain application. The target identity information may also include basic information such as the age, sex, area, server, etc. of the target user, which is not limited herein.

The method for acquiring the target identity information is not limited in the present application, and in a possible example, the acquiring the target identity information of the target user includes: acquiring a target application corresponding to the single sound channel data; acquiring a target account corresponding to the target application; searching a plurality of reference accounts registered in the electronic equipment according to the identification information corresponding to the target account; and acquiring the target identity information according to the target account and the registration information and the shared information corresponding to each of the multiple reference accounts.

For applications in the electronic device, each application corresponds to at least one account, and the account may be a temporary account or a registered account, which is not limited herein. And the account number corresponds to unique identification information, so that no matter what basic information is modified or not, a target user can be searched through the identification information.

As mentioned above, the identification information may be an account number, a nickname, a phone number, a contact mailbox, or the like; the registration information includes the above identification information, and may also include basic information such as age, sex, region, server, etc.; the shared information may be social circle information, such as: the circle of friends may also be an image, a video, an audio, etc., and is not limited herein. When a user registers accounts of a plurality of applications, the nickname of the user can be the same, and identification information such as a telephone number, a contact mailbox and the like can be bound, so that a plurality of other applications registered by the identification information can be determined from the electronic equipment according to the identification information.

It can be understood that the target application corresponding to the monaural data is acquired, then the target account corresponding to the target application is acquired, the target account searches a plurality of reference accounts registered in other applications in the electronic device, and the target identity information is acquired according to the target account and the registration information and the shared information corresponding to each of the plurality of reference accounts. Therefore, the multiple reference accounts are obtained according to the target account of the target application corresponding to the single sound channel data, so that the target identity information is obtained by combining the target account and the multiple reference accounts, namely the associated reference accounts are also considered, and the accuracy of determining the target identity information can be improved.

S202: and acquiring a plurality of reference users corresponding to the target identity information from a preset database.

In an embodiment of the present application, the preset database includes a plurality of users, and is configured to store a historical reverberation play record corresponding to each of the plurality of users. The multiple users may be users logged in the electronic device, users logged in a server corresponding to a current application running in a scene to which the application is applied, or users logged in a server corresponding to a certain application supporting reverberation playing, which is not limited herein.

In one possible example, the obtaining the plurality of reference users corresponding to the target identity information from the preset database includes: acquiring identity information of each user in the plurality of users to obtain a plurality of reference identity information; obtaining a similarity value between each piece of reference identity information in the plurality of pieces of reference identity information and the target identity information to obtain a plurality of similarity values; obtaining a plurality of target similarity values by obtaining the similarity value which is larger than a target threshold value in the plurality of similarity values; and taking the user corresponding to each target similarity value in the target similarity values as the reference user to obtain the reference users.

The target threshold is used to select a reference user, and is not limited to a specific number, for example, 80%.

For the method for acquiring the reference identity information of the user, the method for acquiring the target identity information of the target user can be referred to, and details are not repeated herein.

It can be understood that the reference identity information corresponding to each user is obtained to obtain a plurality of reference identity information, the similarity value between each reference identity information and the target identity information is obtained to obtain a plurality of similarity values, and a plurality of reference users similar to the target user are selected from the plurality of users according to the target threshold and the plurality of similarity values, so that the range of analyzing the historical reverberation playing records is narrowed, the target reverberation parameter is determined according to the reference user corresponding to the target identity information, and the accuracy of determining the target reverberation parameter can be further improved.

S203: and determining target reverberation parameters corresponding to the plurality of reference users.

In this embodiment of the present application, the target reverberation parameter may include setting parameters of multiple dimensions, such as an input volume, a low frequency cut, a high frequency cut, an early reflection time, a spatial extent, a diffusion degree, a low mixing ratio, a frequency dividing point, a reverberation time, a high frequency attenuation point, a dry sound adjustment, a reverberation volume, an early reflection sound volume, a sound field width, an output sound field, and a tail sound, which are not limited herein. It will be appreciated that determining the target reverberation parameter according to the preference type may improve the immersive experience for the user.

The present application is not limited to determining the target reverberation parameter, and in one possible example, the determining the target reverberation parameters corresponding to the multiple reference users includes: obtaining a plurality of historical reverberation play records corresponding to each reference user in the plurality of reference users from the preset database to obtain a plurality of first historical reverberation play records; obtaining a plurality of listening parameters corresponding to each first historical reverberation play record in the plurality of first historical reverberation play records; determining the target reverberation parameter from the plurality of listening parameters.

The listening parameters may be audio type, playing duration, user mood parameters, audio setting parameters, and the like, which are not limited herein.

It can be understood that the historical reverberation play records corresponding to the reference users are obtained from the pre-database of the electronic device to obtain a plurality of first historical reverberation play records, so that the range of analyzing the historical reverberation play records is narrowed, and the listening parameters are analyzed according to the historical reverberation play records of the reference users, so that the accuracy of analysis can be improved. And then, acquiring listening parameters corresponding to each first historical reverberation playing record to obtain a plurality of listening parameters, wherein the listening parameters can reflect the listening habits and preference types of a reference user for reverberation playing at ordinary times, and the reference identity information of the reference user is similar to the target identity information of the target user, so that the listening parameters close to the listening habits and preference types of the target user can be acquired, and then the target reverberation parameters are determined according to the plurality of listening parameters, so that the accuracy of determining the target reverberation parameters is improved, and the playing effect of the audio data is improved conveniently.

In one possible example, the plurality of listening parameters includes an audio type corresponding to each of the plurality of first historical reverb play records, and the determining the target reverb parameter from the plurality of listening parameters includes: acquiring a target audio type corresponding to the single-channel audio; selecting a plurality of second historical reverberation play records of which the audio types are successfully matched with the target audio types from the plurality of first historical reverberation play records; obtaining an evaluation value corresponding to each second historical reverberation play record in the plurality of second historical reverberation play records to obtain a plurality of evaluation values; determining a second historical reverberation play record corresponding to the maximum value in the plurality of evaluation values as a target historical reverberation play record; and determining the reverberation parameter corresponding to the target historical reverberation playing record as the target reverberation parameter.

It can be understood that each listening parameter corresponds to an audio type of one first historical reverberation play record, in the application, a target audio type corresponding to monaural data to be played is obtained first, and then a plurality of second historical reverberation play records are selected from the plurality of first historical reverberation play records according to the target audio type, so that the audio types of the second historical reverberation play records are all the target audio types, the range of analyzing the historical reverberation play records is further narrowed, and the accuracy of analysis is further improved. Then, the evaluation value of each second historical reverberation play record is obtained, the target historical reverberation play record is determined according to the maximum value of the evaluation values in the plurality of second historical reverberation play records, in this way, the record with the largest evaluation in the plurality of second historical reverberation play records is selected as the target historical reverberation play record, and the target reverberation parameter is determined according to the reverberation parameter corresponding to the target historical reverberation play record, so that the accuracy of determining the target reverberation parameter is further improved, and the playing effect of the audio data is convenient to improve.

In one possible example, after obtaining the rating value corresponding to each of the plurality of second historical reverberation play records to obtain a plurality of rating values, the method further includes: determining reference users corresponding to the plurality of second historical reverberation play records to obtain a plurality of target reference users; determining a preset weight corresponding to a similarity value between each target reference user and the target user in the plurality of target reference users to obtain a plurality of preset weights; carrying out weighted calculation on an evaluation value corresponding to each second historical reverberation play record in the plurality of second historical reverberation play records and a preset weight corresponding to a target reference user to obtain a plurality of target evaluation values; determining a second historical reverberation play record corresponding to the maximum value in the plurality of target evaluation values as a target historical reverberation play record; and determining the reverberation parameter corresponding to the target historical reverberation playing record as the target reverberation parameter.

And the target reference user is a reference user corresponding to the second historical reverberation playing record. It can be understood that the preset weight corresponding to the target reference user is determined according to the similarity value between the target reference user and the target user, then the evaluation value corresponding to the second historical reverberation play record and the preset weight corresponding to the target reference user corresponding to the second historical reverberation play record are weighted and calculated to obtain the target evaluation value of the second historical reverberation play record, then the record with the largest target evaluation value in the plurality of second historical reverberation play records is selected as the target historical reverberation play record, and then the reverberation parameter corresponding to the target historical reverberation play record is used to determine the target reverberation parameter, so that the accuracy of determining the target reverberation parameter is further improved, and the playing effect of the audio data is improved.

The method for obtaining the evaluation value corresponding to each second historical reverberation play record is not limited in the present application, and taking the target historical reverberation play record as an example, the method may be referred to by other second historical reverberation play records. Specifically, the listening parameters corresponding to the target historical reverberation play record further include a user mood parameter, and the obtaining the evaluation value corresponding to each of the plurality of second historical reverberation play records in the plurality of second historical reverberation play records to obtain a plurality of evaluation values includes: acquiring a preset mood parameter corresponding to the target audio type; acquiring a difference value between the preset mood parameter and the user mood parameter; and acquiring an evaluation value corresponding to the target historical reverberation play record according to the ratio between the difference and the preset mood parameter.

The obtaining method can obtain brain wave data through a brain wave sensor in the electronic equipment, and then analyze the brain wave data, so as to obtain the mood parameter of the user; the determination may also be made according to the frequency of operating the electronic device, and is not limited herein.

Different target audio types may correspond to different preset mood parameters, for example: the preset mood parameters corresponding to the type of the target audio representing the victory are happy and excited; indicating that the preset mood parameter corresponding to the attacked target audio type is tense; the preset mood parameter corresponding to the failed target audio type is represented as difficult; the preset mood parameters corresponding to the target audio type with cheerful rhythm are happy and excited; and the preset mood parameters corresponding to the target audio type with low rhythm are difficult, and the like.

It can be understood that the preset mood parameter corresponding to the target audio type and the user mood parameter of the target historical reverberation play record are obtained firstly, then the difference value between the preset mood parameter and the user mood parameter is obtained, and the evaluation value corresponding to the target historical reverberation play record is obtained according to the ratio of the difference value between the preset mood parameter and the preset mood parameter, so that the accuracy of obtaining the evaluation value can be improved.

S204: and processing the mono-channel data to be played according to the target reverberation parameter to obtain reverberation binaural data.

The method and the device have no limitation on how to process the mono data to be played according to the target reverberation parameter to obtain the reverberation binaural data, and can input the target reverberation parameter and the mono data into a Head Related Transfer Function (HRTF) model to obtain the reverberation binaural data.

In specific implementation, in the embodiment of the present application, the electronic device may filter audio data (sound emitted by a sound source) by using an HRTF filter to obtain virtual surround sound, also referred to as surround sound, or panoramic sound, so as to implement a three-dimensional stereo effect. The name of the HRTF in the time domain is Head Related Impulse Response (HRIR), or the audio data is convolved with Binaural Room Impulse Response (BRIR), which consists of three parts: direct sound, early reflected sound and reverberation.

In a possible example, the processing, according to the target reverberation parameter, the mono-channel data to be played to obtain the reverberation binaural data includes: analyzing the target reverberation parameter to obtain a left sound channel parameter and a right sound channel parameter; determining sound characteristics according to the target account; and processing the single-channel data according to the sound characteristics, the left channel parameters and the right channel parameters to obtain the reverberation two-channel data.

Each target account corresponds to different sound characteristics, for example, different characters in the game account correspond to different sound characteristics, the sound characteristics may include sound effects such as timbre, tone, frequency, etc., or may include a Buddhist dialect, etc., which is not limited herein.

The target reverberation parameters comprise corresponding left channel parameters and right channel parameters, and the sound characteristics are determined according to the target account number, so that the single-channel data is processed according to the sound characteristics, the left channel parameters and the right channel parameters to obtain reverberation double-channel data.

In a possible example, the analyzing the target reverberation parameter to obtain a left channel parameter and a right channel parameter includes: determining a left ear coordinate and a right ear coordinate corresponding to the target user; determining a first time and a first phase pressure for transmitting the single-channel data to the left ear of the target user according to the left ear coordinate, and determining a second time and a second phase pressure for transmitting the single-channel data to the right ear of the target user according to the right ear coordinate; determining a time difference according to the first time and the second time, and determining a phase pressure difference according to the first phase pressure and the second phase pressure; and analyzing the target reverberation parameter according to the time difference and the phase pressure difference to obtain the left sound channel parameter and the right sound channel parameter.

Wherein, the time difference and the phase difference are respectively the time difference and the phase difference of the monaural data transmitted to the left ear or the right ear of the target user.

It can be understood that, because there is a certain distance between the left ear and the right ear, there is a pressure difference when the sound propagates in the air, in the present application, the left ear coordinate and the right ear coordinate corresponding to the target user are determined first, then the time and the phase pressure of transmitting the monaural data to the left ear or the right ear of the target user are determined according to the left ear coordinate and the right ear coordinate, so as to determine the corresponding time difference and the phase pressure difference, then the target reverberation parameter is analyzed according to the time difference and the phase pressure difference to determine the left sound channel parameter and the right sound channel parameter, so as to analyze the target reverberation parameter according to the target coordinate of the target user, thereby improving the playing effect of the audio data, generating immersion feeling, and facilitating improvement of user experience.

The application is not limited to the method for determining the time and phase pressure, and in a possible example, the determining the first time and the first phase pressure for the monaural data to be transmitted to the left ear of the target user according to the left ear coordinates includes: acquiring a reference coordinate corresponding to the single sound channel data; obtaining a cross section by taking the reference coordinate and the left ear coordinate as axes; determining an occluding object between the reference coordinates and the left ear coordinates; determining a plurality of reference transmission paths for transmitting the single-channel data to the left ear coordinates according to the cross section and the shielding object; and determining the time and phase pressure of the monaural data transmitted to the left ear coordinates according to the plurality of reference transmission paths.

Wherein each path of the binaural data corresponds to a unique propagation direction.

Since sound propagates along all directions in real environment, and of course, reflection, refraction, interference, diffraction, etc. also occur during propagation, the propagation of monaural data may include multiple reference transmission paths. As shown in fig. 2B, when the left ear coordinate and the reference coordinate are taken as the axis to form a cross section, the propagation direction is constant, and the propagation path has a certain symmetry along a certain symmetry axis, so that a plurality of transmission paths can be obtained. And the sound transmission is dispersed and transmitted when encountering the shielding object, so that a plurality of corresponding reference transmission paths are determined according to the cross section and the shielding object in the application scene.

It can be understood that the left ear coordinate and the reference coordinate are used as axes to determine a cross section of sound source data transmission, then a plurality of reference transmission paths corresponding to the single channel data are determined according to the cross section and the shielding object, and then the phase pressure of the target sound source transmitted to the left ear of the target object is determined by the plurality of reference transmission paths. That is to say, according to the cross section that the reference coordinate corresponds to the left ear coordinate, a plurality of possible reference transmission paths are determined, and then time and phase pressure are determined according to the plurality of reference transmission paths, so that the accuracy of determining the time and the phase pressure is improved.

In one possible example, the determining the time and phase pressure of the target mono data transmission to the left ear three-dimensional coordinates from the plurality of reference transmission paths comprises: determining the sound intensity and the sound pressure corresponding to each transmission path in the plurality of reference transmission paths to obtain a plurality of sound intensities and a plurality of sound pressures; and determining the time and phase pressure of the target single-channel data transmitted to the three-dimensional coordinates of the left ear according to the sound intensities and the sound pressures.

Wherein, the sound intensity refers to the sound energy per unit area of the sound wave passing through the direction perpendicular to the propagation direction in unit time, and the unit is W/m2. Sound pressure is the increase in pressure due to the presence of sound waves, in Pa.

The method for determining the phase pressure according to the multiple sound pressures is not limited, the preset weight value can be determined according to the corresponding relative distance of the corresponding reference transmission path, and then the multiple sound pressures and the corresponding preset weight value are subjected to weighting calculation to obtain the phase pressure.

It can be understood that each sound source data has a corresponding sound pressure, so that the sound pressure corresponding to each reference transmission path is determined to obtain a plurality of sound pressures, and then the phase pressure of the target monaural data transmitted to the three-dimensional coordinate of the left ear is determined according to the plurality of sound pressures, so that the accuracy of determining the phase pressure can be improved.

In the 3D sound effect processing method shown in fig. 2A, target identity information of a target user is obtained, a plurality of reference users corresponding to the target identity information are obtained from a preset database, target reverberation parameters corresponding to the plurality of reference users are determined, and mono data to be played is processed according to the target reverberation parameters to obtain reverberant binaural data. Therefore, the target reverberation parameters corresponding to the multiple reference users are determined according to the identity information of the target users, and the reverberation binaural data are played according to the target reverberation parameters, so that the playing effect of the audio data is improved, and the user experience is improved conveniently.

Referring to fig. 3, fig. 3 is a schematic structural diagram of a 3D sound effect processing apparatus according to an embodiment of the present disclosure, and as shown in fig. 3, the 3D sound effect processing apparatus 300 includes an obtaining unit 301, a determining unit 302, and a processing unit 303, where:

the obtaining unit 301 is configured to obtain target identity information of a target user, where the target identity information at least includes one of the following items: gender, age, region, server; acquiring a plurality of reference users corresponding to the target identity information from a preset database;

the determining unit 302 is configured to determine target reverberation parameters corresponding to the multiple reference users;

the processing unit 303 is configured to process, according to the target reverberation parameter, the monaural data to be played to obtain reverberation binaural data.

It can be understood that target identity information of a target user is obtained, a plurality of reference users corresponding to the target identity information are obtained from a preset database, target reverberation parameters corresponding to the plurality of reference users are determined, and mono data to be played is processed according to the target reverberation parameters to obtain reverberation binaural data. Therefore, the target reverberation parameters corresponding to the multiple reference users are determined according to the identity information of the target users, and the reverberation binaural data are played according to the target reverberation parameters, so that the playing effect of the audio data is improved, and the user experience is improved conveniently.

In a possible example, in the aspect of determining the target reverberation parameter corresponding to the target identity information, the obtaining unit 301 is further configured to obtain, from the preset database, a historical reverberation play record corresponding to each of the multiple reference users, to obtain multiple first historical reverberation play records; obtaining a listening parameter corresponding to each first historical reverberation playing record in the plurality of first historical reverberation playing records to obtain a plurality of listening parameters; determining the target reverberation parameter from the plurality of listening parameters.

In one possible example, the plurality of listening parameters includes an audio type corresponding to each of the plurality of first historical reverberation play records, and in the aspect of determining the target reverberation parameter according to the plurality of listening parameters, the obtaining unit 301 is further configured to obtain a target audio type corresponding to the mono audio; selecting a plurality of second historical reverberation play records of which the audio types are successfully matched with the target audio types from the plurality of first historical reverberation play records; obtaining an evaluation value corresponding to each second historical reverberation play record in the plurality of second historical reverberation play records to obtain a plurality of evaluation values; the determining unit 302 is specifically configured to determine that a second historical reverberation play record corresponding to a maximum value of the plurality of evaluation values is a target historical reverberation play record; and determining the reverberation parameter corresponding to the target historical reverberation playing record as the target reverberation parameter.

In a possible example, the listening parameters corresponding to the target historical reverberation play record further include a user mood parameter, and in the aspect of obtaining the evaluation value corresponding to each of the plurality of second historical reverberation play records to obtain a plurality of evaluation values, the obtaining unit 302 is specifically configured to obtain a preset mood parameter corresponding to the target audio type; acquiring a difference value between the preset mood parameter and the user mood parameter; and acquiring an evaluation value corresponding to the target historical reverberation play record according to the ratio between the difference value and the preset mood parameter.

In a possible example, the preset database includes a plurality of users, and in the aspect of acquiring the plurality of reference users corresponding to the target identity information from the preset database, the acquiring unit 301 is specifically configured to acquire the identity information of each of the plurality of users to obtain a plurality of reference identity information; obtaining a similarity value between each piece of reference identity information in the plurality of pieces of reference identity information and the target identity information to obtain a plurality of similarity values; obtaining a similarity value which is larger than a target threshold value in the multiple similarity values to obtain multiple target similarity values; and taking the user corresponding to each target similarity value in the plurality of target similarity values as the reference user to obtain the plurality of reference users.

In one possible example, in the aspect of acquiring target identity information of a target user, the acquiring unit 301 is further configured to acquire a target application corresponding to the monaural data; acquiring a target account corresponding to the target application; searching a plurality of reference accounts registered in the electronic equipment according to the identification information corresponding to the target account; and acquiring the target identity information according to the target account and the registration information and the shared information corresponding to each of the plurality of reference accounts.

In a possible example, in the aspect that the monaural data to be played is processed according to the target reverberation parameter to obtain reverberation binaural data, the processing unit 302 is specifically configured to analyze the target reverberation parameter to obtain a left channel parameter and a right channel parameter; determining the sound characteristics of the target user according to the target account; and processing the single-channel data according to the sound characteristics, the left channel parameters and the right channel parameters to obtain the reverberation two-channel data.

Referring to fig. 4, fig. 4 is a schematic structural diagram of another electronic device according to an embodiment of the present disclosure. As shown in fig. 4, the electronic device 400 includes a processor 410, a memory 420, a communication interface 430, and one or more programs 440, wherein the one or more programs 440 are stored in the memory 420 and configured to be executed by the processor 410, the programs 440 including instructions for:

determining target reverberation parameters corresponding to the multiple reference users;

and processing the single-sound-channel data to be played according to the target reverberation parameter to obtain reverberation double-sound-channel data.

It can be understood that target identity information of a target user is obtained, a plurality of reference users corresponding to the target identity information are obtained from a preset database, target reverberation parameters corresponding to the plurality of reference users are determined, and mono data to be played is processed according to the target reverberation parameters to obtain reverberation binaural data. Therefore, the target reverberation parameters corresponding to the multiple reference users are determined according to the identity information of the target users, and the reverberation binaural data is played according to the target reverberation parameters, so that the playing effect of the audio data is improved, and the user experience is improved conveniently.

In one possible example, in the determining the target reverberation parameters corresponding to the plurality of reference users, the instructions in the program 440 are specifically configured to:

obtaining a historical reverberation play record corresponding to each reference user in the multiple reference users from the preset database to obtain multiple first historical reverberation play records;

obtaining a listening parameter corresponding to each first historical reverberation play record in the plurality of first historical reverberation play records to obtain a plurality of listening parameters;

determining the target reverberation parameter from the plurality of listening parameters.

In one possible example, the plurality of listening parameters includes an audio type corresponding to each of the plurality of first historical reverb play records, and in the determining the target reverb parameter based on the plurality of listening parameters, the instructions in the program 440 are specifically configured to:

acquiring a target audio type corresponding to the single-channel audio;

selecting a plurality of second historical reverberation playing records with successfully matched audio types and the target audio types from the plurality of first historical reverberation playing records;

obtaining an evaluation value corresponding to each second historical reverberation play record in the plurality of second historical reverberation play records to obtain a plurality of evaluation values;

determining a second historical reverberation play record corresponding to the maximum value in the plurality of evaluation values as a target historical reverberation play record;

and determining the reverberation parameter corresponding to the target historical reverberation playing record as the target reverberation parameter.

In one possible example, the listening parameters corresponding to the target historical reverberation play record further include a user mood parameter, and in terms of obtaining the evaluation value corresponding to each of the plurality of second historical reverberation play records, so as to obtain a plurality of evaluation values, the instructions in the program 440 are specifically configured to perform the following operations:

acquiring a preset mood parameter corresponding to the target audio type;

acquiring a difference value between the preset mood parameter and the user mood parameter;

and acquiring an evaluation value corresponding to the target historical reverberation play record according to the ratio between the difference value and the preset mood parameter.

In one possible example, the preset database includes a plurality of users, and in the aspect of obtaining the plurality of reference users corresponding to the target identity information from the preset database, the instructions in the program 440 are specifically configured to:

acquiring identity information of each user in the plurality of users to obtain a plurality of reference identity information;

obtaining a similarity value between each piece of reference identity information in the plurality of pieces of reference identity information and the target identity information to obtain a plurality of similarity values;

obtaining a similarity value which is larger than a target threshold value in the multiple similarity values to obtain multiple target similarity values;

and taking the user corresponding to each target similarity value in the target similarity values as the reference user to obtain the reference users.

In one possible example, in terms of obtaining target identity information of a target user, the instructions in the program 440 are specifically configured to:

acquiring a target application corresponding to the single sound channel data;

acquiring a target account corresponding to the target application;

searching a plurality of reference accounts registered in the electronic equipment according to the identification information corresponding to the target account;

and acquiring the target identity information according to the target account and the registration information and the shared information corresponding to each of the plurality of reference accounts.

In a possible example, in terms of processing the to-be-played mono data according to the target reverberation parameter to obtain the reverberated binaural data, the instructions in the program 440 are specifically configured to perform the following operations:

analyzing the target reverberation parameter to obtain a left sound channel parameter and a right sound channel parameter;

determining the sound characteristics of the target user according to the target account;

and processing the single-channel data according to the sound characteristics, the left channel parameters and the right channel parameters to obtain the reverberation double-channel data.

Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for causing a computer to execute a part or all of the steps of any one of the methods as described in the method embodiments, and the computer includes an electronic device.

Embodiments of the application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as recited in the method embodiments. The computer program product may be a software installation package and the computer comprises the electronic device.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art will recognize that the embodiments described in this specification are preferred embodiments and that no particular act or mode of operation is required.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is only a logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some interfaces, indirect coupling or communication connection between devices or units, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in a hardware form, or may be implemented in a software program mode.

The integrated unit, if implemented in the form of a software program module and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solutions of the present application, which are essential or part of the technical solutions contributing to the prior art, or all or part of the technical solutions, may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and the like.

Those skilled in the art will appreciate that all or part of the steps of the methods of the above embodiments may be implemented by a program, which is stored in a computer-readable memory, the memory including: flash disk, ROM, RAM, magnetic or optical disk, and the like.

The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A3D sound effect processing method is characterized by comprising the following steps:

acquiring target identity information of a target user, comprising: acquiring a target application corresponding to monaural data, acquiring a target account corresponding to the target application, searching a plurality of reference accounts registered in electronic equipment according to identification information corresponding to the target account, and acquiring target identity information according to the target account and registration information and shared information corresponding to each reference account in the plurality of reference accounts, wherein the target identity information at least comprises one of the following items: gender, age, region, server;

acquiring a plurality of reference users corresponding to the target identity information from a preset database; wherein the similarity value between the reference identity information of the plurality of reference users and the target identity information is greater than a target threshold value;

2. The method of claim 1, wherein said determining the target reverberation parameters corresponding to the plurality of reference users comprises:

obtaining a historical reverberation play record corresponding to each reference user in the plurality of reference users from the preset database to obtain a plurality of first historical reverberation play records;

obtaining a listening parameter corresponding to each first historical reverberation playing record in the plurality of first historical reverberation playing records to obtain a plurality of listening parameters;

3. The method of claim 2, wherein the plurality of listening parameters includes an audio type corresponding to each of the plurality of first historical reverb play records, and wherein determining the target reverb parameter based on the plurality of listening parameters comprises:

acquiring a target audio type corresponding to the single sound channel data;

obtaining an evaluation value corresponding to each second historical reverberation playing record in the plurality of second historical reverberation playing records to obtain a plurality of evaluation values;

4. The method of claim 3, wherein the listening parameters corresponding to the target historical reverberation play record further include a user mood parameter, and the obtaining the rating value corresponding to each of the plurality of second historical reverberation play records to obtain a plurality of rating values includes:

acquiring a preset mood parameter corresponding to the target audio type;

and acquiring an evaluation value corresponding to the target historical reverberation play record according to the ratio between the difference and the preset mood parameter.

5. The method according to any one of claims 1 to 4, wherein the preset database includes a plurality of users, and the obtaining a plurality of reference users corresponding to the target identity information from the preset database includes:

acquiring a similarity value between each piece of reference identity information in the plurality of pieces of reference identity information and the target identity information to obtain a plurality of similarity values;

and taking the user corresponding to each target similarity value in the plurality of target similarity values as the reference user to obtain the plurality of reference users.

6. The method of claim 1, wherein the processing the mono data to be played according to the target reverberation parameter to obtain the reverberated binaural data comprises:

7. A 3D sound effect processing apparatus, comprising:

an obtaining unit, configured to obtain target identity information of a target user, where the target identity information at least includes one of: gender, age, region, server; acquiring a plurality of reference users corresponding to the target identity information from a preset database; wherein the similarity value between the reference identity information of the plurality of reference users and the target identity information is greater than a target threshold value;

the processing unit is used for processing the single sound channel data to be played according to the target reverberation parameter to obtain reverberation double sound channel data;

in terms of obtaining target identity information of a target user, the obtaining unit is specifically configured to obtain a target application corresponding to the monaural data, obtain a target account corresponding to the target application, search a plurality of reference accounts registered in the electronic device according to identification information corresponding to the target account, and obtain the target identity information according to the target account and registration information and shared information corresponding to each reference account in the plurality of reference accounts.

8. An electronic device comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps of the method of any of claims 1-6.

9. A computer-readable storage medium for storing a computer program, wherein the computer program causes a computer to perform the method according to any one of claims 1-6.