CN109246580A - 3D sound effect treatment method and Related product - Google Patents

3D sound effect treatment method and Related product Download PDF

Info

Publication number
CN109246580A
CN109246580A CN201811118269.4A CN201811118269A CN109246580A CN 109246580 A CN109246580 A CN 109246580A CN 201811118269 A CN201811118269 A CN 201811118269A CN 109246580 A CN109246580 A CN 109246580A
Authority
CN
China
Prior art keywords
dimensional coordinate
sound source
data
target
mono
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811118269.4A
Other languages
Chinese (zh)
Other versions
CN109246580B (en
Inventor
严锋贵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201811118269.4A priority Critical patent/CN109246580B/en
Publication of CN109246580A publication Critical patent/CN109246580A/en
Priority to PCT/CN2019/090380 priority patent/WO2020062922A1/en
Application granted granted Critical
Publication of CN109246580B publication Critical patent/CN109246580B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved

Abstract

The embodiment of the present application discloses a kind of 3D sound effect treatment method and Related product, and the mono data that wherein method comprises determining that the three-dimensional coordinate of each sound source and each sound source generate in the corresponding multi-acoustical of electronic equipment obtains multiple first three-dimensional coordinates and multiple mono datas;Determine the second three-dimensional coordinate of the corresponding target object of the electronic equipment;According to the multiple first three-dimensional coordinate and second three-dimensional coordinate, the multiple mono data is synthesized to obtain target dual channel data.Using the application, the result of broadcast of audio data can be improved.

Description

3D sound effect treatment method and Related product
Technical field
This application involves audio play-back technology fields, and in particular to a kind of 3D sound effect treatment method and Related product.
Background technique
With the diversified development of electronic functionalities and its portable characteristics, more and more people like setting by electronics It is standby to carry out some recreations.Especially, it can be needed to listen song anywhere or anytime according to user, see video.
In existing audio broadcast mode, often based on volume set by user, set by sounding body using corresponding user The firm power of accordatura amount plays audio, so that the sound played meets the loudness demand of user.However, such broadcasting side Formula, form is excessively single, often brings to user tired out on sense organ.
Summary of the invention
The embodiment of the present application provides a kind of 3D sound effect treatment method and Related product, and the broadcasting effect of audio data can be improved Fruit.
In a first aspect, the embodiment of the present application provides a kind of 3D sound effect treatment method, comprising:
Determine the monophone that the three-dimensional coordinate of each sound source and each sound source generate in the corresponding multi-acoustical of electronic equipment Track data obtains multiple first three-dimensional coordinates and multiple mono datas;
Determine the second three-dimensional coordinate of the corresponding target object of the electronic equipment;
According to the multiple first three-dimensional coordinate and second three-dimensional coordinate, the multiple mono data is closed At obtaining target dual channel data.
Second aspect, the embodiment of the present application provide a kind of 3D sound-effect processing equipment, comprising:
Determination unit, for determining in the corresponding multi-acoustical of electronic equipment the three-dimensional coordinate of each sound source and each The mono data that sound source generates, obtains multiple first three-dimensional coordinates and multiple mono datas;Determine the electronic equipment pair Second three-dimensional coordinate of the target object answered;
Synthesis unit is used for according to the multiple first three-dimensional coordinate and second three-dimensional coordinate, to the multiple list Channel data is synthesized, and target dual channel data is obtained.
The third aspect, the embodiment of the present application provide a kind of electronic equipment, including processor, memory, communication interface and One or more programs, wherein said one or multiple programs are stored in above-mentioned memory, and are configured by above-mentioned It manages device to execute, described program includes the instruction for the step some or all of as described in first aspect.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, wherein described computer-readable Storage medium stores computer program, wherein the computer program makes computer execute such as the embodiment of the present application first party Step some or all of described in face.
5th aspect, the embodiment of the present application provide a kind of computer program product, wherein the computer program product Non-transient computer readable storage medium including storing computer program, the computer program are operable to make to calculate Machine executes the step some or all of as described in the embodiment of the present application first aspect.The computer program product can be one A software installation packet.
Implement the embodiment of the present application, will have the following beneficial effects:
Determine the monophone that the three-dimensional coordinate of each sound source and each sound source generate in the corresponding multi-acoustical of electronic equipment Track data obtains multiple first three-dimensional coordinates and multiple mono datas, and has been determined the of the corresponding target object of electronic equipment Two three-dimensional coordinates, then, according to the multiple first three-dimensional coordinate and second three-dimensional coordinate, to the multiple monophonic number According to being synthesized to obtain target dual channel data.In this way, in the first three-dimensional coordinate and target object that multi-acoustical has been determined The second three-dimensional coordinate after, the corresponding target dual channel data of multi-acoustical is generated, to improve the broadcasting effect of audio data Fruit can produce feeling of immersion by convenient for improving user experience.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Wherein:
Figure 1A is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application;
Figure 1B is the schematic diagram of a scenario of the reference axis of a kind of electronic equipment provided by the embodiments of the present application;
Fig. 2A is a kind of flow diagram of 3D sound effect treatment method provided by the embodiments of the present application;
Fig. 2 B is a kind of schematic diagram of a scenario of multichannel dual channel data provided by the embodiments of the present application;
Fig. 3 is a kind of structural schematic diagram of 3D sound-effect processing equipment provided by the embodiments of the present application;
Fig. 4 is the structural schematic diagram of another electronic equipment provided by the embodiments of the present application.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art Every other embodiment obtained without creative efforts, shall fall in the protection scope of this application.
The description and claims of this application and term " first " in above-mentioned attached drawing, " second " etc. are for distinguishing Different objects, are not use to describe a particular order.In addition, term " includes " and " having " and their any deformations, it is intended that It is to cover and non-exclusive includes.Such as the process, method, system, product or equipment for containing a series of steps or units do not have It is defined in listed step or unit, but optionally further comprising the step of not listing or unit, or optionally also wrap Include other step or units intrinsic for these process, methods, product or equipment.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments It is contained at least one embodiment of the application.Each position in the description occur the phrase might not each mean it is identical Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and Implicitly understand, embodiment described herein can be combined with other embodiments.
Electronic equipment involved by the embodiment of the present application may include the various handheld devices with wireless communication function (such as smart phone), mobile unit, virtual reality (virtual reality, VR)/augmented reality (augmented Reality, AR) equipment, wearable device calculates equipment or is connected to other processing equipments of radio modem, and Various forms of user equipmenies (user equipment, UE), mobile station (mobile station, MS), terminal device (terminal device), research and development/test platform, server etc..For convenience of description, apparatus mentioned above is referred to as electricity Sub- equipment.
Figure 1A is please referred to, Figure 1A is that the embodiment of the present application provides the structural schematic diagram of a kind of electronic equipment, electronic equipment Including control circuit and input-output circuit, imput output circuit is connected to the control circuit.
Wherein, control circuit may include storage and processing circuit.Storage circuit in the storage and processing circuit can be with It is memory, such as hard drive memory, nonvolatile memory (such as flash memory or it is used to form the other of solid state drive Electrically programmable read only memory etc.), volatile memory (such as either statically or dynamically random access memory etc.) etc., the application Embodiment is with no restriction.Processing circuit in storage and processing circuit can be used for the operating of controlling electronic devices.Processing electricity Road can microprocessor based on one or more, microcontroller, digital signal processor, baseband processor, power management unit, Audio codec chip, specific integrated circuit, display-driver Ics etc. are realized.
Storage and processing circuit can be used for running the software in electronic equipment, such as play incoming call prompting jingle bell application journey Sequence, play short message prompt jingle bell application program, play alarm clock prompting jingle bell application program, play media file application program, Voice over internet protocol (voice over internet protocol, VOIP) call application program, operating system function Energy is equal.These softwares can be used for executing some control operations, for example, playing incoming call prompting jingle bell, playing short message prompt sound Other functions etc. in bell, broadcasting alarm clock prompting jingle bell, broadcasting media file, progress voice telephone calls and electronic equipment, The embodiment of the present application is with no restriction.
Wherein, input-output circuit can be used for that electronic equipment is made to realize outputting and inputting for data, i.e. permission electronic equipment From outer equipment receiving data and electronic equipment is allowed to export data to external equipment from electronic equipment.
Input-output circuit may further include sensor.Sensor may include ambient light sensor, based on light and The infrared proximity transducer of capacitor, ultrasonic sensor, touch sensor is (for example, be based on light touch sensor and/or condenser type Touch sensor, wherein touch sensor can be a part of touching display screen, can also be used as a touch sensor knot Structure independently uses), acceleration transducer, gravity sensor and other sensors etc..Input-output circuit can also be further Including audio component, audio component can be used for providing audio input and output function for electronic equipment.Audio component can be with Including tone generator and other components for being used to generate and detect sound.
In the embodiment of the present application, sensor further includes 3-axis acceleration sensor, steric acceleration can be measured, for surveying Posture and the inclination angle for measuring electronic equipment can also be in global positioning systems other than automatically switching horizontal, vertically displayed visual angle When (global positioning system, GPS) poor signal, it is used as motion excursion compensation calculation, it can be comprehensively accurate anti- Reflect the kinetic property of object.
Figure 1B is please referred to, Figure 1B is the schematic diagram of a scenario for the reference axis that three dimension acceleration sensor determines electronic equipment.Such as Shown in Figure 1B, x-axis, y-axis, z-axis are opposing electronic device fuselage positions, and usual y-axis is upward to fuselage, x-axis to fuselage to The right side, the vertical fuselage front of z-axis are in the same direction with centrifugal force.Cross stream component, longitudinal component, vertical component are usually a unit Centrifugal force (size 1g (m*m/s), direction is downward perpendicular to the ground), the projection on each axis.In cross stream component correspondence and x-axis Numerical value, the corresponding numerical value in y-axis of longitudinal component, the corresponding numerical value in z-axis of vertical component, then lateral inclination angle is x-axis With the angle of horizontal plane, longitudinal inclination is the angle of y-axis and horizontal plane.
Such as: electronic equipment is laid flat on the table, x-axis is defaulted as 0, and y-axis default 0, z-axis defaults 9.81;Electronics is set Standby to put downward on the table, z-axis is -9.81;Electronic equipment is tilted to the left, x-axis is positive value;Electronic equipment is tilted to the right, x Axis is negative value;Electronic equipment is tilted upwards, y-axis is negative value;Electronic equipment is tilted down, y-axis is positive value;By z-axis be less than- 3 the case where, is considered as the touching display screen of electronic equipment downward.
Input-output circuit can also include one or more display screens.Display screen may include liquid crystal display, organic Light emitting diode (LED) display screen, electric ink display screen, plasma panel, using a kind of in the display screen of other display technologies or Several combination of person.Display screen may include touch sensor array (that is, display screen can be touching display screen).Touch sensing Device can be the capacitance touch sensing formed by transparent touch sensor electrode (such as tin indium oxide (ITO) electrode) array Device, or can be the touch sensor formed using other touching techniques, such as sound wave touch-control, pressure sensible touch, resistive touch, Optical touch etc., the embodiment of the present application is with no restriction.
Input-output circuit, which can further include telecommunication circuit, can be used for providing for electronic equipment and external equipment The ability of communication.Telecommunication circuit may include analog- and digital- input-output interface circuit, and be based on radiofrequency signal and/or light The radio communication circuit of signal.Radio communication circuit in telecommunication circuit may include radio-frequency transceiver circuitry, power amplifier Circuit, low-noise amplifier, switch, filter and antenna.For example, the radio communication circuit in telecommunication circuit may include For supported by emitting and receiving near-field coupling electromagnetic signal near-field communication (near field communication, NFC circuit).For example, telecommunication circuit may include near-field communication aerial and near-field communication transceiver.Telecommunication circuit can also wrap Include cellular telephone transceiver and antenna, wireless lan transceiver circuit and antenna etc..
Input-output circuit can further include input-output unit.Input-output unit may include button, Control stick, click wheel, scroll wheel, touch tablet, keypad, keyboard, camera, light emitting diode and other positioning indicators etc..
Wherein, electronic equipment can further include battery (not shown), and battery provides electric energy for electron equipment.
It describes in detail below to the embodiment of the present application.
The embodiment of the present application provides a kind of 3D sound effect treatment method and Related product, and the broadcasting effect of audio data can be improved Fruit.
A referring to figure 2., the embodiment of the present application provide a kind of flow diagram of 3D sound effect treatment method, this method application In electronic equipment.Specifically, as shown in Figure 2 A, a kind of 3D sound effect treatment method, comprising:
S201: determine that the three-dimensional coordinate of each sound source and each sound source generate in the corresponding multi-acoustical of electronic equipment Mono data obtain multiple first three-dimensional coordinates and multiple mono datas.
The embodiment of the present application can be applied to virtual reality/augmented reality scene, the scene alternatively, 3D records.The application is implemented In example, sound source can be a sounding body in virtual scene, for example, an aircraft in scene of game, sound source can be solid Sound source is determined, alternatively, moving sound.The reference axis of electronic equipment as shown in Figure 1B, then the corresponding sound source of electronic equipment can more than On the basis of stating reference axis, corresponding first three-dimensional coordinate of the sound source is determined, and when sound source makes a sound, then available source of students The mono data of generation.
Electronic equipment may include multi-acoustical, for example, the sound source of scene of game includes aircraft, gun, river water etc., then correspond to Mono data be aircraft gliding sound, the sound that gun load, emit, the water flow sound of river water;It may also comprise game player, Corresponding mono data is footsteps, the voice sound etc. of game player, it is not limited here.
In a possible example, the three-dimensional of each sound source is sat in the corresponding multi-acoustical of the determining electronic equipment The mono data that mark and each sound source generate obtains multiple first three-dimensional coordinates and multiple mono datas comprise determining that The corresponding multiple references object of the electronic equipment;Determine that the behavioural information of each references object in the multiple references object obtains To multiple behavioural informations;The multiple sound source is chosen from the multiple references object according to the multiple behavioural information;It determines The corresponding coordinate position of each sound source obtains the multiple first three-dimensional coordinate in the multiple sound source;According to the multiple sound source In the corresponding behavioural information of each sound source determine that the mono data of the sound source obtains the multiple mono data.
Wherein, references object can be the object presented in the display page of electronic equipment, such as: in the display page Automobile that house, game player are taken, the firearms held;It is also possible to the not shown object in the display page, such as: it is neighbouring Game player, firearms, vehicle etc..
Behavioural information is the multidate information of references object.It is appreciated that different references object corresponds to different behaviors Type, for example, the capable of emitting sound for loading, shooting of gun, without issuing water flow sound, voice.And it is each with reference in not With behavioural information when correspond to different sound, such as: house will not make a sound under normal circumstances, and the meeting when being bombarded Sound is bombarded in sending;When starting the sound of starting sound and traveling can just occur for automobile;Game player generates language when sending voice Speech generates footsteps etc. in walking.
That is, first determining the corresponding multiple references object of electronic equipment, the behavior of each references object is then obtained Information determines whether the references object is sound source according to each behavioural information, in this way, improving the accuracy of determining sound source.So Afterwards, further determine that the coordinate position of each sound source obtains multiple first three-dimensional coordinates, further according to the corresponding behavior of each sound source Information determines the mono data of the sound source, in this way, the accuracy of determining mono data can be improved according to behavioural information.
How the application is for determine the corresponding coordinate position of sound source without limitation, for example, if corresponding scene of game, And the corresponding three-dimensional map of the scene of game, in this way, the corresponding coordinate position of different sound sources, i.e. needle can be determined according to the map First three-dimensional coordinate is determined to role's specific location, improves the accuracy for determining the first three-dimensional coordinate, it is double convenient for improving target The 3D audio of channel data, allows user in game, can be on the spot in person, and the sensory play world is more true to nature.
How the application is for according to behavioural information to determine mono data without limitation, if the multiple behavioural information packet The corresponding goal behavior information of target sound source in the multiple sound source is included, it is described according in a possible example The corresponding behavioural information of each sound source determines that the mono data of the sound source obtains the multiple mono data in multi-acoustical Comprise determining that the corresponding sound type of the goal behavior information and play parameter;According to the sound type and the broadcasting Parameter generates the mono data of the target sound source.
Wherein, sound type be the corresponding goal behavior information of the sound phonation type, such as: gun include load, The sound type emit, hit, play parameter are loudness, frequency, tone etc..
It is appreciated that determining target sound source according to the corresponding goal behavior information of target sound source by taking target sound source as an example Then sound type and play parameter generate the mono data of the target sound source, such as further according to sound type and play parameter This, the sound type and play parameter of mono data are determined according to goal behavior information, further improves determining monophonic The accuracy of data improves the stickiness of mono data and application scenarios, convenient for improving user experience.
S202: the second three-dimensional coordinate of the corresponding target object of the electronic equipment is determined.
In the embodiment of the present application, target object can be game, electronic equipment in virtual reality or augmented reality scene Corresponding game player is also possible to corresponding target user of electronic equipment etc. in 3D recording scene.Target object can also be right A three-dimensional position, i.e. the second three-dimensional position are answered, certainly, the first three-dimensional position is different positions from the second three-dimensional position.It is right In the method that the method for determining the second three-dimensional coordinate is referred to determining first three-dimensional coordinate, i.e., it is with reference axis shown in Figure 1B Benchmark determines the second three-dimensional coordinate of the target object, and details are not described herein.
S203: according to the multiple first three-dimensional coordinate and second three-dimensional coordinate, to the multiple mono data It is synthesized to obtain target dual channel data.
Wherein, it in the second three-dimensional coordinate for knowing corresponding first three-dimensional coordinate of each sound source, target object, then can incite somebody to action The corresponding mono data of each sound source is synthesized to obtain target dual channel data, specifically, can be three-dimensional by multiple first Coordinate, second three-dimensional coordinate and multiple mono datas are input in HRTF model and obtain target dual channel data.
In the specific implementation, electronic equipment can use head to audio data (sound that sound source issues) in the embodiment of the present application Related transfer function (Head Related Transfer Function, HRTF) filter is filtered, obtain virtual ring around Sound, also referred to as surround sound or panorama sound, realize a kind of 3 D stereo sound effect.Title of the HRTF corresponding to time-domain be Relevant impulse response (Head Related Impulse Response, HRIR), or by audio data and binaural room Convolution is done in impulse response (Binaural Room Impulse Response, BRIR), and binaural room impulse response is by three portions It is grouped as: direct sound wave, reflection and reverberation.
For example, electronic equipment can be according to the 3 d space coordinate position (x, y, z) of sound source, which can be arbitrarily Coordinate generates left and right acoustic channels further according to the mono data that sound source generates, and the production principle of left and right acoustic channels is according to sound source distance Hearer (X, Y, Z), one point data transmit left ear and the time difference and the phase pressure difference generation two-channel that are transferred to auris dextra data Sound.
It is described according to the multiple first three-dimensional coordinate and second three-dimensional coordinate in a possible example, it is right The multiple mono data, which is synthesized to obtain target dual channel data, comprises determining that the corresponding left side of second three-dimensional coordinate Ear three-dimensional coordinate and auris dextra three-dimensional coordinate;According to the multiple first three-dimensional coordinate, the left ear three-dimensional coordinate and the auris dextra Three-dimensional coordinate determines that the transmission path between the multiple sound source and the target object obtains multiple transmission paths;According to described Multiple transmission paths determine in the multiple mono data that each mono data is transmitted to the left ear three-dimensional coordinate, described The time of auris dextra three-dimensional coordinate and phase pressure obtain multiple times and multiple phase pressures;Institute is determined according to the multiple time Stating the corresponding time difference of each mono data in multiple mono datas obtains multiple time differences, according to the multiple phase pressure Power determines that it is poor to obtain multiple phase pressures for the corresponding phase pressure difference of each mono data in the multiple mono data;Root Each mono data pair in the multiple mono data is determined according to the multiple time difference and the multiple phase pressure difference The delay parameter answered obtains multiple delay parameters;According to the multiple delay parameter, to each in the multiple mono data Mono data is handled to obtain corresponding L channel parameter and right channel parameter;According to every in the multiple mono data The corresponding L channel parameter of one mono data and right channel parameter are synthesized to obtain described to the multiple mono data Target dual channel data.
Wherein, the corresponding left ear three-dimensional coordinate of target object and an auris dextra three-dimensional coordinate, for how to determine left ear Three-dimensional coordinate and auris dextra three-dimensional coordinate without limitation, can be determined, i.e. basis according to the 3D person model of the target object The second three-dimensional coordinate and auris dextra three-dimensional coordinate of pre-set target object, the second three-dimensional coordinate and left ear in 3D person model Incidence relation between three-dimensional coordinate is determined.
Time difference and phase pressure difference are respectively to be transmitted to the difference and phase of the time of left ear three-dimensional coordinate, auris dextra three-dimensional coordinate The difference of position pressure, that is to say, that the corresponding mono data of sound source is transmitted to the left ear of target object, the time difference of auris dextra and phase Position pressure difference.
It is appreciated that since there are certain distances between left and right ear, there are pressure difference when sound is propagated in air, Therefore, the corresponding left ear three-dimensional coordinate of the second three-dimensional coordinate and auris dextra three-dimensional coordinate are first determined, further according to each first three-dimensional seat Mark, left ear three-dimensional coordinate and auris dextra three-dimensional coordinate determine the transmission path between multi-acoustical and target object to obtain multiple biographies Defeated path, then by each transmission path determine by each mono data from the first three-dimensional coordinate be transmitted to left ear three-dimensional coordinate, The time of auris dextra three-dimensional coordinate and phase pressure are to obtain multiple times and multiple phase pressures.Then it is determined according to multiple times The time difference of each mono data determines the phase pressure of each mono data according to multiple phase pressures, further according to every One time difference and phase pressure determine that corresponding mono data is transmitted to the delay parameter of the left and right ear of target object, then, root The corresponding L channel parameter of each mono data and right channel parameter are determined according to the delay parameter, thus according to each monophonic The L channel parameter and right channel parameter of data the mono data is handled after dual channel data, then Obtained multiple dual channel datas are synthesized to obtain target dual channel data.That is, according to the multiple first three-dimensional seats Mark determines the corresponding delay parameter of each sound source with the second three-dimensional coordinate respectively, in this way, determining monophonic number according to delay parameter According to L channel parameter and right channel parameter, then synthesized to obtain target dual channel data, improve the broadcasting of audio data Effect can produce feeling of immersion by convenient for improving user experience.
For how to determine the method for time and phase pressure without limitation, the application is transmitted to the application with target sound source For left ear three-dimensional coordinate corresponding time and phase pressure, the target sound source be transmitted to the left ear three-dimensional coordinate corresponding time and The corresponding mono data determination of other sound sources in phase pressure and multi-acoustical other than target sound source is transmitted to a left side The method of ear three-dimensional coordinate, auris dextra three-dimensional coordinate corresponding time and phase pressure can refer to the method.
Specifically, the multiple first three-dimensional coordinate includes the target sound if the multiple sound source includes target sound source Corresponding the first three-dimensional coordinate of target in source, the multiple mono data include the corresponding target monophonic number of the target sound source According to;It is described that each list in the multiple mono data is determined according to the multiple transmission path in a possible example Channel data be transmitted to the left ear three-dimensional coordinate, the time of the auris dextra three-dimensional coordinate and phase pressure obtain multiple times and Multiple phase pressures include: to obtain cross section using first three-dimensional coordinate of target and the left ear three-dimensional coordinate as axis;Really Object is blocked between fixed first three-dimensional coordinate of target and the left ear three-dimensional coordinate;According to the cross section and the screening Block material body determines that the target mono data is transmitted to multiple reference transmission paths of the left ear three-dimensional coordinate;According to described Multiple reference transmission paths determine that the target mono data is transmitted to time and the phase pressure of the left ear three-dimensional coordinate.
Since in actual environment, sound is propagated along all directions, certainly, in communication process, can also go out Phenomena such as now reflection, refraction, interference, diffraction, therefore, the propagation of target mono data may include multiple reference transmission paths. As shown in Figure 2 B, make cross section using the first three-dimensional coordinate of target and left ear three-dimensional coordinate as axis, due to direction of sound propagation one Fixed, propagation trajectories can also have certain symmetry along certain symmetry axis, and multiple transmission paths can be obtained.And the biography of sound Broadcast and will disperse transmission when encountering and blocking object, thus according in cross section and application scenarios block object determine it is corresponding more A reference transmission path.
It is appreciated that determining a sound source data transmission using the first three-dimensional coordinate of target and left ear three-dimensional coordinate as axis Cross section, further according to the cross section with block object and determine the corresponding multiple reference transmission paths of target mono data, then by Multiple reference transmission paths determine that target sound source is transmitted to the phase pressure of the left ear of target object.That is, according to target First three-dimensional coordinate cross section corresponding with left ear three-dimensional coordinate determines possible multiple reference transmission paths, further according to multiple ginsengs It examines transmission path and determines time and phase pressure, improve the accuracy of determining time and phase pressure.
It is described that the target mono data is determined according to the multiple reference transmission path in a possible example The time and phase pressure for being transmitted to the left ear three-dimensional coordinate comprise determining that each transmission in the multiple reference transmission path The corresponding sound intensity in path and acoustic pressure obtain multiple sound intensitys and multiple acoustic pressures;It is determined according to the multiple sound intensity and the multiple acoustic pressure The target mono data is transmitted to time and the phase pressure of the left ear three-dimensional coordinate.
Wherein, the sound intensity referred in the unit time, and sound wave is by the acoustic energy perpendicular to direction of propagation unit area, unit W/m2.Acoustic pressure is the increment of the pressure due to caused by the presence of sound wave, unit Pa.
The application, can be according to corresponding with reference to passing for how according to multiple acoustic pressures to determine the method for phase pressure without limitation The corresponding relative distance in defeated path determines preset weights, then multiple acoustic pressures and corresponding preset weights are weighted to obtain Phase pressure.
It is appreciated that each sound source data has corresponding acoustic pressure, in this way, first determining that each reference transmission path is corresponding Acoustic pressure determines that target mono data is transmitted to the phase pressure of left ear three-dimensional coordinate to obtain multiple acoustic pressures, further according to multiple acoustic pressures Power, in this way, the accuracy of determining phase pressure can be improved.
In 3D sound effect treatment method as shown in Figure 2 A, each sound source in the corresponding multi-acoustical of electronic equipment is determined The mono data that three-dimensional coordinate and each sound source generate obtains multiple first three-dimensional coordinates and multiple mono datas, and The second three-dimensional coordinate of the corresponding target object of electronic equipment is determined, then, according to the multiple first three-dimensional coordinate and institute The second three-dimensional coordinate is stated, the multiple mono data is synthesized to obtain target dual channel data.In this way, more having determined After first three-dimensional coordinate of a sound source and the second three-dimensional coordinate of target object, the corresponding target alliteration of multi-acoustical is generated Track data can produce feeling of immersion by convenient for improving user experience to improve the result of broadcast of audio data.
In a possible example, the method also includes: determine the corresponding preference reverberation parameters of the target object; The target dual channel data is handled to obtain reverberation dual channel data according to the preference reverberation parameters.
Wherein, preference reverberation parameters include input volume, low cut, high cut, early reflection interval, spatial extent, Diffusion, low mixed ratio, part-frequency point, reverberation time, high frequency decline point, dry tone section, reverberation volume, early reflection amount of sound, sound Field width degree, output sound field, last or end syllable etc., it is not limited here.
It is appreciated that determine the corresponding preference reverberation parameters of target object, it is then double to target according to preference reverberation parameters Channel data is handled to obtain reverberation dual channel data, in this way, target dual channel data is handled according to target object, It can further improve the result of broadcast of audio data, convenient for improving user experience.
How the application is for determine preference reverberation parameters without limitation, in a possible example, the determining institute Stating the corresponding preference reverberation parameters of target object includes: to obtain the corresponding multiple history reverberation of the pre-stored target object Play record;It obtains the multiple history reverberation and plays each history reverberation broadcasting in record and record corresponding parameter of listening to and obtain It is multiple to listen to parameter;The preference reverberation parameters are determined according to the multiple parameter of listening to.
Wherein, listening to parameter includes audio types, playing duration, broadcasting adjustment number, user mood parameter etc..It can manage Solution obtains pre-stored multiple history reverberation corresponding with target object and plays record, obtains each history reverberation and play note Record it is corresponding listen to parameter, determine preference reverberation parameters further according to multiple parameters of listening to, improve determining preference reverberation parameters Accuracy, convenient for improving result of broadcast.
The application possible shows for how according to multiple parameters of listening to determine preference reverberation parameters without limitation at one It is described to determine that the preference reverberation parameters include: that listen to parameter true according to the multiple according to the multiple parameter of listening in example Each history reverberation broadcasting records corresponding evaluation of estimate and obtains multiple evaluations of estimate in fixed the multiple history reverberation broadcasting record;It will The corresponding history reverberation record of maximum value in the multiple evaluation of estimate is recorded as target histories reverberation;By the target histories Reverberation records corresponding reverberation parameters as the preference reverberation parameters.
Wherein, it if it includes that target histories reverberation plays record that the multiple history reverberation, which plays record, is gone through with the target For history reverberation plays record, the application scenarios of the electronic equipment are determined;Determine the corresponding default mood of the application scenarios Parameter;The target histories reverberation record is determined according to the difference between the default mood parameter and the user mood parameter Corresponding evaluation of estimate.
It is appreciated that the corresponding default mood parameter of target object is different in different application scenarios, in this way, according to The corresponding application scenarios of electronic equipment determine the default mood parameter of target object, then, according to default mood parameter and user Difference between mood parameter determines that target histories reverberation records corresponding evaluation of estimate.In this application, mixed according to each history The evaluation of estimate listened to parameter and determine corresponding history reverberation record for ringing record, it is mixed then to choose the corresponding history of maximum evaluation of estimate It rings record to record as target histories reverberation, determines preference reverberation parameters further according to the parameter of listening to of target histories reverberation record, In this way, improving the accuracy of determining preference reverberation parameters.
Referring to figure 3., Fig. 3 is a kind of structural schematic diagram of 3D sound-effect processing equipment provided by the embodiments of the present application, such as Fig. 3 Shown, above-mentioned 3D sound-effect processing equipment 300 includes determination unit 301 and synthesis unit 302, in which:
Determination unit 301 is for determining in the corresponding multi-acoustical of electronic equipment the three-dimensional coordinate of each sound source and every The mono data that one sound source generates, obtains multiple first three-dimensional coordinates and multiple mono datas;Determine the electronic equipment Second three-dimensional coordinate of corresponding target object;
Synthesis unit 302 is used for according to the multiple first three-dimensional coordinate and second three-dimensional coordinate, to the multiple Mono data is synthesized, and target dual channel data is obtained.
It is appreciated that determination unit 301 determine the three-dimensional coordinate of each sound source in the corresponding multi-acoustical of electronic equipment, with And the mono data that each sound source generates obtains multiple first three-dimensional coordinates and multiple mono datas, and has been determined that electronics is set Second three-dimensional coordinate of standby corresponding target object, then, synthesis unit 302 is according to the multiple first three-dimensional coordinate and described Second three-dimensional coordinate synthesizes the multiple mono data to obtain target dual channel data.In this way, multiple having determined After first three-dimensional coordinate of sound source and the second three-dimensional coordinate of target object, the corresponding target two-channel of multi-acoustical is generated Data can produce feeling of immersion by convenient for improving user experience to improve the result of broadcast of audio data.
In a possible example, described according to the multiple first three-dimensional coordinate and second three-dimensional coordinate, The multiple mono data is synthesized, in terms of obtaining target dual channel data, the determination unit 301 is also used to determine The corresponding left ear three-dimensional coordinate of second three-dimensional coordinate and auris dextra three-dimensional coordinate;According to the multiple first three-dimensional coordinate, institute It states left ear three-dimensional coordinate and the auris dextra three-dimensional coordinate determines transmission path between the multiple sound source and the target object, Obtain multiple transmission paths;Determine that each mono data passes in the multiple mono data according to the multiple transmission path The left ear three-dimensional coordinate, the time of the auris dextra three-dimensional coordinate and phase pressure are transported to, multiple times and multiple phases are obtained Pressure;The each mono data corresponding time difference in the multiple mono data is determined according to the multiple time, is obtained Multiple time differences determine the corresponding phase of each mono data in the multiple mono data according to the multiple phase pressure Position pressure difference, it is poor to obtain multiple phase pressures;It is determined according to the multiple time difference and the multiple phase pressure difference described more The corresponding delay parameter of each mono data, obtains multiple delay parameters in a mono data;According to the multiple delay Parameter handles each mono data in the multiple mono data, obtains corresponding L channel parameter and right sound Road parameter;The synthesis unit 302 is specifically used for according to the corresponding left side of mono data each in the multiple mono data Channel parameters and right channel parameter, synthesize the multiple mono data, obtain the target dual channel data.
In a possible example, the multiple sound source includes target sound source, and the multiple first three-dimensional coordinate includes Corresponding the first three-dimensional coordinate of target of the target sound source, the multiple mono data includes the corresponding mesh of the target sound source Mark mono data;
Determine that each mono data is transmitted in the multiple mono data according to the multiple transmission path described To the left ear three-dimensional coordinate, the time of the auris dextra three-dimensional coordinate and phase pressure, multiple times and multiple phase pressures are obtained In terms of power, the determination unit 301 is specifically used for using first three-dimensional coordinate of target and the left ear three-dimensional coordinate as axis, Obtain cross section;It determines and blocks object between first three-dimensional coordinate of target and the left ear three-dimensional coordinate;According to described Cross section and the object that blocks determine that the target mono data is transmitted to the multiple with reference to biography of the left ear three-dimensional coordinate Defeated path;Determine that the target mono data is transmitted to the left ear three-dimensional coordinate according to the multiple reference transmission path Time and phase pressure.
In a possible example, the target monophonic number is determined according to the multiple reference transmission path described In terms of the time for being transmitted to the left ear three-dimensional coordinate and phase pressure, the determination unit 301 is specifically used for described in determination The corresponding sound intensity of each transmission path and acoustic pressure, obtain multiple sound intensitys and multiple acoustic pressures in multiple reference transmission paths;According to institute It states multiple sound intensitys and determines that the target mono data is transmitted to the time of the left ear three-dimensional coordinate, according to the multiple acoustic pressure Determine that the target mono data is transmitted to the phase pressure of the left ear three-dimensional coordinate.
In a possible example, the three-dimensional of each sound source is sat in the corresponding multi-acoustical of the determining electronic equipment The mono data that mark and each sound source generate, it is described in terms of obtaining multiple first three-dimensional coordinates and multiple mono datas Determination unit 301 is specifically used for determining the corresponding multiple references object of the electronic equipment;It determines in the multiple references object The behavioural information of each references object obtains multiple behavioural informations;According to the multiple behavioural information from the multiple reference pair The multiple sound source is chosen as middle;It determines the corresponding coordinate position of each sound source in the multiple sound source, obtains the multiple One three-dimensional coordinate;The mono data that the sound source is determined according to the corresponding behavioural information of sound source each in the multiple sound source, obtains To the multiple mono data.
In a possible example, the multiple behavioural information includes the corresponding goal behavior information of target sound source;? It is described according to the corresponding behavioural information of sound source each in the multiple sound source determine the sound source mono data obtain it is described more In terms of a mono data, the determination unit 301 be specifically used for determining the corresponding sound type of the goal behavior information and Play parameter;The mono data of the target sound source is generated according to the sound type and the play parameter.
In a possible example, the determination unit 301 is also used to determine that the corresponding target of the target object is mixed Ring parameter;The synthesis unit 302 is also used to handle the target dual channel data according to the target reverberation parameters Obtain reverberation dual channel data.
Referring to figure 4., Fig. 4 is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application.As shown in figure 4, The electronic equipment 400 includes processor 410, memory 420, communication interface 430 and one or more programs 440, wherein on It states one or more programs 440 to be stored in above-mentioned memory 420, and is configured to be executed by above-mentioned processor 410, it is above-mentioned Program 440 includes the instruction for executing following steps:
Determine what the three-dimensional coordinate of each sound source in the corresponding multi-acoustical of electronic equipment 400 and each sound source generated Mono data obtains multiple first three-dimensional coordinates and multiple mono datas;
Determine the second three-dimensional coordinate of the corresponding target object of the electronic equipment 400;
According to the multiple first three-dimensional coordinate and second three-dimensional coordinate, the multiple mono data is closed At obtaining target dual channel data.
It is appreciated that determining the three-dimensional coordinate and each sound of each sound source in the corresponding multi-acoustical of electronic equipment 400 The mono data that source generates obtains multiple first three-dimensional coordinates and multiple mono datas, and has been determined that electronic equipment 400 is right Second three-dimensional coordinate of the target object answered, it is then, right according to the multiple first three-dimensional coordinate and second three-dimensional coordinate The multiple mono data is synthesized to obtain target dual channel data.In this way, in the first three-dimensional that multi-acoustical has been determined After second three-dimensional coordinate of coordinate and target object, the corresponding target dual channel data of multi-acoustical is generated, to improve The result of broadcast of audio data can produce feeling of immersion by convenient for improving user experience.
In a possible example, described according to the multiple first three-dimensional coordinate and second three-dimensional coordinate, The multiple mono data is synthesized, in terms of obtaining target dual channel data, the instruction in described program 440 is specifically used The operation below executing:
Determine the corresponding left ear three-dimensional coordinate of second three-dimensional coordinate and auris dextra three-dimensional coordinate;
It is determined according to the multiple first three-dimensional coordinate, the left ear three-dimensional coordinate and the auris dextra three-dimensional coordinate described more Transmission path between a sound source and the target object obtains multiple transmission paths;
Determine that each mono data is transmitted to described in the multiple mono data according to the multiple transmission path Left ear three-dimensional coordinate, the time of the auris dextra three-dimensional coordinate and phase pressure, obtain multiple times and multiple phase pressures;
The each mono data corresponding time difference in the multiple mono data is determined according to the multiple time, is obtained To multiple time differences, determine that each mono data is corresponding in the multiple mono data according to the multiple phase pressure Phase pressure is poor, and it is poor to obtain multiple phase pressures;
Each list in the multiple mono data is determined according to the multiple time difference and the multiple phase pressure difference The corresponding delay parameter of channel data, obtains multiple delay parameters;
According to the multiple delay parameter, each mono data in the multiple mono data is handled, is obtained To corresponding L channel parameter and right channel parameter;
It is right according to the corresponding L channel parameter of mono data each in the multiple mono data and right channel parameter The multiple mono data is synthesized, and the target dual channel data is obtained.
In a possible example, the multiple sound source includes target sound source, and the multiple first three-dimensional coordinate includes Corresponding the first three-dimensional coordinate of target of the target sound source, the multiple mono data includes the corresponding mesh of the target sound source Mark mono data;
Determine that each mono data is transmitted in the multiple mono data according to the multiple transmission path described To the left ear three-dimensional coordinate, the time of the auris dextra three-dimensional coordinate and phase pressure, multiple times and multiple phase pressures are obtained In terms of power, the instruction in described program 440 is specifically used for executing following operation:
Using first three-dimensional coordinate of target and the left ear three-dimensional coordinate as axis, cross section is obtained;
It determines and blocks object between first three-dimensional coordinate of target and the left ear three-dimensional coordinate;
Determine that the target mono data is transmitted to the left ear three-dimensional according to the cross section and the object that blocks Multiple reference transmission paths of coordinate;
Determine that the target mono data is transmitted to the left ear three-dimensional coordinate according to the multiple reference transmission path Time and phase pressure.
In a possible example, the target monophonic number is determined according to the multiple reference transmission path described In terms of the time for being transmitted to the left ear three-dimensional coordinate and phase pressure, the instruction in described program 440 is specifically used for executing It operates below:
Determine the corresponding sound intensity of each transmission path and acoustic pressure in the multiple reference transmission path, obtain multiple sound intensitys and Multiple acoustic pressures;
Determine that the target mono data is transmitted to the time of the left ear three-dimensional coordinate, root according to the multiple sound intensity Determine that the target mono data is transmitted to the phase pressure of the left ear three-dimensional coordinate according to the multiple acoustic pressure.
In a possible example, the three of each sound source in the corresponding multi-acoustical of the determining electronic equipment 400 The mono data for tieing up coordinate and the generation of each sound source, in terms of obtaining multiple first three-dimensional coordinates and multiple mono datas, Instruction in described program 440 is specifically used for executing following operation:
Determine the corresponding multiple references object of the electronic equipment 400;
The behavioural information for determining each references object in the multiple references object obtains multiple behavioural informations;
The multiple sound source is chosen from the multiple references object according to the multiple behavioural information;
It determines the corresponding coordinate position of each sound source in the multiple sound source, obtains the multiple first three-dimensional coordinate;
The mono data that the sound source is determined according to the corresponding behavioural information of sound source each in the multiple sound source, obtains institute State multiple mono datas.
In a possible example, the multiple behavioural information includes the corresponding goal behavior information of target sound source;? It is described according to the corresponding behavioural information of sound source each in the multiple sound source determine the sound source mono data obtain it is described more In terms of a mono data, the instruction in described program 440 is specifically used for executing following operation:
Determine the corresponding sound type of the goal behavior information and play parameter;
The mono data of the target sound source is generated according to the sound type and the play parameter.
In a possible example, the instruction in described program 440 is also used to execute following operation:
Determine the corresponding target reverberation parameters of the target object;
The target dual channel data is handled according to the target reverberation parameters, obtains reverberation dual channel data.
The embodiment of the present application also provides a kind of computer storage medium, wherein the computer storage medium is stored for depositing Computer program is stored up, which makes computer execute either record part of method or complete in such as embodiment of the method Portion's step, computer include electronic equipment.
The embodiment of the present application also provides a kind of computer program product, and computer program product includes storing computer journey The non-transient computer readable storage medium of sequence, computer program are operable to execute computer as remembered in embodiment of the method Some or all of either load method step.The computer program product can be a software installation packet, and computer includes Electronic equipment.
It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because According to the application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know It knows, the embodiments described in the specification are all preferred embodiments, related movement and mode not necessarily the application It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed device, it can be by another way It realizes.For example, the apparatus embodiments described above are merely exemplary, such as the division of unit, only a kind of logic Function division, there may be another division manner in actual implementation, such as multiple units or components can combine or can collect At another system is arrived, or some features can be ignored or not executed.Another point, shown or discussed mutual coupling It closes or direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit can be with It is electrical or other forms.
Unit may or may not be physically separated as illustrated by the separation member, shown as a unit Component may or may not be physical unit, it can and it is in one place, or may be distributed over multiple networks On unit.It can some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also be realized in the form of software program mode.
If integrated unit is realized and when sold or used as an independent product in the form of software program mode, can To be stored in a computer-readable access to memory.Based on this understanding, the technical solution of the application is substantially in other words The all or part of the part that contributes to existing technology or the technical solution can embody in the form of software products Come, which is stored in a memory, including some instructions are used so that a computer equipment (can be Personal computer, server or network equipment etc.) execute each embodiment method of the application all or part of the steps.And it is preceding The memory stated includes: USB flash disk, read-only memory (read-only memory, ROM), random access memory (random Access memory, RAM), mobile hard disk, the various media that can store program code such as magnetic or disk.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can It is completed with instructing relevant hardware by program, which can store in a computer-readable memory, memory It may include: flash disk, ROM, RAM, disk or CD etc..
The embodiment of the present application is described in detail above, specific case used herein to the principle of the application and Embodiment is expounded, the description of the example is only used to help understand the method for the present application and its core ideas; At the same time, for those skilled in the art can in specific embodiments and applications according to the thought of the application There is change place, to sum up, the contents of this specification should not be construed as limiting the present application.

Claims (10)

1. a kind of 3D sound effect treatment method characterized by comprising
Determine the monophonic number that the three-dimensional coordinate of each sound source and each sound source generate in the corresponding multi-acoustical of electronic equipment According to obtaining multiple first three-dimensional coordinates and multiple mono datas;
Determine the second three-dimensional coordinate of the corresponding target object of the electronic equipment;
According to the multiple first three-dimensional coordinate and second three-dimensional coordinate, the multiple mono data is synthesized, Obtain target dual channel data.
2. the method according to claim 1, wherein described according to the multiple first three-dimensional coordinate and described Two three-dimensional coordinates synthesize the multiple mono data, obtain target dual channel data, comprising:
Determine the corresponding left ear three-dimensional coordinate of second three-dimensional coordinate and auris dextra three-dimensional coordinate;
The multiple sound is determined according to the multiple first three-dimensional coordinate, the left ear three-dimensional coordinate and the auris dextra three-dimensional coordinate Transmission path between source and the target object obtains multiple transmission paths;
Determine that each mono data is transmitted to the left ear in the multiple mono data according to the multiple transmission path Three-dimensional coordinate, the time of the auris dextra three-dimensional coordinate and phase pressure, obtain multiple times and multiple phase pressures;
The each mono data corresponding time difference in the multiple mono data is determined according to the multiple time, is obtained more A time difference determines the corresponding phase of each mono data in the multiple mono data according to the multiple phase pressure It is poor to obtain multiple phase pressures for pressure difference;
Each monophonic in the multiple mono data is determined according to the multiple time difference and the multiple phase pressure difference The corresponding delay parameter of data, obtains multiple delay parameters;
According to the multiple delay parameter, each mono data in the multiple mono data is handled, is obtained pair The L channel parameter and right channel parameter answered;
According to the corresponding L channel parameter of mono data each in the multiple mono data and right channel parameter, to described Multiple mono datas are synthesized, and the target dual channel data is obtained.
3. according to the method described in claim 2, it is characterized in that, the multiple sound source includes target sound source, the multiple One three-dimensional coordinate includes corresponding the first three-dimensional coordinate of target of the target sound source, and the multiple mono data includes the mesh Mark the corresponding target mono data of sound source;
It is described to determine that each mono data is transmitted to described in the multiple mono data according to the multiple transmission path Left ear three-dimensional coordinate, the time of the auris dextra three-dimensional coordinate and phase pressure, obtain multiple times and multiple phase pressures, packet It includes:
Using first three-dimensional coordinate of target and the left ear three-dimensional coordinate as axis, cross section is obtained;
It determines and blocks object between first three-dimensional coordinate of target and the left ear three-dimensional coordinate;
Determine that the target mono data is transmitted to the left ear three-dimensional coordinate according to the cross section and the object that blocks Multiple reference transmission paths;
According to the multiple reference transmission path determine the target mono data be transmitted to the left ear three-dimensional coordinate when Between and phase pressure.
4. according to the method described in claim 3, it is characterized in that, described according to the determination of the multiple reference transmission path Target mono data is transmitted to time and the phase pressure of the left ear three-dimensional coordinate, comprising:
It determines the corresponding sound intensity of each transmission path and acoustic pressure in the multiple reference transmission path, obtains multiple sound intensitys and multiple Acoustic pressure;
Determine that the target mono data is transmitted to the time of the left ear three-dimensional coordinate according to the multiple sound intensity, according to institute It states multiple acoustic pressures and determines that the target mono data is transmitted to the phase pressure of the left ear three-dimensional coordinate.
5. method according to claim 1-4, which is characterized in that the corresponding multiple sound of the determining electronic equipment The mono data that the three-dimensional coordinate of each sound source and each sound source generate in source obtains multiple first three-dimensional coordinates and more A mono data, comprising:
Determine the corresponding multiple references object of the electronic equipment;
The behavioural information for determining each references object in the multiple references object obtains multiple behavioural informations;
The multiple sound source is chosen from the multiple references object according to the multiple behavioural information;
It determines the corresponding coordinate position of each sound source in the multiple sound source, obtains the multiple first three-dimensional coordinate;
The mono data that the sound source is determined according to the corresponding behavioural information of sound source each in the multiple sound source, obtains described more A mono data.
6. according to the method described in claim 5, it is characterized in that, the multiple behavioural information includes in the multiple sound source The corresponding goal behavior information of target sound source;Described determined according to the corresponding behavioural information of sound source each in the multiple sound source should The mono data of sound source obtains the multiple mono data, comprising:
Determine the corresponding sound type of the goal behavior information and play parameter;
The mono data of the target sound source is generated according to the sound type and the play parameter.
7. method according to claim 1-6, which is characterized in that the method also includes:
Determine the corresponding preference reverberation parameters of the target object;
The target dual channel data is handled according to the preference reverberation parameters, obtains reverberation dual channel data.
8. a kind of 3D sound-effect processing equipment characterized by comprising
Determination unit, for determining the three-dimensional coordinate of each sound source and each sound source in the corresponding multi-acoustical of electronic equipment The mono data of generation obtains multiple first three-dimensional coordinates and multiple mono datas;Determine that the electronic equipment is corresponding Second three-dimensional coordinate of target object;
Synthesis unit is used for according to the multiple first three-dimensional coordinate and second three-dimensional coordinate, to the multiple monophonic Data are synthesized, and target dual channel data is obtained.
9. a kind of electronic equipment, which is characterized in that including processor, memory, communication interface and one or more program, In, one or more of programs are stored in the memory, and are configured to be executed by the processor, described program Include the steps that requiring the instruction in any one of 1-7 method for perform claim.
10. a kind of computer readable storage medium, which is characterized in that it is used to store computer program, wherein the computer Program makes computer execute the method according to claim 1 to 7.
CN201811118269.4A 2018-09-25 2018-09-25 3D sound effect processing method and related product Active CN109246580B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201811118269.4A CN109246580B (en) 2018-09-25 2018-09-25 3D sound effect processing method and related product
PCT/CN2019/090380 WO2020062922A1 (en) 2018-09-25 2019-06-06 Sound effect processing method and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811118269.4A CN109246580B (en) 2018-09-25 2018-09-25 3D sound effect processing method and related product

Publications (2)

Publication Number Publication Date
CN109246580A true CN109246580A (en) 2019-01-18
CN109246580B CN109246580B (en) 2022-02-11

Family

ID=65056811

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811118269.4A Active CN109246580B (en) 2018-09-25 2018-09-25 3D sound effect processing method and related product

Country Status (2)

Country Link
CN (1) CN109246580B (en)
WO (1) WO2020062922A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020063028A1 (en) * 2018-09-25 2020-04-02 Oppo广东移动通信有限公司 3d sound effect processing method and related product
WO2020062922A1 (en) * 2018-09-25 2020-04-02 Oppo广东移动通信有限公司 Sound effect processing method and related product
WO2021197020A1 (en) * 2020-03-31 2021-10-07 北京字节跳动网络技术有限公司 Audio processing method and apparatus, readable medium, and electronic device
CN116389982A (en) * 2023-05-19 2023-07-04 零束科技有限公司 Audio processing method, device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103218198A (en) * 2011-08-12 2013-07-24 索尼电脑娱乐公司 Sound localization for user in motion
CN105159655A (en) * 2014-05-28 2015-12-16 腾讯科技(深圳)有限公司 Playing method and playing device for behavior event
CN106448687A (en) * 2016-09-19 2017-02-22 中科超影(北京)传媒科技有限公司 Audio making and decoding method and device
CN107360494A (en) * 2017-08-03 2017-11-17 北京微视酷科技有限责任公司 A kind of 3D sound effect treatment methods, device, system and sound system
CN107608519A (en) * 2017-09-26 2018-01-19 深圳传音通讯有限公司 A kind of sound method of adjustment and virtual reality device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7928311B2 (en) * 2004-12-01 2011-04-19 Creative Technology Ltd System and method for forming and rendering 3D MIDI messages
CN104869524B (en) * 2014-02-26 2018-02-16 腾讯科技(深圳)有限公司 Sound processing method and device in three-dimensional virtual scene
CN109246580B (en) * 2018-09-25 2022-02-11 Oppo广东移动通信有限公司 3D sound effect processing method and related product

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103218198A (en) * 2011-08-12 2013-07-24 索尼电脑娱乐公司 Sound localization for user in motion
CN105159655A (en) * 2014-05-28 2015-12-16 腾讯科技(深圳)有限公司 Playing method and playing device for behavior event
CN106448687A (en) * 2016-09-19 2017-02-22 中科超影(北京)传媒科技有限公司 Audio making and decoding method and device
CN107360494A (en) * 2017-08-03 2017-11-17 北京微视酷科技有限责任公司 A kind of 3D sound effect treatment methods, device, system and sound system
CN107608519A (en) * 2017-09-26 2018-01-19 深圳传音通讯有限公司 A kind of sound method of adjustment and virtual reality device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020063028A1 (en) * 2018-09-25 2020-04-02 Oppo广东移动通信有限公司 3d sound effect processing method and related product
WO2020062922A1 (en) * 2018-09-25 2020-04-02 Oppo广东移动通信有限公司 Sound effect processing method and related product
WO2021197020A1 (en) * 2020-03-31 2021-10-07 北京字节跳动网络技术有限公司 Audio processing method and apparatus, readable medium, and electronic device
CN116389982A (en) * 2023-05-19 2023-07-04 零束科技有限公司 Audio processing method, device, electronic equipment and storage medium

Also Published As

Publication number Publication date
WO2020062922A1 (en) 2020-04-02
CN109246580B (en) 2022-02-11

Similar Documents

Publication Publication Date Title
CN109246580A (en) 3D sound effect treatment method and Related product
CN102687529B (en) For the method and apparatus processing audio signal
US20160085305A1 (en) Audio computer system for interacting within a virtual reality environment
EP2942980A1 (en) Real-time control of an acoustic environment
CN108597530A (en) Sound reproducing method and device, storage medium and electronic device
CN105955700A (en) Sound effect adjusting method and user terminal
EP3629145B1 (en) Method for processing 3d audio effect and related products
CN108141696A (en) The system and method adjusted for space audio
US9781538B2 (en) Multiuser, geofixed acoustic simulations
CN103999021A (en) Gesture controlled audio user interface
CN109254752A (en) 3D sound effect treatment method and Related product
CN109597481A (en) AR virtual portrait method for drafting, device, mobile terminal and storage medium
CN106033676B (en) Audio play control method and device, electronic equipment
CN108683927A (en) Main broadcaster recommends method, apparatus and storage medium
CN109660911A (en) Recording sound effect treatment method, device, mobile terminal and storage medium
CN109327795A (en) Sound effect treatment method and Related product
CN108319445A (en) A kind of audio frequency playing method and mobile terminal
CN109121069A (en) 3D sound effect treatment method and Related product
CN109104687A (en) Sound effect treatment method and Related product
CN108924705A (en) 3D sound effect treatment method and Related product
CN109327766A (en) 3D sound effect treatment method and Related product
CN109529335A (en) Game role sound effect treatment method, device, mobile terminal and storage medium
CN108827338A (en) Phonetic navigation method and Related product
CN106462382A (en) Multi-sound audio interface system
CN109327794A (en) 3D sound effect treatment method and Related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant