CN109086029A - A kind of audio frequency playing method and VR equipment - Google Patents
A kind of audio frequency playing method and VR equipment Download PDFInfo
- Publication number
- CN109086029A CN109086029A CN201810862521.6A CN201810862521A CN109086029A CN 109086029 A CN109086029 A CN 109086029A CN 201810862521 A CN201810862521 A CN 201810862521A CN 109086029 A CN109086029 A CN 109086029A
- Authority
- CN
- China
- Prior art keywords
- user
- loudspeaker
- equipment
- virtual scene
- relative position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
Abstract
The embodiment of the invention provides a kind of audio frequency playing method and VR equipment, orientation information of this method for acquisition user in the provided virtual scene of VR equipment；Position of the user in virtual scene is obtained, as user location；Using pronunciation sound source position is preset in user location and virtual scene, the relative position between user in virtual scene and default pronunciation source of sound is calculated；Using orientation information and relative position, the angle between user in virtual scene and default pronunciation source of sound is calculated；Depending on the relative position and angle, it controls each loudspeaker and plays the audio that VR equipment generates.VR equipment is enabled to acoustically to bring impression on the spot in person for user using scheme provided in an embodiment of the present invention.
Description
Technical field
The present invention relates to virtual reality technical fields, more particularly to a kind of audio frequency playing method and VR equipment.
Background technique
It can produce the void in 3D (three-dimensional) space using the VR equipment of VR (Virtual Reality, virtual reality) technology
Quasi- scene, provides the simulation of the sense organs such as vision, the sense of hearing, tactile for user, allows user as on the spot in person, can it is timely, do not have
Observe the things in the virtual scene of above-mentioned 3d space in limitation ground.If user carries out position shifting during using VR equipment
Dynamic, position of the user in above-mentioned virtual scene can also change therewith, and in this case, VR equipment carries out complicated fortune
It calculates, shows current location corresponding 3D image of the user in virtual scene to user, user is made to generate telepresenc.Namely
It says, an important feature of VR technology is that the experience of immersion is provided for user, and the experience of this immersion can allow user to make
When with VR equipment, seemingly place oneself in the midst of in virtual scene.
However, existing VR equipment all compares emphasis visual experience, audio experience is ignored, for example, the prior art provides
A kind of wearing earphone the VR helmet, which has the function of spatial audio (space audio), and the VR helmet generates
After spatial audio, needs to play spatial audio by peripheral earphone, user could be made to experience spatial
The effect of audio.Although playing the audio of VR helmet generation by way of peripheral earphone, the structure letter of the VR helmet is enabled to
It is single, but since user needs to wear earphone on ear during using the VR helmet, after such earphone plays audio, sound
Frequency is directly transferred in the ear of user, it is difficult to bring true spatial audio effect for user.Therefore earphone is worn
VR helmet difficulty is acoustically to bring feeling on the spot in person to user.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of audio frequency playing method and VR equipment, so that VR equipment is in the sense of hearing
It is upper to bring impression on the spot in person for user.
In order to achieve the above objectives, the embodiment of the invention discloses a kind of audio frequency playing method, it is applied to that there are multiple loudspeakings
The VR equipment of device, each loudspeaker are located at the different location of the VR equipment, which comprises
Orientation information of the user in the provided virtual scene of VR equipment is provided；
Position of the user in the virtual scene is obtained, as user location；
Using pronunciation sound source position is preset in the user location and the virtual scene, calculate in the virtual scene
Pronunciation sound source position is preset to the relative position of user location；
Using the orientation information and the relative position, calculates the user in the virtual scene and preset towards with described
Angle between pronunciation source of sound；
Depending on that relative position with the angle, controls each loudspeaker and play the audio that the VR equipment generates.
Further, described to utilize the orientation information and the relative position, calculate the user in the virtual scene
Towards the angle between the default pronunciation source of sound, comprising:
According to the orientation information, direction of the user in the virtual scene is obtained；
Using the direction and the relative position, the user in the virtual scene is calculated according to following expression
Towards the angle between the default pronunciation source of sound；
The expression formula are as follows:
A is direction of the user in the virtual scene；a1,a2,a3Respectively the direction of user is in three-dimensional flute
The value of x-axis, y-axis and z-axis under karr coordinate system；B is to preset pronunciation sound source position to the relative position of user location；b1,b2,
b3The difference of respectively default pronunciation sound source position and user location x-axis, y-axis and z-axis under three Cartesian coordinates respectively
Value；θ is angle.
Further, described depending on that relative position with the angle, it controls each loudspeaker and plays the VR equipment
The audio of generation, comprising:
The loudspeaker being located in the default pronunciation sound source position preset range is determined, as playing the VR equipment
The target loudspeaker of produced audio；
Mapping relations based on the relative position and speaker volume, adjust the volume of the target loudspeaker, as
First volume；
Mapping relations based on the angle and speaker volume adjust the first volume of the target loudspeaker, as
Second volume；
It controls the target loudspeaker and the audio is played with the second volume adjusted.
Further, the loudspeaker is uniformly arranged on the different location of the VR equipment in a manner of around user's head
Place.
A kind of VR equipment, the VR equipment include: that shell, multiple loudspeakers, speaker controller, locator and information are adopted
Storage；Wherein, each loudspeaker is located at the different predetermined positions of the shell, the loudspeaker control, locator and information
Collector is respectively positioned in the shell；
The locator obtains position of the user in the virtual scene, as user location, and by the user position
It sets and is sent to the speaker controller；
The information acquisition device, acquires orientation information of the user in the provided virtual scene of VR equipment, and by institute
It states acquisition information and is sent to the speaker controller；
The speaker controller receives the user location and information acquisition device transmission that the locator is sent
The orientation information calculate described and using pronunciation sound source position is preset in the user location and the virtual scene
Pronunciation sound source position is preset in virtual scene to the relative position of user location；Utilize the orientation information and the opposite position
It sets, calculates the angle between user's direction in the virtual scene and the default pronunciation source of sound；Depending on that relative position
With the angle, controls each loudspeaker and play the audio that the VR equipment generates.
Further, described to utilize the orientation information and relative position, calculate user's direction in the virtual scene
With the angle between the default pronunciation source of sound, comprising:
According to the orientation information, direction of the user in the virtual scene is obtained；
Using above-mentioned direction and the relative position, the user in the virtual scene is calculated according to following expression
Towards the angle between the default pronunciation source of sound；
The expression formula are as follows:
A is direction；a1,a2,a3Respectively the direction of user is in the initial position with user in virtual scene
For the value of the x-axis, y-axis and z-axis under the cartesian coordinate system of origin；B is to preset pronunciation sound source position to the opposite of user location
Position；b1,b2,b3Respectively default pronunciation sound source position and user location are respectively in the initial bit with user in virtual scene
It is set to the difference of the x-axis, y-axis and z-axis under the cartesian coordinate system of origin；θ is angle.
Further, described depending on that relative position with the angle, it controls each loudspeaker and plays the VR equipment
The audio of generation, comprising:
The loudspeaker being located in the default pronunciation sound source position preset range is determined, as playing the VR equipment
The target loudspeaker of produced audio；
Mapping relations based on the relative position and speaker volume, adjust the volume of the target loudspeaker, as
First volume；
Mapping relations based on the angle and speaker volume adjust the first volume of the target loudspeaker, as
Second volume；
It controls the target loudspeaker and the audio is played with the second volume adjusted.
Further, the loudspeaker is uniformly arranged on the different location of the VR equipment in a manner of around user's head
Place.
Further, the information acquisition device is gyroscope.
At the another aspect that the present invention is implemented, a kind of computer readable storage medium is additionally provided, it is described computer-readable
Instruction is stored in storage medium, when run on a computer, so that computer executes any of the above-described audio and broadcasts
Put method.
At the another aspect that the present invention is implemented, the embodiment of the invention also provides a kind of, and the computer program comprising instruction is produced
Product, when run on a computer, so that computer executes any of the above-described audio frequency playing method.
A kind of audio frequency playing method provided in an embodiment of the present invention and VR equipment, set applied to the VR with multiple loudspeakers
Standby, each loudspeaker is located at the different location of the VR equipment, and VR equipment obtains user in the provided virtual scene of VR equipment
In orientation information after, obtain position of the user in virtual scene and utilize user location and virtual scene as user location
In preset pronunciation sound source position, calculate in virtual scene preset pronunciation sound source position arrive the relative position of user location, utilization
Orientation information and relative position calculate the angle between user in virtual scene and default pronunciation source of sound, depending on the relative position
And angle, it controls each loudspeaker and plays the audio that the VR equipment generates.As it can be seen that using scheme provided in an embodiment of the present invention
Audio plays in compared with the existing technology and plays audio, relative position and angle using calculating, control bit using peripheral earphone
Each loudspeaker at VR equipment different location plays the audio that VR equipment generates, and can bring really for user
Spatial audio effect enables VR equipment acoustically bringing impression on the spot in person for user.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described.
Fig. 1 is a kind of flow chart of audio frequency playing method provided in an embodiment of the present invention；
Fig. 2 is the schematic diagram that a kind of loudspeaker for being placed in different directions provided in an embodiment of the present invention plays audio；
The flow chart of Fig. 3 second of audio frequency playing method provided in an embodiment of the present invention；
Fig. 4 is a kind of structural schematic diagram of VR equipment provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention is described.
Referring to Fig. 1, Fig. 1 is the flow chart of the first audio frequency playing method provided in an embodiment of the present invention, applied to having
The VR equipment of multiple loudspeakers, each loudspeaker are located at the different predetermined positions of above-mentioned VR equipment, include the following steps:
S101 obtains orientation information of the user in above-mentioned the provided virtual scene of VR equipment；
Wherein, VR equipment can be VR glasses and the VR helmet etc..
In addition, sight is sat in Descartes when orientation information can be understood as user in the provided virtual scene of VR equipment
Mark is lower determining bearing sense information, in cartesian coordinate system around the velocity and acceleration of each reference axis, that is,
It says, orientation information may include direction, which can be understood as using the initial position of user as origin, user's view
The vector of line in cartesian coordinate system, the direction of the vector is from origin to the direction of user's sight.
S102 obtains position of the user in above-mentioned virtual scene, as user location；
It is consistent with user action to the scene changes that perceive user in the virtual scene that VR equipment provides, and
Make the imperceptible delay of user, then VR equipment is needed to perceive the variation of user action in time.Based on the above situation, it needs in real time
Position and movement direction of the user in virtual scene space is determined, so that the void that user's move mode and user's vision are perceived
Quasi- scene is consistent, based on the virtual scene of user's visual perception, along with user from acoustically perception and uses on user location
The audio that the default pronunciation source of sound of family position relative direction plays, be able to use virtual scene that family is visually perceived with
The virtual scene acoustically perceived is consistent, enhances the authenticity of virtual scene.
It should be noted that can first carry out S101 executes S102 again, S102 can also be first carried out and execute S101 again；This hair
Bright embodiment is not defined the execution sequence of S101 and S102.
S103 is calculated using pronunciation sound source position is preset in above-mentioned user location and above-mentioned virtual scene above-mentioned virtual
Above-mentioned default pronunciation sound source position is to the relative position of user location in scene；
This step in above-mentioned virtual scene it is to be understood that pre-set multiple sources of sound, when source of sound set in advance
Reach when being triggered condition, obtains the position of the default pronunciation meaning source in virtual scene.
Since default pronunciation source of sound can be seen as one in the user location that the position of virtual scene and S102 obtain
It is a, therefore when presetting pronunciation sound source position to the relative position of user location in calculating virtual scene, it can be according to two
The difference formula of point coordinate is solved, it should be noted that the relative position is a vector, and the direction of vector is from default hair
Sound sound source position is to the direction of user location.
The above-mentioned default pronunciation source of sound in above-mentioned virtual scene can be quickly and accurately calculated by above-mentioned expression formula
Position to the relative position of user location.
S104, using above-mentioned orientation information and above-mentioned relative position, calculate in above-mentioned virtual scene user with it is above-mentioned pre-
If the angle between the source of sound that pronounces；
Realize that a kind of implementation of S104 can specifically include following steps A-B:
Step A obtains direction of the user in above-mentioned virtual scene according to above-mentioned orientation information；
Based in S101 to the description of orientation information, direction belong to a number of the orientation information of acquisition it is believed that
Breath, the preparation method of direction are as follows: with the initial position origin of user, in cartesian coordinate system, take up an official post from user's sight
It selects a bit, the direction using relative position, that is, coordinate difference of origin to the point as user in above-mentioned virtual scene.
Step B is calculated according to following expression and is used in above-mentioned virtual scene using above-mentioned direction and relative position
Angle between family and above-mentioned default pronunciation source of sound；
Above-mentioned expression formula are as follows:
A is direction of the user in above-mentioned virtual scene；a1,a2,a3Respectively the direction of user is in three-dimensional flute
The value of x-axis, y-axis and z-axis under karr coordinate system；B is to preset pronunciation sound source position to the relative position of user location；b1,b2,
b3The difference of respectively default pronunciation sound source position and user location x-axis, y-axis and z-axis under three Cartesian coordinates respectively
Value；θ is angle.
It should be noted that the dot of above-mentioned three Cartesian coordinates is initial position of the user in virtual scene.
As it can be seen that this implementation can quickly and accurately obtain the value of angle by direction and relative position.
S105 controls each loudspeaker and plays the sound that above-mentioned VR equipment generates according to above-mentioned relative position and above-mentioned angle
Frequently.
The above-mentioned each loudspeaker of control plays the mode for the audio that above-mentioned VR equipment generates, can be by controlling each loudspeaking
The switch of device, the volume of the loudspeaker of each starting of adjustment, which reach, plays the audio that above-mentioned VR equipment generates, and can also only lead to
It crosses and controls the size of each speaker volume and reach and play the audio that above-mentioned VR equipment generates.
A kind of specific embodiment of S105 includes the following steps C-F:
Step C determines the loudspeaker being located in the default pronunciation sound source position preset range, as described for playing
The target loudspeaker of audio produced by VR equipment；
In this step, after determining default pronunciation sound source position, inquiry presets model in default pronunciation sound source position
Enclose the location information of interior all loudspeakers.
For example, determine that default pronunciation sound source position is (2,1,2) in virtual scene；With the default pronunciation source of sound position
It is set to point centered on (2,1,2), is to inquire the location information of all loudspeakers within the scope of this within the scope of 1m in radius, if inquiring
The interior loudspeaker difference location information of the range is the loudspeaker A of (- 2,1,2.3), and location information is the loudspeaking of (2,1,2.2)
Device B；These loudspeaker A inquired and loudspeaker B be exactly it needs to be determined that preset range be 1m in target loudspeaker.
It should be noted that this step can be understood as from each loudspeaker selection, to be located at default pronunciation sound source position pre-
If the loudspeaker in range, the selection of these loudspeakers can be the switch for closing the not loudspeaker in above-mentioned preset range,
It is also possible to the volume of the loudspeaker not in above-mentioned preset range being transferred to 0 degree, is equivalent to the pent state of loudspeaker.
Step D, the mapping relations based on the relative position and speaker volume, adjusts the sound of the target loudspeaker
Amount, as the first volume；
It should be noted that setting the volume of each loudspeaker as 0~M, wherein the value of M is determined according to practical experience
Maximum value, the size of M value and above-mentioned relative position are in mapping relations, the remoter source of sound in relative position, loudspeaking in virtual scene
The volume of device is smaller, conversely, the source of sound that relative position is closer, the volume of loudspeaker is bigger.
In this step, depending on the relative position with the mapping relations of speaker volume, according to the relative position of acquisition,
With the volume of the above-mentioned target loudspeaker of determination, volume of the volume of target loudspeaker to after determining is adjusted.
Step E, the mapping relations based on the angle and speaker volume adjust the first sound of the target loudspeaker
Amount, as the second volume；
It should be noted that setting the volume of each loudspeaker as 0~M, wherein the value of M is determined according to practical experience
Maximum value, the size of M value adjusts the folder according to the value of above-mentioned angle in mapping relations with above-mentioned angle in virtual scene
The volume of the corresponding each target loudspeaker in angle.
It in this step, can be to each mesh according to the angle of acquisition according to the mapping relations of angle and speaker volume
Corresponding first volume of mark loudspeaker is adjusted, and obtains the second volume of each target loudspeaker.
Step F controls the target loudspeaker with the second volume adjusted and plays the audio.
In this step, above-mentioned target loudspeaker is controlled to play above-mentioned audio, the target according to step E volume adjusted
The sounding of loudspeaker allow users to feel the opposite user side's parallactic angle i.e. angle, the opposite user relative position it is above-mentioned
Default sound source of sound is sent out in sounding, makes user as on the spot in person.
As it can be seen that this implementation determines target loudspeaker by angle from identified loudspeaker, relative position is utilized
With the mapping relations of loudspeaker, the first volume of determining target loudspeaker is adjusted, using the mapping relations of angle and loudspeaker,
The second volume for adjusting the first volume of target loudspeaker, and controlling target loudspeaker to adjust plays above-mentioned hair and presets sound sound
Source, so that VR equipment can acoustically bring impression on the spot in person for user.
For example, if presetting pronunciation sound source position to the relative position of user location is 0.5m, pronunciation meaning source is preset
There are 3 loudspeakers within the scope of 1m, respectively the first loudspeaker, the second loudspeaker and third loudspeaker, this 3 loudspeakers are as mesh
Marking loudspeaker, it is believed that the loudspeaker outside the 1m range in default pronunciation meaning source, user can't hear default pronunciation source of sound sounding,
If depending on the relative position with the mapping relations of speaker volume, obtain relative position be 0.5m when, 10 decibels of speaker volume,
The volume of each target loudspeaker is adjusted as the first volume, i.e. the first volume is 10 decibels, if subscriber station is in relative position
Direction when for 0.5m is right front, i.e., angle is 30 degree, is closed according to 30 degree of angle and the mapping of each target loudspeaker
When system such as angle is 30 degree, the first loudspeaker is 20 decibels, and the second loudspeaker is 30 decibels, and third loudspeaker is 40 decibels；Then
First volume of each target loudspeaker respectively corresponds by 10 decibels to adjust to the first loudspeaker be 20 decibels, the second loudspeaker
It is 30 decibels, third loudspeaker is 40 decibels；If direction of the subscriber station when relative position is 0.5m is left front, i.e.,
Angle is -30 degree, according to -30 degree and the mapping relations of each target loudspeaker, as angle be -30 spend when, the first loudspeaker is
40 decibels, the second loudspeaker is 30 decibels, and third loudspeaker is 20 decibels；Then each target loudspeaker correspondence is separately adjusted to angularly
First loudspeaker is 40 decibels, and the second loudspeaker is 30 decibels, and third loudspeaker is 20 decibels.
Each loudspeaker provided in an embodiment of the present invention is located at the different predetermined positions of above-mentioned VR equipment, in a kind of realization
In mode:, above-mentioned loudspeaker is uniformly arranged at the different location of above-mentioned VR equipment in a manner of around user's head.Such as Fig. 2 institute
Show, Fig. 2 shows, when loudspeaker is arranged in the different location of VR equipment, user listens in VR equipment in a manner of around user's head
The played audio of each loudspeaker schematic diagram.
Ideally, in order to enable loudspeaker to simulate true virtual scene, then what spherical coordinate was fastened appoints
Angle of anticipating should all be equipped with a loudspeaker, and in a practical situation, the case where above-mentioned all angles are equipped with loudspeaker is
Can not be existing, but can centered on user location point, be based on spheric coordinate system, it is uniform according to the interval angles of setting
Place loudspeaker；These loudspeakers placed are placed on the interval angles of each setting in a manner of around user's head, so that
The each loudspeaker for being arranged in user's head surrounding can play out source of sound true to nature in virtual scene.
It can be seen that the present invention implements the audio frequency playing method of offer by utilizing default pronunciation sound source position and acquisition
User location calculates above-mentioned relative position, using above-mentioned relative position and orientation information, calculates angle, and then utilize calculating
Relative position and angle control each loudspeaker and play the audio that above-mentioned VR equipment generates, compared with the prior art in by external
Earphone plays audio, implements the audio frequency playing method provided control loudspeaker using the present invention and pronounces, can bring very for user
Real spatial audio effect, so that VR equipment can acoustically bring impression on the spot in person for user.
Referring to Fig. 3, the embodiment of the invention provides the flow charts of second of audio frequency playing method, raise applied to multiple
The VR equipment of sound device, each loudspeaker are located at the different location of above-mentioned VR equipment, include the following steps:
S201 obtains orientation information of the user in above-mentioned the provided virtual scene of VR equipment；
S202 obtains position of the user in above-mentioned virtual scene, as user location；
S203 is calculated using pronunciation sound source position is preset in above-mentioned user location and above-mentioned virtual scene above-mentioned virtual
Above-mentioned default pronunciation sound source position is to the relative position of user location in scene；
S204, using above-mentioned orientation information and above-mentioned relative position, calculate in above-mentioned virtual scene user with it is above-mentioned pre-
If the angle between the source of sound that pronounces；
Wherein, S201~S204 is identical as the method that step S101~S104 in Fig. 1 embodiment is executed respectively.Therefore,
The implementation that embodiment illustrated in fig. 1 part refers to is adapted to the correlation step that embodiment illustrated in fig. 3 is related to, and can reach
The same or similar beneficial effect, details are not described herein.
S205 determines the loudspeaker being located in above-mentioned default pronunciation sound source position preset range, as above-mentioned for playing
The target loudspeaker of audio produced by VR equipment；
S206, the mapping relations based on above-mentioned relative position and speaker volume, adjusts the volume of above-mentioned target loudspeaker,
As the first volume；
S207, the mapping relations based on above-mentioned angle and speaker volume adjust the first volume of above-mentioned target loudspeaker,
As the second volume；
S208 controls above-mentioned target loudspeaker with the second volume adjusted and plays above-mentioned audio.
It can be seen that method provided in an embodiment of the present invention passes through the user position using default pronunciation sound source position and acquisition
It sets, calculates above-mentioned relative position, using above-mentioned relative position and orientation information, calculate angle, target loudspeaking is determined by angle
Device adjusts the volume of determining target loudspeaker as the first volume, and benefit using the mapping relations of relative position and loudspeaker
With the mapping relations of angle and loudspeaker, the first volume of each target loudspeaker is adjusted as the second volume, and controls target
Loudspeaker plays above-mentioned hair with determining the second volume and presets sound source of sound, compared with the prior art in sound played by peripheral earphone
Frequently, benefit control loudspeaker pronunciation with the aforedescribed process, keeps the pronunciation of loudspeaker more life-like, so that VR equipment can be in the sense of hearing
It is upper to bring impression on the spot in person for user.
Referring to fig. 4, the embodiment of the invention provides a kind of structural schematic diagrams of VR equipment, and above-mentioned VR equipment includes: shell
301, multiple loudspeakers 302, locator 303 and information acquisition device 304 and speaker controller 305；Wherein, each loudspeaker position
At the different location of above-mentioned shell 301, above-mentioned loudspeaker control 305, locator 303 and information acquisition device 304 are respectively positioned on
It states in shell 301；
Above-mentioned locator 303 obtains position of the user in above-mentioned virtual scene, as user location, and by above-mentioned use
Family position is sent to above-mentioned speaker controller 305；
Above- mentioned information collector 304 acquires orientation information of the user in above-mentioned the provided virtual scene of VR equipment, and will
Above-mentioned acquisition information is sent to above-mentioned speaker controller 305；
Above-mentioned speaker controller 305 receives above-mentioned user location and above- mentioned information acquisition that above-mentioned locator 303 is sent
The above-mentioned orientation information that device 304 is sent, and using pronunciation sound source position is preset in above-mentioned user location and above-mentioned virtual scene, it counts
Above-mentioned default pronunciation sound source position is calculated in above-mentioned virtual scene to the relative position of user location；Using above-mentioned orientation information and
Above-mentioned relative position calculates the angle between user in above-mentioned virtual scene and above-mentioned default pronunciation source of sound；According to above-mentioned phase
To position and above-mentioned angle, controls each loudspeaker and play the audio that above-mentioned VR equipment generates.
Wherein, information acquisition device 304 can be gyroscope, be believed using position of the gyroscope acquisition user in virtual scene
Breath.
The working principle of VR equipment are as follows: on the one hand, above-mentioned locator 303 obtains position of the user in above-mentioned virtual scene
That is user location, and above-mentioned user location is sent in above-mentioned speaker controller 305；On the other hand, information acquisition device 304
Orientation information of the user in above-mentioned the provided virtual scene of VR equipment is provided, and above-mentioned acquisition information is sent to above-mentioned loudspeaking
In device controller 305；Above-mentioned speaker controller 305 receives the above-mentioned user location and above-mentioned letter that above-mentioned locator 303 is sent
The above-mentioned orientation information that collector 304 is sent is ceased, and utilizes pronunciation source of sound default in above-mentioned user location and above-mentioned virtual scene
Position calculates in above-mentioned virtual scene above-mentioned default pronunciation sound source position to the relative position of user location；Utilize above-mentioned court
To information and relative position, the angle between user in above-mentioned virtual scene and above-mentioned default pronunciation source of sound is calculated；According to upper
Relative position and angle are stated, each loudspeaker is controlled and plays the audio that above-mentioned VR equipment generates, brought really for user
Spatial audio effect.
It can be seen that VR equipment provided in an embodiment of the present invention passes through the user using default pronunciation sound source position and acquisition
Position calculates above-mentioned relative position, using above-mentioned relative position and orientation information, calculates angle, and then opposite using what is calculated
Position and angle control each loudspeaker and play the audio that above-mentioned VR equipment generates, and can bring true spatial for user
Audio effect, so that VR equipment can acoustically bring impression on the spot in person for user.
In one implementation, above-mentioned to utilize above-mentioned orientation information and relative position, it calculates in above-mentioned virtual scene
Angle between user and above-mentioned default pronunciation source of sound, comprising:
According to the orientation information, direction of the user in the virtual scene is obtained；
Using above-mentioned direction and relative position, user's direction in the virtual scene is calculated according to following expression
With the angle between the default pronunciation source of sound；
The expression formula are as follows:
A is direction of the user in above-mentioned virtual scene；a1,a2,a3Respectively the direction of user is in three-dimensional flute
The value of x-axis, y-axis and z-axis under karr coordinate system；B is to preset pronunciation sound source position to the relative position of user location；b1,b2,
b3The difference of respectively default pronunciation sound source position and user location x-axis, y-axis and z-axis under three Cartesian coordinates respectively
Value；θ is angle.
In one implementation, above-mentioned according to above-mentioned relative position and angle, it controls each loudspeaker and plays above-mentioned VR
The audio that equipment generates, comprising:
The loudspeaker being located in the default pronunciation sound source position preset range is determined, as playing the VR equipment
The target loudspeaker of produced audio；
Mapping relations based on the relative position and speaker volume, adjust the volume of the target loudspeaker, as
First volume；
Mapping relations based on the angle and speaker volume adjust the first volume of the target loudspeaker, as
Second volume；
It controls the target loudspeaker and the audio is played with the second volume adjusted.
In one implementation, above-mentioned loudspeaker is uniformly arranged on above-mentioned VR equipment not in a manner of around user's head
At position.
In one implementation, above- mentioned information collector can be gyroscope.
Based on the above-mentioned description to VR equipment, above-mentioned VR equipment can be a kind of VR helmet；Now with VR equipment for the VR helmet
Citing, above-mentioned shell are helmet shell, and each loudspeaker is evenly arranged in above-mentioned helmet shell, can be on above-mentioned helmet shell
Multiple air holes are provided with, can breathe freely but also mitigate the weight of the helmet, for sound insulation, the outer surface of helmet shell be can be set
There is puigging, to prevent from bothering people around, in order to obtain preferable audio frequency effect, the edge of above-mentioned helmet shell entrance
Be provided with pressure pad, above-mentioned pressure pad can by inflate with corresponding neck seal.In order to make user be better able to be immersed in
The virtual scene that VR equipment provides, often user can have on the VR helmet and be sitting on VR seat, while experience vision, the sense of hearing, tactile
Bring feeling on the spot in person, in order to slow down VR seat bring impact force, the corresponding account of the inner surface of above-mentioned helmet shell
Cushion has can be set in the position on top, and above-mentioned cushion can be foam-rubber cushion.
Since user's head is immersed in the helmet for a long time, the temperature in the helmet can be higher and higher, and not only user experience is not
It is good, and it is easy to seriously affect the service life of electronic component in the helmet, it for these reasons, can be according to following three
Implementation solves the above problems.
The first implementation, the above-mentioned VR helmet can also include temperature controller, and above-mentioned temperature controller is fixedly mounted on above-mentioned head
On helmet inner surface of outer cover；The temperature of the above-mentioned above-mentioned interior of shell of temperature controller real-time testing, when above-mentioned temperature reaches preset threshold,
Start the refrigerating function of above-mentioned temperature controller；
When above-mentioned temperature is lower than above-mentioned preset threshold, stop the refrigerating function of above-mentioned temperature controller.
As it can be seen that above-mentioned implementation is not only brought by the temperature being arranged in the temperature controller reduction helmet in helmet shell
Good user experience, and the service life of electronic component in the VR helmet is also extended relatively.
Second of implementation, the above-mentioned VR helmet can also include temperature controller, above-mentioned temperature controller and above system controller
Connection, and be fixedly mounted on above-mentioned helmet shell inner surface；
Temperature inside the above-mentioned above-mentioned helmet shell of temperature controller real-time testing, and above-mentioned system is sent by the temperature tested
It unites in controller, when the temperature that above system controller obtains reaches preset threshold, starts the refrigerating function of above-mentioned temperature controller；
When the temperature that above system controller obtains is lower than above-mentioned preset threshold, stop the refrigeration function of above-mentioned temperature controller
Energy.
As it can be seen that above-mentioned implementation controls temperature controller unlatching by system controller and stops refrigerating function, to reduce head
Temperature in helmet shell not only brings good user experience, but also also extends making for electronic component in the VR helmet relatively
Use the service life.
The third implementation, the above-mentioned helmet further include fan, and said fans are connect with above system controller, and fixed
It is mounted on above-mentioned inner surface of outer cover；
When the temperature of the above-mentioned interior of shell of above system controller test reaches preset threshold, start fan running；
When the temperature of the above-mentioned interior of shell of above system controller test is lower than preset threshold, stop fan running.
It is rotated as it can be seen that fan is opened by system controller and stopped to above-mentioned implementation, the setting of fan both structure letters
It is single to replace again conveniently, while the temperature reduced in helmet shell can be reached, good user experience is not only brought, but also opposite
Also the service life of electronic component in the VR helmet is extended.
In another embodiment provided by the invention, a kind of computer readable storage medium is additionally provided, which can
It reads to be stored with instruction in storage medium, when run on a computer, so that computer executes on any in above-described embodiment
The audio frequency playing method stated.
In another embodiment provided by the invention, a kind of computer program product comprising instruction is additionally provided, when it
When running on computers, so that computer executes any above-mentioned audio frequency playing method in above-described embodiment.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program
Product includes one or more computer instructions.When loading on computers and executing the computer program instructions, all or
It partly generates according to process or function described in the embodiment of the present invention.The computer can be general purpose computer, dedicated meter
Calculation machine, computer network or other programmable devices.The computer instruction can store in computer readable storage medium
In, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computer
Instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center
User's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or
Data center is transmitted.The computer readable storage medium can be any usable medium that computer can access or
It is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be with
It is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk
Solid State Disk (SSD)) etc..
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device,
For electronic equipment or storage medium embodiment, since it is substantially similar to the method embodiment, so being described relatively simple, phase
Place is closed to illustrate referring to the part of embodiment of the method.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (9)
1. a kind of audio frequency playing method, which is characterized in that applied to the VR equipment with multiple loudspeakers, each loudspeaker is located at
At the different location of the VR equipment, which comprises
Orientation information of the user in the provided virtual scene of VR equipment is provided；
Position of the user in the virtual scene is obtained, as user location；
Using pronunciation sound source position is preset in the user location and the virtual scene, calculates and preset in the virtual scene
Sound source position pronounce to the relative position of user location；
Using the orientation information and the relative position, user's direction and the default pronunciation in the virtual scene are calculated
Angle between source of sound；
Depending on that relative position with the angle, controls each loudspeaker and play the audio that the VR equipment generates.
2. the method as described in claim 1, which is characterized in that described to utilize the orientation information and the relative position, meter
Calculate the angle between user's direction in the virtual scene and the default pronunciation source of sound, comprising:
According to the orientation information, direction of the user in the virtual scene is obtained；
Using the direction and the relative position, user's direction in the virtual scene is calculated according to following expression
With the angle between the default pronunciation source of sound；
The expression formula are as follows:
A is direction of the user in the virtual scene；a1,a2,a3Respectively the direction of user is in three-dimensional cartesian
The value of x-axis, y-axis and z-axis under coordinate system；B is to preset pronunciation sound source position to the relative position of user location；b1,b2,b3Point
The difference of pronunciation sound source position and user location x-axis, y-axis and z-axis under three Cartesian coordinates respectively Wei not preset；θ
For angle.
3. the method as described in claim 1, which is characterized in that described depending on that relative position with the angle, control is respectively
A loudspeaker plays the audio that the VR equipment generates, comprising:
It determines the loudspeaker being located in the default pronunciation sound source position preset range, is produced as playing the VR equipment
The target loudspeaker of raw audio；
Mapping relations based on the relative position and speaker volume, adjust the volume of the target loudspeaker, as first
Volume；
Mapping relations based on the angle and speaker volume adjust the first volume of the target loudspeaker, as second
Volume；
It controls the target loudspeaker and the audio is played with the second volume adjusted.
4. method according to any one of claims 1 to 3, which is characterized in that the loudspeaker is to surround user's head side
Formula is uniformly arranged at the different location of the VR equipment.
5. a kind of VR equipment, which is characterized in that the VR equipment includes: shell, multiple loudspeakers, speaker controller, positioning
Device and information acquisition device；Wherein, each loudspeaker is located at the different predetermined positions of the shell, and the loudspeaker control is determined
Position device and information acquisition device are respectively positioned in the shell；
The locator obtains position of the user in the virtual scene, sends out as user location, and by the user location
It send to the speaker controller；
The information acquisition device acquires orientation information of the user in the provided virtual scene of VR equipment, and adopts described
Collection information is sent to the speaker controller；
The speaker controller receives the user location that the locator is sent and the institute that the information acquisition device is sent
Orientation information is stated, and using pronunciation sound source position is preset in the user location and the virtual scene, is calculated described virtual
Pronunciation sound source position is preset in scene to the relative position of user location；Utilize the orientation information and the relative position, meter
Calculate the angle between user's direction in the virtual scene and the default pronunciation source of sound；Depending on that relative position with it is described
Angle controls each loudspeaker and plays the audio that the VR equipment generates.
6. equipment as claimed in claim 5, which is characterized in that it is described to utilize the orientation information and relative position, it calculates
Angle in the virtual scene between user's direction and the default pronunciation source of sound, comprising:
According to the orientation information, direction of the user in the virtual scene is obtained；
Using above-mentioned direction and the relative position, user's direction in the virtual scene is calculated according to following expression
With the angle between the default pronunciation source of sound；
The expression formula are as follows:
A is direction；a1,a2,a3Respectively the direction of user is being original with initial position of the user in virtual scene
The value of x-axis, y-axis and z-axis under the cartesian coordinate system of point；B is to preset pronunciation sound source position to the relative position of user location；
b1,b2,b3Respectively default pronunciation sound source position and user location are being respectively original with initial position of the user in virtual scene
The difference of x-axis, y-axis and z-axis under the cartesian coordinate system of point；θ is angle.
7. equipment as claimed in claim 5, which is characterized in that described depending on that relative position with the angle, control is respectively
A loudspeaker plays the audio that the VR equipment generates, comprising:
It determines the loudspeaker being located in the default pronunciation sound source position preset range, is produced as playing the VR equipment
The target loudspeaker of raw audio；
Mapping relations based on the relative position and speaker volume, adjust the volume of the target loudspeaker, as first
Volume；
Mapping relations based on the angle and speaker volume adjust the first volume of the target loudspeaker, as second
Volume；
It controls the target loudspeaker and the audio is played with the second volume adjusted.
8. the equipment as described in any one of claim 5~7, which is characterized in that the loudspeaker is to surround user's head side
Formula is uniformly arranged at the different location of the VR equipment.
9. equipment as claimed in claim 8, which is characterized in that the information acquisition device is gyroscope.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810862521.6A CN109086029B (en) | 2018-08-01 | 2018-08-01 | Audio playing method and VR equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810862521.6A CN109086029B (en) | 2018-08-01 | 2018-08-01 | Audio playing method and VR equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109086029A true CN109086029A (en) | 2018-12-25 |
| CN109086029B CN109086029B (en) | 2021-10-26 |
Family
ID=64833261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810862521.6A Active CN109086029B (en) | 2018-08-01 | 2018-08-01 | Audio playing method and VR equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109086029B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110270094A (en) * | 2019-07-17 | 2019-09-24 | 珠海天燕科技有限公司 | A kind of method and device of game sound intermediate frequency control |
| CN110371051A (en) * | 2019-07-22 | 2019-10-25 | 广州小鹏汽车科技有限公司 | A kind of prompt tone playing method and device of car entertainment |
| CN112492097A (en) * | 2020-11-26 | 2021-03-12 | 广州酷狗计算机科技有限公司 | Audio playing method, device, terminal and computer readable storage medium |
| CN112882568A (en) * | 2021-01-27 | 2021-06-01 | 深圳市慧鲤科技有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN114020235A (en) * | 2021-09-29 | 2022-02-08 | 北京城市网邻信息技术有限公司 | Audio processing method in real scene space, electronic terminal and storage medium |
| WO2022068640A1 (en) * | 2020-09-29 | 2022-04-07 | 上海连尚网络科技有限公司 | Method and device for broadcasting voice information in multi-user voice call |
| WO2022127747A1 (en) * | 2020-12-14 | 2022-06-23 | 郑州大学综合设计研究院有限公司 | Method and system for real social using virtual scene |
| WO2024088135A1 (en) * | 2022-10-27 | 2024-05-02 | 安克创新科技股份有限公司 | Audio processing method, audio playback device, and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105607735A (en) * | 2015-12-17 | 2016-05-25 | 深圳Tcl数字技术有限公司 | Output controlling system and method of multimedia equipment |
| KR101683385B1 (en) * | 2015-06-26 | 2016-12-07 | 동서대학교산학협력단 | 360 VR 360 due diligence stereo recording and playback method applied to the VR experience space |
| CN107168518A (en) * | 2017-04-05 | 2017-09-15 | 北京小鸟看看科技有限公司 | A kind of synchronous method, device and head-mounted display for head-mounted display |
| CN107360494A (en) * | 2017-08-03 | 2017-11-17 | 北京微视酷科技有限责任公司 | A kind of 3D sound effect treatment methods, device, system and sound system |
| CN107367839A (en) * | 2016-05-11 | 2017-11-21 | 宏达国际电子股份有限公司 | Wearable electronic installation, virtual reality system and control method |
-
2018
- 2018-08-01 CN CN201810862521.6A patent/CN109086029B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101683385B1 (en) * | 2015-06-26 | 2016-12-07 | 동서대학교산학협력단 | 360 VR 360 due diligence stereo recording and playback method applied to the VR experience space |
| CN105607735A (en) * | 2015-12-17 | 2016-05-25 | 深圳Tcl数字技术有限公司 | Output controlling system and method of multimedia equipment |
| CN107367839A (en) * | 2016-05-11 | 2017-11-21 | 宏达国际电子股份有限公司 | Wearable electronic installation, virtual reality system and control method |
| CN107168518A (en) * | 2017-04-05 | 2017-09-15 | 北京小鸟看看科技有限公司 | A kind of synchronous method, device and head-mounted display for head-mounted display |
| CN107360494A (en) * | 2017-08-03 | 2017-11-17 | 北京微视酷科技有限责任公司 | A kind of 3D sound effect treatment methods, device, system and sound system |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110270094A (en) * | 2019-07-17 | 2019-09-24 | 珠海天燕科技有限公司 | A kind of method and device of game sound intermediate frequency control |
| CN110371051A (en) * | 2019-07-22 | 2019-10-25 | 广州小鹏汽车科技有限公司 | A kind of prompt tone playing method and device of car entertainment |
| CN110371051B (en) * | 2019-07-22 | 2021-06-04 | 广州小鹏汽车科技有限公司 | Prompt tone playing method and device for vehicle-mounted entertainment |
| WO2022068640A1 (en) * | 2020-09-29 | 2022-04-07 | 上海连尚网络科技有限公司 | Method and device for broadcasting voice information in multi-user voice call |
| CN112492097A (en) * | 2020-11-26 | 2021-03-12 | 广州酷狗计算机科技有限公司 | Audio playing method, device, terminal and computer readable storage medium |
| CN112492097B (en) * | 2020-11-26 | 2022-01-11 | 广州酷狗计算机科技有限公司 | Audio playing method, device, terminal and computer readable storage medium |
| WO2022127747A1 (en) * | 2020-12-14 | 2022-06-23 | 郑州大学综合设计研究院有限公司 | Method and system for real social using virtual scene |
| CN112882568A (en) * | 2021-01-27 | 2021-06-01 | 深圳市慧鲤科技有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN114020235A (en) * | 2021-09-29 | 2022-02-08 | 北京城市网邻信息技术有限公司 | Audio processing method in real scene space, electronic terminal and storage medium |
| CN114020235B (en) * | 2021-09-29 | 2022-06-17 | 北京城市网邻信息技术有限公司 | Audio processing method in live-action space, electronic terminal and storage medium |
| WO2024088135A1 (en) * | 2022-10-27 | 2024-05-02 | 安克创新科技股份有限公司 | Audio processing method, audio playback device, and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109086029B (en) | 2021-10-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109086029A (en) | A kind of audio frequency playing method and VR equipment | |
| JP6017664B1 (en) | Information processing method and information processing program | |
| CN104243779B (en) | Directive property control system and sound output control method | |
| JPWO2017043400A1 (en) | Information processing apparatus, method, and computer program | |
| JP2019527956A (en) | Virtual, augmented, and mixed reality | |
| CN106997238A (en) | For changing the programmable tactile apparatus and method that haptic effect is disturbed with compensating audio tactile | |
| CN105101027A (en) | Real-time Control Of An Acoustic Environment | |
| JP2018511212A (en) | System and method for improving hearing | |
| CN105979441A (en) | Customized optimization method for 3D sound effect headphone reproduction | |
| CN109257682A (en) | Pickup adjusting method, controlling terminal and computer readable storage medium | |
| CN106029184B (en) | Stereophonic virtual golf analogy method and method on meteorology is provided | |
| CN106303832A (en) | Speaker and the raising method of directivity, headset equipment and method | |
| CN109426343A (en) | Cooperation training method and system based on virtual reality | |
| CN108668024A (en) | A kind of method of speech processing and terminal | |
| TWI818272B (en) | Method of manufacturing a torso form and method for testing a level of support provided by a support garment | |
| US20200133009A1 (en) | Head-mountable apparatus, systems and methods | |
| US20240078991A1 (en) | Acoustic devices and methods for determining transfer functions thereof | |
| JP2010122369A (en) | Voice reproduction device | |
| CN106302974A (en) | A kind of method of information processing and electronic equipment | |
| CN110741657B (en) | Method for determining a distance between ears of a wearer of a sound generating object and ear-worn sound generating object | |
| US11314082B2 (en) | Motion signal generation | |
| US11641551B2 (en) | Bone conduction speaker and compound vibration device thereof | |
| CN207780373U (en) | A kind of Novel portable VR equipment | |
| WO2019174442A1 (en) | Adapterization equipment, voice output method, device, storage medium and electronic device | |
| CN102196332B (en) | Sound field localization method, remote control and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |