CN107632703A - Mixed reality audio control method and service equipment based on binocular camera - Google Patents
Mixed reality audio control method and service equipment based on binocular camera Download PDFInfo
- Publication number
- CN107632703A CN107632703A CN201710781257.9A CN201710781257A CN107632703A CN 107632703 A CN107632703 A CN 107632703A CN 201710781257 A CN201710781257 A CN 201710781257A CN 107632703 A CN107632703 A CN 107632703A
- Authority
- CN
- China
- Prior art keywords
- virtual
- heads
- location
- aobvious
- sound source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
A kind of mixed reality audio control method and service equipment, this method based on binocular camera include：The scene that the binocular camera shown according to MR heads gathers, determines that the MR heads show the physical location in real space；The physical location is mapped into Virtual Space, virtual location corresponding to acquisition；The angular speed when MR heads are aobvious to be rotated is obtained, the view directions of the aobvious wearer of the MR heads are determined according to the angular speed；According to known location, the virtual location and the view directions of any virtual sound source in the Virtual Space, audio signal corresponding to the virtual sound source is calculated from the output time delay and the output acoustic pressure of each sound channel during the different sound channels output of audio-frequence player device；According to the output time delay and the output acoustic pressure, the audio signal is exported to the audio-frequence player device from each sound channel respectively, the matching degree between the audio signal of virtual sound source and customer location can be improved.
Description
Technical field
The present invention relates to audio frequency control technical field, and in particular to a kind of mixed reality audio control based on binocular camera
Method processed and service equipment.
Background technology
With mixed reality technology (Mixed Reality, abbreviation MR) development, user is for mixed reality feeling of immersion
It is required that more and more higher, most of mixed reality technology can visually provide the user feeling of immersion, such as in real picture
Middle superposition digital picture, or allow user to see that dummy object and user carry out interaction, so as to break real space and virtual sky
Between between boundary.But a ring indispensable during the processing of the sense of hearing and raising feeling of immersion, however, current
Mixed reality situation under, do not associated between sound and customer location that any virtual sound source is sent, when user's head move
When, the relative position between user's head and virtual sound source will not change, therefore audio corresponding to virtual sound source is believed
Number it will not be adjusted in real time with the change of customer location.
The content of the invention
The embodiment of the invention discloses a kind of mixed reality audio control method and service equipment based on binocular camera,
The matching degree between the audio signal of virtual sound source and customer location can be improved.
First aspect of the embodiment of the present invention discloses a kind of mixed reality audio control method based on binocular camera, described
Method includes：The scene within the vision that the binocular camera to be worked according to the aobvious simulation human eye of MR heads collects, it is determined that described
MR heads show the physical location in real space；
According to the mapping relations between real space and Virtual Space, determine the aobvious physical location of the MR heads in institute
State corresponding virtual location in Virtual Space；
The angular speed when MR heads are aobvious to be rotated is obtained, and determines the aobvious wearer's of the MR heads according to the angular speed
View directions；
According to the aobvious virtual location of known location of any virtual sound source in the Virtual Space, the MR heads,
And the view directions, calculate the audio that the wearer that audio signal corresponding to the virtual sound source shows from the MR heads wears
During each sound channel output of playback equipment, each sound channel in the output time delay and each sound channel between each sound channel
Output acoustic pressure；
According to the output time delay between each sound channel and the output acoustic pressure of each sound channel, the audio is believed
Exported number respectively from each sound channel to the audio-frequence player device.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described according to any virtual sound source
The aobvious virtual location of known location, the MR heads in the Virtual Space and the view directions, described in calculating
During each sound channel output for the audio-frequence player device that audio signal corresponding to virtual sound source is worn from the wearer that the MR heads show,
The output acoustic pressure of each sound channel in output time delay and each sound channel between each sound channel, including：
According to the virtual bit that known location of any virtual sound source in the Virtual Space and the MR heads are aobvious
Put, calculate the virtual sound source and the MR heads it is aobvious between relative distance；
According to known location of the virtual sound source in the Virtual Space and the view directions, calculate described
The relative bearing that virtual sound source shows with the MR heads；
According to the relative distance and the relative bearing, audio signal corresponding to the virtual sound source is calculated from the MR
During each sound channel output for the audio-frequence player device that the aobvious wearer of head wears, output time delay between each sound channel and
The output acoustic pressure of each sound channel in each sound channel.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described according to the aobvious simulation people of MR heads
The scene within the vision that the binocular camera of eye work collects, determines that the MR heads show the physical bit in real space
Put, including：
Obtain the scene within the vision that the binocular camera of the aobvious simulation human eye work of MR heads collects；
Identify that each described location feature point is known in real space in multiple location feature points of the scene
Position, the quantity of the multiple location feature point is at least three；
According to each depth of field degree of the location feature point in the scene, determine that the MR heads show and each institute
State the relative position between location feature point；
According to known location of each described location feature point in real space, the MR heads it is aobvious with it is the multiple fixed
Relative position between the characteristic point of position, determines that the MR heads show the physical location in real space.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is characterised in that methods described is also
Including：
Judge the virtual location whether in the designated area, the designated area centered on the virtual sound source,
Using default minimum range as radius；
If it is, directly audio signal corresponding to the virtual sound source is exported to the audio-frequence player device.
As an alternative embodiment, in first aspect of the embodiment of the present invention, methods described also includes：
If the virtual location is not in designated area, judge whether the virtual sound source is system manager,
The system manager is used to issue information of voice prompt；
If it is, judge to whether there is other Virtual Sounds with the system manager while sounding in the Virtual Space
Source；
If it does, improve the output acoustic pressure of audio signal corresponding to the system manager until higher than it is described its
The output acoustic pressure of each audio signal corresponding to virtual sound source in his virtual sound source, and according to the output sound after raising
Pressure exports audio signal corresponding to the system manager to the audio-frequence player device.
Second aspect of the embodiment of the present invention discloses a kind of service equipment, including：
First determining unit, the binocular camera for being worked according to the aobvious simulation human eye of MR heads collect within sweep of the eye
Scene, determine that the MR heads show the physical location in real space；
Second determining unit, for according to the mapping relations between real space and Virtual Space, determining that the MR heads show
The physical location in the Virtual Space corresponding virtual location；
3rd determining unit, for obtaining the angular speed when MR heads are aobvious to be rotated, and institute is determined according to the angular speed
State the view directions of the aobvious wearer of MR heads；
Processing unit, for aobvious according to known location of any virtual sound source in the Virtual Space, the MR heads
The virtual location and the view directions, calculate the pendant that audio signal corresponding to the virtual sound source shows from the MR heads
During each sound channel output for the audio-frequence player device that wearer wears, output time delay between each sound channel and described each
The output acoustic pressure of each sound channel in sound channel；
Output unit, for the output sound according to the output time delay between each sound channel and each sound channel
Pressure, the audio signal is exported to the audio-frequence player device from each sound channel respectively.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the processing unit, including：
Distance calculation module, for according to known location of any virtual sound source in the Virtual Space and the MR
The aobvious virtual location of head, calculate the virtual sound source and the MR heads it is aobvious between relative distance；
Orientation computing module, for according to known location of the virtual sound source in the Virtual Space and described regarding
Angular direction, calculate the relative bearing that the virtual sound source shows with the MR heads；
Processing module, for according to the relative distance and the relative bearing, calculating sound corresponding to the virtual sound source
During each sound channel output for the audio-frequence player device that frequency signal is worn from the wearer that the MR heads show, between each sound channel
Output time delay and each sound channel in each sound channel output acoustic pressure.
As an alternative embodiment, in second aspect of the embodiment of the present invention, first determining unit, bag
Include：
Acquisition module, the scape within the vision that the binocular camera for obtaining the aobvious simulation human eye work of MR heads collects
As；
Identification module, each described location feature point is true in multiple location feature points for identifying the scene
Known location in space, the quantity of the multiple location feature point is at least three；
First determining module, for according to each depth of field degree of the location feature point in the scene, determining institute
State the aobvious relative position between each described location feature point of MR heads；
Second determining module, for according to known location of each described location feature point in real space, described
MR heads show the relative position between the multiple location feature point, determine that the MR heads show the physical bit in real space
Put.
As an alternative embodiment, in second aspect of the embodiment of the present invention, in addition to：
First judging unit, for judging the virtual location whether in designated area, the designated area is with institute
Centered on stating virtual sound source, using default minimum range as radius；
The output unit, it is additionally operable to judge that the virtual location is in designated area in first judging unit
When, directly audio signal corresponding to the virtual sound source is exported to the audio-frequence player device.
As an alternative embodiment, in second aspect of the embodiment of the present invention, in addition to：
Second judging unit, for judging that the virtual location is not in designated area in first judging unit
When interior, judge whether the virtual sound source is system manager, the system manager is used to issue information of voice prompt；
3rd judging unit, for when it is system manager that the second judging unit, which judges the virtual sound source, judging
It whether there is other virtual sound sources with the system manager while sounding in the Virtual Space；
The processing unit, it is additionally operable to exist and the system in the 3rd judging unit judges the Virtual Space
During other virtual sound sources of system keeper while sounding, the output sound of audio signal corresponding to the system manager is improved
The output acoustic pressure of straightening audio signal corresponding to each virtual sound source into higher than other described virtual sound sources；
The output unit, it is additionally operable to audio corresponding to the system manager according to the output acoustic pressure after raising
Signal output is to the audio-frequence player device.
Compared with prior art, the embodiment of the present invention has the advantages that：
The eyes collection for the wearer that the binocular camera shooting connector analog MR heads that service equipment is shown using MR heads show is within sweep of the eye
Scene, determine the aobvious physical location in real space of MR heads so as to the location feature point in above-mentioned scene,
Namely physical location of the user in real space.According to reflecting between the physical location and real space and Virtual Space
Penetrate, the virtual location of user can be obtained.In addition, service equipment can also obtain the aobvious wearer's (namely user) of MR heads
It is view directions, according to known location in Virtual Space of the view directions, any virtual sound source and above-mentioned virtual bit
Put, the relative position between user and virtual sound source can be calculated, so as to calculate what MR heads showed according to the relative position
Output time delay between each sound channel for the audio-frequence player device that wearer (namely user) wears, and virtual sound source are corresponding
Audio signal from each sound channel export when output acoustic pressure, so as to according to above-mentioned output time delay and output acoustic pressure, will
The audio signal exports from each sound channel, therefore, service equipment can according to the relative position between user and virtual sound source,
Adjust audio signal corresponding to virtual sound source so that audio signal changes with the change of customer location corresponding to virtual sound source
Become, so as to improve the matching degree corresponding to virtual sound source between audio signal and customer location.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, it will use below required in embodiment
Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for ability
For the those of ordinary skill of domain, on the premise of not paying creative work, it can also be obtained according to these accompanying drawings other attached
Figure.
Fig. 1 is a kind of flow of the mixed reality audio control method based on binocular camera disclosed in the embodiment of the present invention
Schematic diagram；
Fig. 2 is the stream of mixed reality audio control method of the another kind disclosed in the embodiment of the present invention based on binocular camera
Journey schematic diagram；
Fig. 3 is a kind of structural representation of service equipment disclosed in the embodiment of the present invention；
Fig. 4 is the structural representation of another service equipment disclosed in the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.Based on this
Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example is applied, belongs to the scope of protection of the invention.
It should be noted that term " comprising " and " having " and their any changes in the embodiment of the present invention and accompanying drawing
Shape, it is intended that cover non-exclusive include.Such as contain the process of series of steps or unit, method, system, product or
The step of equipment is not limited to list or unit, but alternatively also include the step of not listing or unit, or it is optional
Ground is also included for the intrinsic other steps of these processes, method, product or equipment or unit.
The embodiment of the invention discloses a kind of mixed reality audio control method and service equipment based on binocular camera,
The matching degree between the audio signal of virtual sound source and customer location can be improved.It is described in detail individually below.
Embodiment one
Referring to Fig. 1, Fig. 1 is a kind of mixed reality audio frequency control based on binocular camera disclosed in the embodiment of the present invention
The schematic flow sheet of method.Wherein, the mixed reality method based on optical alignment described by Fig. 1 is applied to and the aobvious connection of MR heads
Service equipment, the embodiment of the present invention do not limit.For example, can be personal electricity with the service equipment of the aobvious connection of MR heads
Brain, smart mobile phone, Cloud Server etc., the embodiment of the present invention does not limit.Wherein, the operation of the service equipment of connection is shown with MR heads
System may include but be not limited to Windows operating system, (SuSE) Linux OS, Android operation system, IOS etc.
Deng the embodiment of the present invention does not limit.As shown in figure 1, should mixed reality audio control method based on binocular camera can be with
Comprise the following steps：
101st, the scape within the vision that the binocular camera that service equipment works according to the aobvious simulation human eye of MR heads collects
As determining that MR heads show the physical location in real space.
As an alternative embodiment, in embodiments of the present invention, the mode that service equipment performs step 101 is specific
Can be：
Service equipment obtains the scene within the vision that the binocular camera of the aobvious simulation human eye work of MR heads collects；
Identify the known position information of each location feature point in multiple location feature points of the scene, the plurality of positioning
The quantity of characteristic point is at least three；
According to each depth of field degree of the location feature point in the scene, determine MR heads it is aobvious with each location feature point it
Between relative position；
It is aobvious between multiple location feature points according to known location of each location feature point in real space, MR heads
Relative position, determine that MR heads show the physical location in real space.
102nd, service equipment determines the aobvious physical location of MR heads according to the mapping relations between real space and Virtual Space
The corresponding virtual location in Virtual Space.
In the embodiment of the present invention, multiple location feature points in the scene that service equipment is got are to be present in real space
In location feature point, therefore the aobvious physical location of the MR heads being calculated according to the known location of multiple location feature points is MR
Head shows the physical location in real space, and virtual sound source is to exist only in Virtual Space, is not present in real space
Sound source, the relative position between virtual sound source and user's head are for Virtual Space, and therefore, service equipment can be held
The physical location that MR heads show is mapped to Virtual Space by row step 102, is obtained the virtual location that MR heads show in Virtual Space and is made
The virtual location for being user's head in Virtual Space.
In addition, service equipment can previously generate above-mentioned Virtual Space, can also be from Virtual Space open platform, three-dimensional void
Intend the upper platforms such as space storage cloud platform and obtain Virtual Space.
For example, service equipment can be scanned in surrounding environment with the presence or absence of the access node pre-set；If deposit
In access node, service equipment can detect the mean data transfer speed between access node and the terminal for accessing the access node
Rate；If the average data transfer rate between access node and the terminal for accessing the access node is not less than specified threshold, clothes
Equipment of being engaged in can send the authentication request for carrying services equipment identity information to access node, by the access node service for checking credentials
Whether the identity of equipment is legal；If the identity of service equipment is legal, service equipment can send Virtual Space to access node
Request is obtained, is sent after Virtual Space is obtained into request encryption by access node to Virtual Space open platform；Open Virtual Space
It is laid flat platform to decrypt after obtaining Virtual Space acquisition request, Virtual Space is sent to access node, and will be virtual by dummy node
Space is sent to service equipment.Wherein, above-mentioned embodiment is implemented, it is possible to reduce service equipment generates the calculating of Virtual Space
Amount, computing resource is vacateed for other computings such as tracking user positions, improves the response speed of service equipment.
103rd, service equipment obtains angular speed when MR heads are aobvious to be rotated, and determines the aobvious wearer of MR heads according to the angular speed
View directions.
In the embodiment of the present invention, MR heads it is aobvious can the Inertial Measurement Unit such as built-in gyroscope, accelerometer, gyroscope can be with
Angular speed when MR heads are aobvious to be rotated is measured, so as to determine what the aobvious rotation direction of MR heads showed as MR heads according to the angular speed
The view directions of wearer.
As an alternative embodiment, service equipment according to the angular speed determine the aobvious rotation direction of MR heads it
Afterwards, according to the known location of any location feature point in above-mentioned scene within the vision, and the physical location that MR heads are aobvious,
The rotation direction shown to above-mentioned MR heads is modified, and the wearer that the rotation direction that revised MR heads show is shown as MR heads
Be view directions.Wherein, implement above-mentioned embodiment, optical alignment and inertia measurement can be combined, improve and determine MR heads
The degree of accuracy of the view directions of aobvious wearer.
104th, service equipment according to the aobvious virtual location of known location of any virtual sound source in Virtual Space, MR heads,
And above-mentioned view directions, calculate the audio broadcasting that the wearer that audio signal corresponding to virtual sound source shows from MR heads wears and set
The output acoustic pressure of each sound channel in output time delay and each sound channel when standby each sound channel exports between each sound channel.
In the embodiment of the present invention, it is assumed that any virtual sound source is virtual guitar, and virtual guitar is on the left of user's head, then
The left ear of user hears that the sound of virtual guitar can be higher than the sound that user's auris dextra is heard, moreover, the sound of virtual guitar is reached and used
The time of the left ear in family can be earlier than the time for reaching user's auris dextra, when user walks close to virtual guitar, sound that the left ear of user is heard
Also the sound heard when can be slightly remote higher than distance.If user rotates body, make virtual guitar on the right side of user's head, then use
The sound that the left ear in family is heard can be less than the sound that user's auris dextra is heard, while the sound of virtual guitar reaches the time of the left ear of user
Also the sound for reaching user's auris dextra can be later than.It can be seen that the embodiment of the present invention by combine virtual sound source in Virtual Space
Know the aobvious physical location in position, MR heads, and the view directions of the aobvious wearer of MR heads, it is never defeated with sound channel to calculate audio signal
The output acoustic pressure of output time delay and each sound channel when going out between each sound channel, can according to user's head and virtual sound source it
Between relative position, adjust virtual sound source corresponding to audio signal, improve virtual sound source corresponding to audio signal and customer location
Between matching degree, can make user experience incoming ears sound existence time difference and level difference, and the time difference and
Relative position between level difference and user's head and virtual sound source matches, so as to strengthen the sense of reality of Consumer's Experience.
105th, service equipment is according to the output time delay and the output acoustic pressure of each sound channel between each sound channel, by Virtual Sound
Audio signal corresponding to source is exported to audio-frequence player device from each sound channel respectively.
It can be seen that in the method described by Fig. 1, what service equipment can be collected using the binocular camera that MR heads show regards
Multiple location feature points in scene in wild scope determine that MR heads show the thing of (namely user's head) in real space
Position is managed, so as to be tracked to user's head, that is, customer location.Service equipment can also obtain the aobvious rotation of MR heads
When angular speed, determine the view directions of the aobvious wearer (namely user) of MR heads, and combine virtual sound source virtual empty
Between in virtual location, the aobvious physical location of MR heads be mapped to virtual location in Virtual Space, and the wearer that MR heads are aobvious
View directions, adjust virtual sound source corresponding to audio signal respectively from MR heads show wearer (namely user) wear sound
Output delay and output acoustic pressure during each sound channel output of frequency playback equipment, can be according between user's head and virtual sound source
Relative position virtual sound source corresponding to audio signal, improve between audio signal and customer location corresponding to virtual sound source
With degree, so as to strengthen the sense of reality of Consumer's Experience.
Embodiment two
Referring to Fig. 2, Fig. 2 is mixed reality audio control of the another kind disclosed in the embodiment of the present invention based on binocular camera
The schematic flow sheet of method processed.As shown in Fig. 2 should mixed reality audio control method based on binocular camera can include with
Lower step：
201st, the scape within the vision that the binocular camera that service equipment works according to the aobvious simulation human eye of MR heads collects
As determining that MR heads show the physical location in real space.
As an alternative embodiment, in embodiments of the present invention, the mode that service equipment performs step 201 is specific
Can be：
Service equipment obtains the scene within the vision that the binocular camera of the aobvious simulation human eye work of MR heads collects；
Service equipment identifies the known position information of each location feature point in multiple location feature points of the scene, should
The quantity of multiple location feature points is at least three；
Service equipment determines that MR heads are aobvious and positioned with each according to each depth of field degree of the location feature point in the scene
Relative position between characteristic point；
Service equipment is aobvious special with multiple positioning according to known location of each location feature point in real space, MR heads
Relative position between sign point, determines that MR heads show the physical location in real space.
As another optional embodiment, in embodiments of the present invention, if be not present at least in above-mentioned scene
Three location feature points, service equipment determine that MR heads show the mode of the physical location in real space and are specifically as follows：
Service equipment obtains the initial physical location that angular speed, acceleration and MR heads when MR heads are aobvious to move show, wherein,
The initial physical location is that MR heads show true before MR heads show and collect the scene not comprising 1 location feature points
Physical location in space；
Angular speed and acceleration when service equipment moves according to the initial physical location and MR heads are aobvious, utilize inertial navigation
When calculating that MR heads are aobvious to collect the scene not comprising 1 location feature points, MR heads show the physical bit in real space
Put.
Wherein, implement above-mentioned embodiment, at least three features can not be included in the aobvious scene collected of MR heads
During point, using inertial navigation as supplement, the physical location shown to MR heads positions, so as to improve the accurate of position tracking
Degree.
202nd, service equipment determines the aobvious physical location of MR heads according to the mapping relations between real space and Virtual Space
The corresponding virtual location in Virtual Space.
203rd, service equipment judges the aobvious virtual location of MR heads whether in designated area, if it is, directly performing step
Rapid 207, if not, performing step 204.
In the embodiment of the present invention, designated area is centered on any virtual sound source, using default minimum range as radius, when
When the virtual location that MR heads show (namely user's head) is in designated area, user distance virtual sound source is nearer, Yong Hunan
To differentiate difference of the sound of incoming ears on time difference and level difference, therefore, when service equipment judges the aobvious void of MR heads
Intend position when be in designated area, execution step 207, do not adjust output time delay between each sound channel of audio-frequence player device and defeated
Go out acoustic pressure, audio signal corresponding to virtual sound source is directly output to audio-frequence player device, Consumer's Experience can not influenceed
In the case of reduce the amount of calculation of service equipment, save the computing resource of service equipment.
204th, service equipment judges whether virtual sound source is system manager, if it is, step 205 is performed, if not, directly
Connect and perform step 208.
205th, service equipment judges to whether there is other virtual sound sources with system manager while sounding in Virtual Space,
If it is, step 206 is performed, if not, performing step 207.
206th, service equipment improves the output acoustic pressure of audio signal corresponding to system manager until being higher than other Virtual Sounds
The output acoustic pressure of each audio signal corresponding to virtual sound source in source, it is according to the output acoustic pressure after raising that system manager is corresponding
Audio signal export to audio-frequence player device, and terminate this flow.
In the embodiment of the present invention, system manager is used to issue information of voice prompt, and information of voice prompt can be guided
The prompt message of type, such as be used to prompt the mission bit stream that custom system has issued new task under mixed reality scene of game,
It is the guidance information of user's explanation or the prompt message of caution type either under mixed reality exhibition scene, such as
The message of call user's attention electricity when service equipment detects that MR heads show not enough power supply, or under multi-user environment, clothes
When business equipment judges that there is another user quickly moved in front by aobvious multiple scenes collected of MR heads, call user's attention
Safety, the message of collision free, the embodiment of the present invention do not limit.Because the information of voice prompt of system administration issue can refer to
Quote family, it is also possible to be related to user security, user needs to catch audio signal corresponding to system reason person, therefore, when virtual
When multiple and system manager while other virtual sound sources of sounding in space be present, service equipment can improve system manager
The output acoustic pressure of corresponding audio signal, until it exports the output sound that acoustic pressure is higher than audio signal corresponding to other virtual sound sources
Pressure so that user hear other virtual sound sources sound will not covering system keeper sound, make user clearly hear to be
The information of voice prompt of system keeper's issue.
As an alternative embodiment, in order to protect the hearing of user while acoustic pressure is improved, service equipment exists
While improving the output acoustic pressure of audio signal corresponding to system manager, sound corresponding to other virtual sound sources can be suitably turned down
Acoustic pressure corresponding to frequency signal, until the output acoustic pressure of audio signal corresponding to system manager is higher than corresponding to other virtual sound sources
The output acoustic pressure of audio signal.
In addition, system manager can be have in Virtual Space physical location Dummy (such as non-player's control role,
NPC), as another optional embodiment, in order to strengthen the sense of reality of Consumer's Experience, service equipment can be in the system of holding
The output acoustic pressure of audio signal corresponding to keeper higher than audio signal corresponding to other virtual sound sources output acoustic pressure this
In the case of part, step 209 is performed, calculates the sound that the wearer that audio signal corresponding to system manager shows from MR heads wears
Frequency playback equipment each sound channel output when output time delay and each sound channel output acoustic pressure, and according to the output time delay with
Output acoustic pressure exports audio signal corresponding to system manager from each sound channel.
Optionally, system manager can also be the Dummy for not having physical location in Virtual Space (under such as game contexts
For the world channel that gives out information), position of the user without sensory perceptual system keeper, therefore service equipment can adjust
Audio signal corresponding to system manager is higher than after audio signal corresponding to other virtual sound sources, can not consider different sound channels
Between output delay and output acoustic pressure difference, by audio signal corresponding to system manager export to audio play set
It is standby.
207th, service equipment directly exports audio signal corresponding to virtual sound source to audio-frequence player device, and terminates this stream
Journey.
In the embodiment of the present invention, service equipment, which lands vertically, exports audio signal corresponding to virtual sound source to audio-frequence player device
When, the output delay between each sound channel of audio-frequence player device and the difference of output acoustic pressure can not be considered, according to identical
Output time and the default output acoustic pressure of service equipment are by audio signal corresponding to virtual sound source from each sound channel output valve sound
Frequency playback equipment.
208th, service equipment obtains angular speed when MR heads are aobvious to be rotated, and determines the aobvious wearer of MR heads according to the angular speed
View directions.
209th, service equipment according to the aobvious virtual location of known location of the virtual sound source in Virtual Space, MR heads and
Above-mentioned view directions, calculate the audio-frequence player device that the wearer that audio signal corresponding to virtual sound source shows from MR heads wears
The output acoustic pressure of each sound channel in output time delay and each sound channel during each sound channel output between each sound channel.
As an alternative embodiment, in embodiments of the present invention, the mode that service equipment performs step 209 is specific
Can be：
According to the virtual location that known location of the virtual sound source in Virtual Space and MR heads are aobvious, virtual sound source is calculated
With relative distance of the MR heads between aobvious；
Show the view directions of wearer according to known location of the virtual sound source in Virtual Space and MR heads, calculate void
The relative bearing that onomatopoeia source shows with MR heads；
According to relative distance and relative bearing, calculate the wearer that audio signal corresponding to virtual sound source shows from MR heads and wear
Audio-frequence player device the output of each sound channel when, each sound channel in the output time delay and each sound channel between each sound channel
Export acoustic pressure.
210th, service equipment is according to the output time delay and the output acoustic pressure of each sound channel between each sound channel, by Virtual Sound
Audio signal corresponding to source is exported to audio-frequence player device from each sound channel respectively.
As an alternative embodiment, in embodiments of the present invention, service equipment is according to defeated between each sound channel
Go out the output acoustic pressure of time delay and each sound channel, audio signal corresponding to virtual sound source is exported to audio from each sound channel respectively
Before playback equipment, service equipment can also pre-process to audio signal corresponding to virtual sound source, such as to audio signal
Noise reduction process, or the sound field characteristics of superposition Virtual Space are carried out, to strengthen the sense of reality of Consumer's Experience.
It can be seen that in the method described by Fig. 2, physical location that service equipment can show to MR heads and corresponding virtual
Position is monitored in real time, and implement to adjust audio signal corresponding to virtual sound source so that the audio signal and MR heads it is aobvious (
It is exactly user's head) relative position between virtual sound source matches.Further, in the method described by Fig. 2, service
When the virtual location that equipment can show in MR heads is in designated area, directly audio signal is exported to audio-frequence player device,
The amount of calculation of service equipment can be reduced in the case where not influenceing Consumer's Experience, saves the computing resource of service equipment.More enter
One step, in the method described by Fig. 2, the virtual location that service equipment can show in MR heads is in outside designated area, and empty
Onomatopoeia source is when multiple virtual sound sources with system manager while sounding in system manager and Virtual Space be present, to improve
The output acoustic pressure of audio signal corresponding to system manager is until higher than sound corresponding to each virtual sound source in other virtual sound sources
The output acoustic pressure of frequency signal, and audio signal corresponding to system manager is exported to audio according to the output acoustic pressure after raising and broadcast
Equipment is put, so as to reduce the sound of the information of voice prompt of the acoustic pressure covering system keeper of other virtual sound sources issue
Probability, user is caught information of voice prompt, provide the user good usage experience, and ensure the peace of user
Entirely.
Embodiment three
Referring to Fig. 3, Fig. 3 is a kind of service equipment disclosed in the embodiment of the present invention.As shown in figure 3, the service equipment can
With including：
First determining unit 301, the visual field model that the binocular camera for being worked according to the aobvious simulation human eye of MR heads collects
Interior scene is enclosed, determines that MR heads show the physical location in real space；
Wherein, the first above-mentioned determining unit 301, including：
Acquisition module 3011, the binocular camera for obtaining the aobvious simulation human eye work of MR heads collect within sweep of the eye
Scene；
Identification module 3012, each in multiple location feature points of the scene got for identifying acquisition module 3011
Known location of the location feature point in real space, wherein, the quantity of multiple location feature points is at least three；
First determining module 3013, each location feature point of the scene for being got according to acquisition module 3011 exist
Depth of field degree in the scene, determine the aobvious relative position between each location feature point of MR heads；
Second determining module 3014, for identifying each location feature point in real space according to identification module 3012
In known location, the aobvious relative position between multiple location feature points of MR heads that determines of the first determining module 3013, it is determined that
MR heads show the physical location in real space.
Service equipment shown in Fig. 3 can also include:
Second determining unit 302, for according to the mapping relations between real space and Virtual Space, determining the second determination
The physical location that the MR heads that module 3014 determines show corresponding virtual location in Virtual Space；
3rd determining unit 303, for obtaining angular speed when MR heads are aobvious to be rotated, and determine that MR heads show according to the angular speed
Wearer view directions；
In the embodiment of the present invention, the 3rd determining unit can obtain the aobvious gyroscope of MR heads and measure when MR heads are aobvious to be rotated
Angular speed, so as to calculate the visual angle side for the wearer that the aobvious rotation direction of MR heads shows as MR heads according to the angular speed
To；
Processing unit 304, for known location, the second determining unit according to any virtual sound source in Virtual Space
The view directions that the aobvious virtual location of the 302 MR heads determined and the 3rd determining unit 303 determine, it is corresponding to calculate virtual sound source
The audio-frequence player device worn from the wearer that MR heads show of audio signal the output of each sound channel when, it is defeated between each sound channel
Go out the output acoustic pressure of each sound channel in time delay and each sound channel；
Output unit 305, for the output time delay between each sound channel for being calculated according to processing unit 304 and each
The output acoustic pressure of sound channel, above-mentioned audio signal is exported to audio-frequence player device from each sound channel respectively.
And as an alternative embodiment, the 3rd above-mentioned determining unit 303 shows angle when rotating according to MR heads
, can be with the scene of the acquisition of acquisition module 3011 in the first determining unit 301 after speed determines that MR heads show rotation direction
The known location of one positioning characteristic point, and the aobvious thing of the MR heads that determine of the second determining module 3014 of the first determining unit 301
Position is managed, the rotation direction shown to above-mentioned MR heads is modified, and the rotation direction that revised MR heads show is shown as MR heads
Wearer be view directions.Wherein, implement above-mentioned embodiment, optical alignment and inertia measurement can be combined, improve
Determine the degree of accuracy of the view directions of the aobvious wearer of MR heads.
It can be seen that the service equipment shown in implementing Fig. 3, the field range that the binocular camera that MR heads can be utilized to show collects
Multiple location feature points in interior scene determine that MR heads show the physical location of (namely user's head) in real space,
So as to be tracked to user's head, that is, customer location.Service equipment can also obtain angle when MR heads are aobvious to be rotated
Speed, the view directions of the aobvious wearer (namely user) of MR heads are determined, and combine virtual sound source in Virtual Space
The aobvious physical location of virtual location, MR heads is mapped to the virtual location in Virtual Space, and the visual angle of the aobvious wearer of MR heads
Direction, adjust the audio that the wearer (namely user) that audio signal corresponding to virtual sound source shows from MR heads respectively wears and play
Output delay and output acoustic pressure during each sound channel output of equipment, can be according to relative between user's head and virtual sound source
Audio signal corresponding to the virtual sound source of position, the matching degree between audio signal and customer location corresponding to virtual sound source is improved,
So as to strengthen the sense of reality of Consumer's Experience.
Example IV
Fig. 4 please be participate in, Fig. 4 is another service equipment disclosed in the embodiment of the present invention.Wherein, the service shown in Fig. 4 is set
Standby is that service equipment as shown in Figure 3 optimizes what is obtained.Compared with the service equipment shown in Fig. 3, the service shown in Fig. 4
Equipment can also include：
First judging unit 306, for judging whether the virtual location that the second determining unit 302 determines is in designated area
It is interior；
In the embodiment of the present invention, above-mentioned designated area centered on the virtual sound source, using default minimum range as
Radius；
Above-mentioned output unit 305, it is additionally operable to judge that the aobvious virtual location of MR heads is in finger in the first judging unit 306
When determining in region, directly audio signal corresponding to virtual sound source is exported to audio-frequence player device.
Second judging unit 307, for judging that the aobvious virtual location of MR heads is not in referring in the first judging unit 306
When determining in region, judge whether virtual sound source is system manager, and system manager is used to issue information of voice prompt；
In the embodiment of the present invention, the second judging unit when it is system manager to judge virtual sound source, sentence by triggering the 3rd
Disconnected unit 308, when it is not system manager to judge virtual sound source, trigger the 3rd determining unit 303；
The 3rd above-mentioned judging unit 308, for judging that virtual sound source is system manager in the second judging unit 307
When, judge to whether there is other virtual sound sources with system manager while sounding in Virtual Space；
The 3rd above-mentioned determining unit 303, specifically for judging that virtual sound source is not system in the second judging unit 307
During keeper, angular speed when MR heads are aobvious to be rotated is obtained, and the view directions of the aobvious wearer of MR heads are determined according to the angular speed,
And trigger processing unit 304 perform according to the aobvious virtual location of known location of any virtual sound source in Virtual Space, MR heads,
And above-mentioned view directions, when calculating the output between each sound channel for the audio-frequence player device that the aobvious wearer of MR heads wears
Prolong and virtual sound source corresponding to audio signal output acoustic pressure of each sound channel when being exported from each sound channel operation.
Above-mentioned processing unit 304, is additionally operable to exist in the 3rd judging unit 308 judges Virtual Space and system pipes
During other virtual sound sources of reason person while sounding, the output acoustic pressure of audio signal corresponding to system manager is improved until being higher than it
The output acoustic pressure of each audio signal corresponding to virtual sound source in his virtual sound source；
Wherein, above-mentioned processing unit 304, including：
Distance calculation module 3041, for being determined according to known location of the virtual sound source in Virtual Space and second
The aobvious virtual location of MR heads that unit 302 determines, calculate virtual sound source and MR heads it is aobvious between relative distance；
Orientation computing module 3042, for being determined according to known location of the virtual sound source in Virtual Space and the 3rd
The view directions that unit 303 determines, calculate the relative bearing that the virtual sound source shows with MR heads；
Processing module 3043, for the relative distance and orientation computing module calculated according to distance calculation module 3041
3042 relative bearings calculated, calculate the audio that the wearer that audio signal corresponding to virtual sound source shows from MR heads wears and play
During each sound channel output of equipment, the output sound of each sound channel in the output time delay and each sound channel between each sound channel
Pressure.
And processing module 3043 is additionally operable to exist in the 3rd judging unit 308 judges Virtual Space and system pipes
During other virtual sound sources of reason person while sounding, the output acoustic pressure of audio signal corresponding to system manager is improved until being higher than it
The output acoustic pressure of each audio signal corresponding to virtual sound source in his virtual sound source.
Above-mentioned output unit 305, specifically for the output between each sound channel for being calculated according to processing module 3043
The output acoustic pressure of time delay and each sound channel, above-mentioned audio signal is exported to audio-frequence player device from each sound channel respectively.
Or
Output acoustic pressure after being improved according to processing module 3043 exports audio signal corresponding to system manager to audio
Playback equipment.Or
Sentence when the first judging unit 306 judges that the aobvious virtual location of MR heads is in designated area, or the 3rd
When disconnected unit 308 judges to be not present the virtual sound source with system manager while sounding in Virtual Space, directly by Virtual Sound
Audio signal corresponding to source is exported to audio-frequence player device.
In addition, in embodiments of the present invention, if as an alternative embodiment, the first above-mentioned determining unit
1 location feature points are not present in 301 scenes got, the first determining unit 301 determines that MR heads show in real space
In the mode of physical location can be：
First determining unit 301 obtains the initial physical position that angular speed, acceleration and MR heads when MR heads are aobvious to move show
Put, wherein, the initial physical location is the MR heads before MR heads show and collect the scene not comprising 1 location feature points
Show the physical location in real space；
Angular speed and acceleration when first determining unit 301 is moved according to the initial physical location and MR heads are aobvious, are utilized
When inertial navigation calculates that MR heads are aobvious to collect the scene not comprising 1 location feature points, MR heads show in real space
Physical location.
Wherein, implement above-mentioned embodiment, at least three features can not be included in the aobvious scene collected of MR heads
During point, using inertial navigation as supplement, the physical location shown to MR heads positions, so as to improve the accurate of position tracking
Degree.
It can be seen that implementing the service equipment shown in Fig. 4, the physical location and corresponding virtual location that can show to MR heads enter
Row monitoring in real time, and implement to adjust audio signal corresponding to virtual sound source so that the audio signal and MR heads show (namely uses
Account portion) relative position between virtual sound source matches.Further, the service equipment shown in Fig. 4 is implemented, can be the
When one judging unit 306 judges that the aobvious virtual location of MR heads is in designated area, by output unit 305 directly by audio
Signal output can reduce the amount of calculation of service equipment in the case where not influenceing Consumer's Experience, save to audio-frequence player device
The computing resource of service equipment.Further, implement the service equipment shown in Fig. 4, can judge in the first judging unit 306
Go out the aobvious virtual location of MR heads to be in outside designated area, and the second judging unit 307 judges that virtual sound source is system manager,
And the 3rd judging unit 308 judge in Virtual Space exist with system manager simultaneously sounding multiple virtual sound sources when,
The output acoustic pressure of audio signal corresponding to system manager is improved until corresponding higher than each virtual sound source in other virtual sound sources
Audio signal output acoustic pressure, and audio signal corresponding to system manager is exported to sound according to the output acoustic pressure after raising
Frequency playback equipment, so as to reduce the sound of the information of voice prompt of the acoustic pressure covering system keeper of other virtual sound sources issue
The probability of sound, allows user to catch information of voice prompt, provides the user good usage experience, and ensure user's
Safety.
Embodiment five
The embodiment of the present invention discloses a kind of service equipment, including：
The processor for being stored with the memory of executable program code and being coupled with memory；
Wherein, processor calls the executable program code that stores in memory, perform shown in Fig. 1 or Fig. 2 based on double
The mixed reality audio control method of mesh camera.
In addition, the embodiment of the present invention discloses a kind of computer-readable recording medium, it stores computer program, wherein, should
Computer program causes computer to perform the mixed reality audio control method based on binocular camera shown in Fig. 1 or Fig. 2.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
To instruct the hardware of correlation to complete by program, the program can be stored in a computer-readable recording medium, storage
Medium include read-only storage (Read-Only Memory, ROM), random access memory (Random Access Memory,
RAM), programmable read only memory (Programmable Read-only Memory, PROM), erasable programmable is read-only deposits
Reservoir (Erasable Programmable Read Only Memory, EPROM), disposable programmable read-only storage (One-
Time Programmable Read-Only Memory, OTPROM), the electronics formula of erasing can make carbon copies read-only storage
(Electrically-Erasable Programmable Read-Only Memory, EEPROM), read-only optical disc (Compact
Disc Read-Only Memory, CD-ROM) or other disk storages, magnetic disk storage, magnetic tape storage or can
For carrying or any other computer-readable medium of data storage.
Above to a kind of mixed reality audio control method and clothes based on binocular camera disclosed in the embodiment of the present invention
Business equipment is described in detail, and specific case used herein is set forth to the principle and embodiment of the present invention,
The explanation of above example is only intended to help the method and its core concept for understanding the present invention；Meanwhile for the one of this area
As technical staff, according to the thought of the present invention, there will be changes in specific embodiments and applications, to sum up institute
State, this specification content should not be construed as limiting the invention.
Claims (10)
1. a kind of mixed reality audio control method based on binocular camera, it is characterised in that methods described includes：
The scene within the vision that the binocular camera to be worked according to the aobvious simulation human eye of MR heads collects, determines that the MR heads show
Physical location in real space；
According to the mapping relations between real space and Virtual Space, determine the aobvious physical location of the MR heads in the void
Intend corresponding virtual location in space；
The angular speed when MR heads are aobvious to be rotated is obtained, and the visual angle of the aobvious wearer of the MR heads is determined according to the angular speed
Direction；
According to the aobvious virtual location of known location of any virtual sound source in the Virtual Space, the MR heads and
The view directions, calculate the audio that the wearer that audio signal corresponding to the virtual sound source shows from the MR heads wears and play
During each sound channel output of equipment, each sound channel is defeated in the output time delay and each sound channel between each sound channel
Go out acoustic pressure；
According to the output time delay between each sound channel and the output acoustic pressure of each sound channel, by the audio signal point
Do not exported from each sound channel to the audio-frequence player device.
2. the mixed reality audio control method according to claim 1 based on binocular camera, it is characterised in that described
According to the aobvious virtual location of known location of any virtual sound source in the Virtual Space, the MR heads and described
View directions, calculate the audio-frequence player device that the wearer that audio signal corresponding to the virtual sound source shows from the MR heads wears
The output of each sound channel when, each output sound of sound channel in the output time delay and each sound channel between each sound channel
Pressure, including：
According to the virtual location that known location of any virtual sound source in the Virtual Space and the MR heads are aobvious, meter
Calculate the virtual sound source and the MR heads it is aobvious between relative distance；
According to known location of the virtual sound source in the Virtual Space and the view directions, calculate described virtual
The relative bearing that sound source shows with the MR heads；
According to the relative distance and the relative bearing, calculate audio signal corresponding to the virtual sound source and show from the MR heads
The audio-frequence player device worn of wearer the output of each sound channel when, output time delay between each sound channel and described
The output acoustic pressure of each sound channel in each sound channel.
3. the mixed reality audio control method according to claim 1 based on binocular camera, it is characterised in that described
The scene within the vision that the binocular camera to be worked according to the aobvious simulation human eye of MR heads collects, determines that the MR heads show true
Physical location in the real space, including：
Obtain the scene within the vision that the binocular camera of the aobvious simulation human eye work of MR heads collects；
Each known location of the location feature point in real space in multiple location feature points of the scene is identified,
The quantity of the multiple location feature point is at least three；
According to each depth of field degree of the location feature point in the scene, determine the MR heads it is aobvious with it is fixed each described
Relative position between the characteristic point of position；
It is aobvious special with the multiple positioning according to known location of each described location feature point in real space, the MR heads
Relative position between sign point, determines that the MR heads show the physical location in real space.
4. the mixed reality audio control method based on binocular camera according to any one of claims 1 to 3, its feature
It is, methods described also includes：
The virtual location is judged whether in designated area, and the designated area is centered on the virtual sound source, with pre-
If minimum range be radius；
If it is, directly audio signal corresponding to the virtual sound source is exported to the audio-frequence player device.
5. the mixed reality audio control method according to claim 4 based on binocular camera, it is characterised in that described
Method also includes：
If the virtual location is not in designated area, judge whether the virtual sound source is system manager, it is described
System manager is used to issue information of voice prompt；
If it is, judge to whether there is other virtual sound sources with the system manager while sounding in the Virtual Space；
If it does, the output acoustic pressure of audio signal corresponding to the system manager is improved until higher than other described void
The output acoustic pressure of each audio signal corresponding to virtual sound source in onomatopoeia source, and will according to the output acoustic pressure after raising
Audio signal corresponding to the system manager is exported to the audio-frequence player device.
A kind of 6. service equipment, it is characterised in that including：
First determining unit, the scape within the vision that the binocular camera for being worked according to the aobvious simulation human eye of MR heads collects
As determining that the MR heads show the physical location in real space；
Second determining unit, for according to the mapping relations between real space and Virtual Space, determining the aobvious institute of the MR heads
State physical location corresponding virtual location in the Virtual Space；
3rd determining unit, for obtaining the angular speed when MR heads are aobvious to be rotated, and the MR is determined according to the angular speed
The view directions of the aobvious wearer of head；
Processing unit, for according to known location of any virtual sound source in the Virtual Space, the MR heads are aobvious
Virtual location and the view directions, calculate the wearer that audio signal corresponding to the virtual sound source shows from the MR heads
During each sound channel output of the audio-frequence player device of wearing, output time delay and each sound channel between each sound channel
In each sound channel output acoustic pressure；
Output unit, will for the output acoustic pressure according to the output time delay between each sound channel and each sound channel
The audio signal is exported to the audio-frequence player device from each sound channel respectively.
7. service equipment according to claim 6, it is characterised in that the processing unit, including：
Distance calculation module, for being shown according to known location of any virtual sound source in the Virtual Space and the MR heads
The virtual location, calculate the virtual sound source and the MR heads it is aobvious between relative distance；
Orientation computing module, for according to known location of the virtual sound source in the Virtual Space and the visual angle side
To calculating the relative bearing that the virtual sound source and the MR heads show；
Processing module, for according to the relative distance and the relative bearing, calculating audio corresponding to the virtual sound source and believing
It is defeated between each sound channel during each sound channel output of number audio-frequence player device worn from the wearer that the MR heads show
Go out the output acoustic pressure of each sound channel in time delay and each sound channel.
8. service equipment according to claim 6, it is characterised in that first determining unit, including：
Acquisition module, the scene within the vision that the binocular camera for obtaining the aobvious simulation human eye work of MR heads collects；
Identification module, each described location feature point is in real space in multiple location feature points for identifying the scene
In known location, the quantity of the multiple location feature point is at least three；
First determining module, for according to each depth of field degree of the location feature point in the scene, determining the MR
The aobvious relative position between each described location feature point of head；
Second determining module, for according to known location of each described location feature point in real space, the MR heads
Relative position between aobvious and the multiple location feature point, determines that the MR heads show the physical location in real space.
9. according to the service equipment described in any one of claim 6~8, it is characterised in that also include：
First judging unit, for judging the virtual location whether in designated area, the designated area is with the void
Centered on onomatopoeia source, using default minimum range as radius；
The output unit, it is additionally operable to when first judging unit judges that the virtual location is in designated area,
Directly audio signal corresponding to the virtual sound source is exported to the audio-frequence player device.
10. service equipment according to claim 9, it is characterised in that also include：
Second judging unit, for judging that the virtual location is not in designated area in first judging unit
When, judge whether the virtual sound source is system manager, the system manager is used to issue information of voice prompt；
3rd judging unit, for when it is system manager that the second judging unit, which judges the virtual sound source, described in judgement
It whether there is other virtual sound sources with the system manager while sounding in Virtual Space；
The processing unit, it is additionally operable to exist and the system pipes in the 3rd judging unit judges the Virtual Space
During other virtual sound sources of reason person while sounding, the output acoustic pressure for improving audio signal corresponding to the system manager is straight
The output acoustic pressure of audio signal corresponding to each virtual sound source into higher than other described virtual sound sources；
The output unit, it is additionally operable to audio signal corresponding to the system manager according to the output acoustic pressure after raising
Export to the audio-frequence player device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710781257.9A CN107632703A (en) | 2017-09-01 | 2017-09-01 | Mixed reality audio control method and service equipment based on binocular camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710781257.9A CN107632703A (en) | 2017-09-01 | 2017-09-01 | Mixed reality audio control method and service equipment based on binocular camera |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107632703A true CN107632703A (en) | 2018-01-26 |
Family
ID=61100361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710781257.9A Pending CN107632703A (en) | 2017-09-01 | 2017-09-01 | Mixed reality audio control method and service equipment based on binocular camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107632703A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109582273A (en) * | 2018-11-26 | 2019-04-05 | 联想(北京)有限公司 | Audio-frequency inputting method, electronic equipment and audio output device |
| WO2022135242A1 (en) * | 2020-12-21 | 2022-06-30 | 青岛千眼飞凤信息技术有限公司 | Virtual positioning method and apparatus, and virtual positioning system |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510074A (en) * | 2009-02-27 | 2009-08-19 | 河北大学 | High present sensation intelligent perception interactive motor system and implementing method |
| CN101690150A (en) * | 2007-04-14 | 2010-03-31 | 缪斯科姆有限公司 | virtual reality-based teleconferencing |
| CN103677715A (en) * | 2013-12-13 | 2014-03-26 | 深圳市经伟度科技有限公司 | Immersive virtual reality experiencing system |
| CN104102678A (en) * | 2013-04-15 | 2014-10-15 | 腾讯科技（深圳）有限公司 | Method and device for realizing augmented reality |
| CN105260016A (en) * | 2015-09-24 | 2016-01-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN105578355A (en) * | 2015-12-23 | 2016-05-11 | 惠州Tcl移动通信有限公司 | Method and system for enhancing sound effect when using virtual reality glasses |
| CN105745602A (en) * | 2013-11-05 | 2016-07-06 | 索尼公司 | Information processing device, method of processing information, and program |
| CN105807922A (en) * | 2016-03-07 | 2016-07-27 | 湖南大学 | Implementation method, device and system for virtual reality entertainment driving |
| CN105916096A (en) * | 2016-05-31 | 2016-08-31 | 努比亚技术有限公司 | Sound waveform processing method and device, mobile terminal and VR head-mounted device |
| CN106303787A (en) * | 2016-10-18 | 2017-01-04 | 杨跃龙 | The earphone system of reduction sound bearing true to nature |
| CN106296348A (en) * | 2016-08-03 | 2017-01-04 | 陈涛 | The indoor scene analog systems realized based on virtual reality method and method |
| CN106354472A (en) * | 2016-11-02 | 2017-01-25 | 广州幻境科技有限公司 | Control method used for sound in virtual reality environment and system thereof |
| CN106488288A (en) * | 2015-08-27 | 2017-03-08 | 宏达国际电子股份有限公司 | Virtual reality system and its audio/video synchronization method |
| CN106528038A (en) * | 2016-10-25 | 2017-03-22 | 三星电子（中国）研发中心 | Method, system and device for adjusting audio effect in virtual reality scene |
| CN106648528A (en) * | 2016-11-11 | 2017-05-10 | 宇龙计算机通信科技(深圳)有限公司 | Sound adjustment method and device for virtual reality equipment, and virtual reality equipment |
| CN106774844A (en) * | 2016-11-23 | 2017-05-31 | 上海创米科技有限公司 | A kind of method and apparatus for virtual positioning |
| CN106843456A (en) * | 2016-08-16 | 2017-06-13 | 深圳超多维光电子有限公司 | A kind of display methods, device and virtual reality device followed the trail of based on attitude |
-
2017
- 2017-09-01 CN CN201710781257.9A patent/CN107632703A/en active Pending
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101690150A (en) * | 2007-04-14 | 2010-03-31 | 缪斯科姆有限公司 | virtual reality-based teleconferencing |
| CN101510074A (en) * | 2009-02-27 | 2009-08-19 | 河北大学 | High present sensation intelligent perception interactive motor system and implementing method |
| CN104102678A (en) * | 2013-04-15 | 2014-10-15 | 腾讯科技（深圳）有限公司 | Method and device for realizing augmented reality |
| CN105745602A (en) * | 2013-11-05 | 2016-07-06 | 索尼公司 | Information processing device, method of processing information, and program |
| CN103677715A (en) * | 2013-12-13 | 2014-03-26 | 深圳市经伟度科技有限公司 | Immersive virtual reality experiencing system |
| CN106488288A (en) * | 2015-08-27 | 2017-03-08 | 宏达国际电子股份有限公司 | Virtual reality system and its audio/video synchronization method |
| CN105260016A (en) * | 2015-09-24 | 2016-01-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN105578355A (en) * | 2015-12-23 | 2016-05-11 | 惠州Tcl移动通信有限公司 | Method and system for enhancing sound effect when using virtual reality glasses |
| CN105807922A (en) * | 2016-03-07 | 2016-07-27 | 湖南大学 | Implementation method, device and system for virtual reality entertainment driving |
| CN105916096A (en) * | 2016-05-31 | 2016-08-31 | 努比亚技术有限公司 | Sound waveform processing method and device, mobile terminal and VR head-mounted device |
| CN106296348A (en) * | 2016-08-03 | 2017-01-04 | 陈涛 | The indoor scene analog systems realized based on virtual reality method and method |
| CN106843456A (en) * | 2016-08-16 | 2017-06-13 | 深圳超多维光电子有限公司 | A kind of display methods, device and virtual reality device followed the trail of based on attitude |
| CN106303787A (en) * | 2016-10-18 | 2017-01-04 | 杨跃龙 | The earphone system of reduction sound bearing true to nature |
| CN106528038A (en) * | 2016-10-25 | 2017-03-22 | 三星电子（中国）研发中心 | Method, system and device for adjusting audio effect in virtual reality scene |
| CN106354472A (en) * | 2016-11-02 | 2017-01-25 | 广州幻境科技有限公司 | Control method used for sound in virtual reality environment and system thereof |
| CN106648528A (en) * | 2016-11-11 | 2017-05-10 | 宇龙计算机通信科技(深圳)有限公司 | Sound adjustment method and device for virtual reality equipment, and virtual reality equipment |
| CN106774844A (en) * | 2016-11-23 | 2017-05-31 | 上海创米科技有限公司 | A kind of method and apparatus for virtual positioning |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109582273A (en) * | 2018-11-26 | 2019-04-05 | 联想(北京)有限公司 | Audio-frequency inputting method, electronic equipment and audio output device |
| US11202163B2 (en) | 2018-11-26 | 2021-12-14 | Lenovo (Beijing) Co., Ltd. | Audio output method, electronic device, and audio output apparatus |
| WO2022135242A1 (en) * | 2020-12-21 | 2022-06-30 | 青岛千眼飞凤信息技术有限公司 | Virtual positioning method and apparatus, and virtual positioning system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2019200642B2 (en) | Bio leash for user authentication | |
| CN110574103B (en) | Voice control method, wearable device and terminal | |
| CN104822042B (en) | A kind of pedestrains safety detection method and device based on camera | |
| US20220382846A1 (en) | Personal authentication device, personal authentication method, and recording medium | |
| CN107527046B (en) | Unlocking control method and related product | |
| CN107111705A (en) | Access checking based on situation | |
| CN109063977B (en) | Non-inductive transaction risk monitoring method and device | |
| CN110493781A (en) | The method and system of dynamic authorization | |
| CN109711847B (en) | Near field information authentication method and device, electronic equipment and computer storage medium | |
| CN107590859A (en) | A kind of mixed reality picture processing method and service equipment | |
| CN107632704A (en) | A kind of mixed reality audio control method and service equipment based on optical alignment | |
| EP3502939B1 (en) | Authentication method based on virtual reality scene, virtual reality device, and storage medium | |
| CN107632703A (en) | Mixed reality audio control method and service equipment based on binocular camera | |
| CN108206891A (en) | Call processing method, device, computer installation and computer readable storage medium | |
| CN106102031A (en) | Personnel protection method with the linkage of smart mobile phone shell | |
| CN110049490A (en) | Safety protecting method, device, wearable device and the medium of wearable device | |
| WO2018059962A1 (en) | A device, computer program and method | |
| CN104808775B (en) | Judge the device and method of head-wearing type intelligent device authentication effectiveness of information | |
| CN109062402A (en) | A kind of underwater photographic method and wearable device based on wearable device | |
| CN108593197A (en) | A kind of deep water method for early warning and wearable device based on wearable device | |
| CN109123927A (en) | A kind of Intelligent bracelet based on speech recognition | |
| CN109257490A (en) | Audio-frequency processing method, device, wearable device and storage medium | |
| US11134079B2 (en) | Cognitive behavioral and environmental access | |
| CN109939442A (en) | Using character location abnormality recognition method, device, electronic equipment and storage medium | |
| KR20190057613A (en) | System For Golf Playing Management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180126 |