CN105260158B - A kind of audio-frequency processing method and device based on augmented reality - Google Patents
A kind of audio-frequency processing method and device based on augmented reality Download PDFInfo
- Publication number
- CN105260158B CN105260158B CN201510593082.XA CN201510593082A CN105260158B CN 105260158 B CN105260158 B CN 105260158B CN 201510593082 A CN201510593082 A CN 201510593082A CN 105260158 B CN105260158 B CN 105260158B
- Authority
- CN
- China
- Prior art keywords
- audio
- augmented reality
- environmental
- combining
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Circuit For Audible Band Transducer (AREA)
- Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
The present invention relates to audio signal processing technique field more particularly to a kind of audio-frequency processing methods and device based on augmented reality.In the present invention, the audio-frequency processing method based on augmented reality includes：Sampling is carried out to ambient sound and forms environmental audio；Corresponding virtual audio is generated according to environmental parameter；The environmental audio and the virtual audio are combined processing and form combining audio；The combining audio is exported.In the present invention, in terms of augmented reality being applied to the sense of hearing, by the combination of actual environment audio and virtual audio, a reality is established and the interactive scene that is virtually overlapped mutually；After it is combined with traditional augmented reality, not only perfect augmented reality by cognitive range, but also extend the application scenario of augmented reality.
Description
Technical field
The present invention relates to audio signal processing technique field more particularly to a kind of audio-frequency processing methods based on augmented reality
And device.
Background technology
Augmented reality (Augmented Reality, abbreviation AR) is a kind of position calculating camera image in real time
Set and angle and plus respective virtual image technology, the target of this technology is that virtual world is sleeved on real generation on the screen
Boundary simultaneously carries out interaction.Augmented reality not only presents the information of real world, but also virtual information is shown simultaneously
Come, two kinds of information are complementary to one another, are superimposed.In the augmented reality of visualization, user utilizes Helmet Mounted Display, real world and
Computer graphic is multiple to be synthesized together, and the true world can be seen around it.Augmented reality contain multimedia,
The new technologies such as three-dimensional modeling, real-time video show and control, multisensor is fused, real-time tracking and registration, scene fusion with it is new
Means.
Traditional augmented reality both for vision, in terms of the sense of hearing and do not set up one virtually with it is real mutually folded
The interactive scene added causes the application range of augmented reality small, and application scenarios are not perfect.
Invention content
The purpose of the present invention is to provide a kind of audio-frequency processing methods based on augmented reality, it is intended to solve traditional
Augmented reality both for vision, in terms of the sense of hearing and do not set up one virtually with the interactive scene that is overlapped mutually of reality,
Cause the application range of augmented reality small, the incomplete problem of application scenarios.
The invention is realized in this way a kind of audio-frequency processing method based on augmented reality, described existing based on enhancing
The audio-frequency processing method of real technology includes：
Sampling is carried out to ambient sound and forms environmental audio；
Corresponding virtual audio is generated according to environmental parameter；
The environmental audio and the virtual audio are combined processing and form combining audio；
The combining audio is exported.
Further, before the corresponding virtual audio according to environmental parameter generation, the method further includes：
The environmental parameter is simultaneously weighted processing by measuring environment parameter.
Further, the environmental parameter includes：Environment temperature, ambient humidity, the high-frequency ratio of ambient noise and environment are made an uproar
The low frequency ratio of sound.
Further, described the environmental audio and the virtual audio to be combined processing to form combining audio specific
For：
The environmental audio and the virtual audio are subjected to simple time domain additional combining, and carries out simple filtering and goes
Except circuit noise, combining audio is formed.
Further, described the environmental audio and the virtual audio to be combined processing to form combining audio specific
For：
The environmental audio and the virtual audio are subjected to simple frequency domain additional combining, and carries out simple filtering and goes
Except circuit noise, combining audio is formed.
It is described based on increasing another object of the present invention is to provide a kind of apparatus for processing audio based on augmented reality
The apparatus for processing audio of reality technology includes by force：
Audio sample module forms environmental audio for carrying out sampling to ambient sound；
Virtual audio generation module, for generating corresponding virtual audio according to environmental parameter；
Audio combination module forms combination tone for the environmental audio and the virtual audio to be combined processing
Frequently；
Audio output module, for exporting the combining audio.
Further, the apparatus for processing audio based on augmented reality further includes：
Sensor assembly is weighted processing for measuring environment parameter and by the environmental parameter.
Further, the environmental parameter includes：Environment temperature, ambient humidity, the high-frequency ratio of ambient noise and environment are made an uproar
The low frequency ratio of sound.
Further, the audio combination module includes：
Temporal composition unit, for the environmental audio and the virtual audio to be carried out simple time domain additional combining,
And simple filtering removal circuit noise is carried out, form combining audio.
Further, the audio combination module includes：
Frequency domain assembled unit, for the environmental audio and the virtual audio to be carried out simple frequency domain additional combining,
And simple filtering removal circuit noise is carried out, form combining audio.
In the present invention, the audio-frequency processing method based on augmented reality includes：Ambient sound is sampled
Form environmental audio；Corresponding virtual audio is generated according to environmental parameter；The environmental audio and the virtual audio are carried out
Combined treatment forms combining audio；The combining audio is exported.In the present invention, augmented reality is applied into sense of hearing side
Face establishes a reality and the interactive scene that is virtually overlapped mutually by the combination of actual environment audio and virtual audio；It will
After it is combined with traditional augmented reality, not only perfect augmented reality by cognitive range, but also extend increasing
The application scenario of strong reality technology.
Description of the drawings
Fig. 1 is the flow chart for the audio-frequency processing method based on augmented reality that first embodiment of the invention provides；
Fig. 2 is the module map for the apparatus for processing audio based on augmented reality that second embodiment of the invention provides；
Fig. 3 is the module map for the apparatus for processing audio based on augmented reality that third embodiment of the invention provides.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
First embodiment
First embodiment of the invention provides a kind of audio-frequency processing method based on augmented reality.
Fig. 1 shows the flow for the audio-frequency processing method based on augmented reality that first embodiment of the invention provides
Figure.For convenience of description, it illustrates only and the relevant part of the embodiment of the present invention.
A kind of audio-frequency processing method based on augmented reality, includes the following steps：
S1：Sampling is carried out to ambient sound and forms environmental audio；
S2：Corresponding virtual audio is generated according to environmental parameter；
In step s 2, different virtual audios is generated to different grades of environmental parameter and be overlapped.
S3：The environmental audio and the virtual audio are combined processing and form combining audio；
S4：The combining audio is exported.
As one embodiment of the invention, before step S2, the method further includes：Measuring environment parameter simultaneously will be described
Environmental parameter is weighted processing.
As one embodiment of the invention, the environmental parameter includes：The height of environment temperature, ambient humidity, ambient noise
Frequency ratio and the low frequency of ambient noise ratio.
As one embodiment of the invention, step S3 is specially：The environmental audio and the virtual audio are subjected to letter
Single time domain additional combining, and simple filtering removal circuit noise is carried out, form combining audio.
As one embodiment of the invention, step S3 is specially：The environmental audio and the virtual audio are subjected to letter
Single frequency domain additional combining, and simple filtering removal circuit noise is carried out, form combining audio.
Second embodiment
Second embodiment of the invention provides a kind of apparatus for processing audio based on augmented reality.
Fig. 2 shows the module maps for the voiceband facility that second embodiment of the invention provides.For convenience of description, only show
Go out and the relevant part of the embodiment of the present invention.
A kind of apparatus for processing audio based on augmented reality, including：
Audio sample module 1 forms environmental audio for carrying out sampling to ambient sound；
Virtual audio generation module 2, for generating corresponding virtual audio according to environmental parameter；
Audio combination module 3 forms combination tone for the environmental audio and the virtual audio to be combined processing
Frequently；
Audio output module 4, for the combining audio to be exported
As one embodiment of the invention, the apparatus for processing audio based on augmented reality further includes：
Sensor assembly 5 is weighted processing for measuring environment parameter and by the environmental parameter.
As one embodiment of the invention, the environmental parameter includes：The height of environment temperature, ambient humidity, ambient noise
Frequency ratio and the low frequency of ambient noise ratio.
As one embodiment of the invention, audio combination module 3 includes：Temporal composition unit 31 is used for the environment
Audio and the virtual audio carry out simple time domain additional combining, and carry out simple filtering removal circuit noise, formation group
Synaeresis frequency.
3rd embodiment
Third embodiment of the invention provides a kind of apparatus for processing audio based on augmented reality.
Fig. 3 shows the module map for the voiceband facility that third embodiment of the invention provides.For convenience of description, only show
Go out and the relevant part of the embodiment of the present invention.
A kind of apparatus for processing audio based on augmented reality, including：
Audio sample module 1 forms environmental audio for carrying out sampling to ambient sound；
Virtual audio generation module 2, for generating corresponding virtual audio according to environmental parameter；
Audio combination module 3 forms combination tone for the environmental audio and the virtual audio to be combined processing
Frequently；
Audio output module 4, for the combining audio to be exported
As one embodiment of the invention, the apparatus for processing audio based on augmented reality further includes：
Sensor assembly 5 is weighted processing for measuring environment parameter and by the environmental parameter.
As one embodiment of the invention, the environmental parameter includes：The height of environment temperature, ambient humidity, ambient noise
Frequency ratio and the low frequency of ambient noise ratio.
As one embodiment of the invention, audio combination module 3 includes：Frequency domain assembled unit 32 is used for the environment
Audio and the virtual audio carry out simple frequency domain additional combining, and carry out simple filtering removal circuit noise, formation group
Synaeresis frequency.
In the present invention, the audio-frequency processing method based on augmented reality includes：Ambient sound is sampled
Form environmental audio；Corresponding virtual audio is generated according to environmental parameter；The environmental audio and the virtual audio are carried out
Combined treatment forms combining audio；The combining audio is exported.In the present invention, augmented reality is applied into sense of hearing side
Face establishes a reality and the interactive scene that is virtually overlapped mutually by the combination of actual environment audio and virtual audio；It will
After it is combined with traditional augmented reality, not only perfect augmented reality by cognitive range, but also extend increasing
The application scenario of strong reality technology.
One of ordinary skill in the art will appreciate that：The step of realizing above method embodiment or part steps can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in computer read/write memory medium, which exists
When execution, step including the steps of the foregoing method embodiments is executed, and storage medium above-mentioned includes：ROM, RAM, magnetic disc or CD
Etc. the various media that can store program code.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention
All any modification, equivalent and improvement etc., should all be included in the protection scope of the present invention made by within refreshing and principle.
Claims (6)
1. a kind of audio-frequency processing method based on augmented reality, which is characterized in that the sound based on augmented reality
Frequency processing method includes：
Sampling is carried out to ambient sound and forms environmental audio；
The environmental parameter is simultaneously weighted processing by measuring environment parameter；The environmental parameter includes：Environment temperature, environmental wet
The low frequency ratio of degree, the high-frequency ratio of ambient noise and ambient noise；
According to weighting, treated that the environmental parameter generates corresponding virtual audio；Wherein, to the different grades of environment
Parameter generates different virtual audios and is overlapped；
The environmental audio and the virtual audio are combined processing and form combining audio；
The combining audio is exported.
2. the audio-frequency processing method based on augmented reality as described in claim 1, which is characterized in that described by the ring
Border audio is combined processing formation combining audio with the virtual audio：
The environmental audio and the virtual audio are subjected to simple time domain additional combining, and carry out simple filtering removal electricity
Road noise forms combining audio.
3. the audio-frequency processing method based on augmented reality as described in claim 1, which is characterized in that described by the ring
Border audio is combined processing formation combining audio with the virtual audio：
The environmental audio and the virtual audio are subjected to simple frequency domain additional combining, and carry out simple filtering removal electricity
Road noise forms combining audio.
4. a kind of apparatus for processing audio based on augmented reality, which is characterized in that the sound based on augmented reality
Frequency processing device includes：
Audio sample module forms environmental audio for carrying out sampling to ambient sound；
Sensor assembly is weighted processing for measuring environment parameter and by the environmental parameter；The environmental parameter includes：
The low frequency ratio of environment temperature, ambient humidity, the high-frequency ratio of ambient noise and ambient noise；
Virtual audio generation module, for treated that the environmental parameter generates corresponding virtual audio according to weighting；Wherein,
The virtual audio generation module is specifically used for generating different virtual audios to different grades of environmental parameter and being overlapped；
Audio combination module forms combining audio for the environmental audio and the virtual audio to be combined processing；
Audio output module, for exporting the combining audio.
5. the apparatus for processing audio based on augmented reality as claimed in claim 4, which is characterized in that the audio combination
Module includes：
Temporal composition unit is gone forward side by side for the environmental audio and the virtual audio to be carried out simple time domain additional combining
The simple filtering removal circuit noise of row, forms combining audio.
6. the apparatus for processing audio based on augmented reality as claimed in claim 4, which is characterized in that the audio combination
Module includes：
Frequency domain assembled unit is gone forward side by side for the environmental audio and the virtual audio to be carried out simple frequency domain additional combining
The simple filtering removal circuit noise of row, forms combining audio.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510593082.XA CN105260158B (en) | 2015-09-17 | 2015-09-17 | A kind of audio-frequency processing method and device based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510593082.XA CN105260158B (en) | 2015-09-17 | 2015-09-17 | A kind of audio-frequency processing method and device based on augmented reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105260158A CN105260158A (en) | 2016-01-20 |
| CN105260158B true CN105260158B (en) | 2018-09-25 |
Family
ID=55099864
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510593082.XA Active CN105260158B (en) | 2015-09-17 | 2015-09-17 | A kind of audio-frequency processing method and device based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105260158B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3287868B1 (en) * | 2016-08-26 | 2020-10-14 | Nokia Technologies Oy | Content discovery |
| CN108200003B (en) * | 2016-12-08 | 2021-05-28 | 武汉斗鱼网络科技有限公司 | Audio data mixing processing method and device |
| CN107016990B (en) * | 2017-03-21 | 2018-06-05 | 腾讯科技（深圳）有限公司 | Audio signal generation method and device |
| CN107193386B (en) * | 2017-06-29 | 2020-10-27 | 联想(北京)有限公司 | Audio signal processing method and electronic equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101999067A (en) * | 2008-04-18 | 2011-03-30 | 索尼爱立信移动通讯有限公司 | Augmented reality enhanced audio |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6625299B1 (en) * | 1998-04-08 | 2003-09-23 | Jeffrey Meisner | Augmented reality technology |
-
2015
- 2015-09-17 CN CN201510593082.XA patent/CN105260158B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101999067A (en) * | 2008-04-18 | 2011-03-30 | 索尼爱立信移动通讯有限公司 | Augmented reality enhanced audio |
| CN104915979A (en) * | 2014-03-10 | 2015-09-16 | 苏州天魂网络科技有限公司 | System capable of realizing immersive virtual reality across mobile platforms |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105260158A (en) | 2016-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110286773B (en) | Information providing method, device, equipment and storage medium based on augmented reality | |
| TWI713995B (en) | Interactive processing method, device, equipment, client device and electronic equipment for vehicle damage assessment | |
| US10708704B2 (en) | Spatial audio for three-dimensional data sets | |
| CN105260158B (en) | A kind of audio-frequency processing method and device based on augmented reality | |
| KR101773018B1 (en) | Augmented reality based on imaged object characteristics | |
| US11676395B2 (en) | Automated capture of image data for points of interest | |
| CN106066701B (en) | A kind of AR and VR data processing equipment and method | |
| CN107084740B (en) | Navigation method and device | |
| US20170294051A1 (en) | System and method for automated visual content creation | |
| US10791412B2 (en) | Particle-based spatial audio visualization | |
| TWI681364B (en) | Method, device and equipment for generating visual objects | |
| EP2731084A1 (en) | Method for augmented reality | |
| US11887616B2 (en) | Audio processing | |
| US20170364143A1 (en) | System and method for automatically localizing haptic effects on a body | |
| US11532138B2 (en) | Augmented reality (AR) imprinting methods and systems | |
| WO2017207868A1 (en) | An apparatus and associated methods | |
| CN106845435A (en) | A kind of augmented reality Implementation Technology based on material object detection tracing algorithm | |
| JP7439131B2 (en) | Apparatus and related methods for capturing spatial audio | |
| CN111161426B (en) | Panoramic image-based three-dimensional display method and system | |
| CN113997863A (en) | Data processing method and device and vehicle | |
| US11868520B2 (en) | Rendering content | |
| US20190325244A1 (en) | System and method to enable creative playing on a computing device | |
| TWM497315U (en) | A kind perception of touch with the augmented reality functionality and device tags | |
| Nijholt | Perceptual Modifications in Augmented Reality: A Short Survey | |
| WO2019121059A1 (en) | An apparatus and associated methods for presentation of first and second augmented, virtual or mixed reality content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Longgang District of Shenzhen City, Guangdong province 518116 Ping Street Takahashi Industrial Park East Area Applicant after: SHENZHE GUANXU ELECTRONIC CO., LTD. Address before: Longgang District of Shenzhen City, Guangdong province 518116 Ping Street Takahashi Industrial Park East Area Applicant before: Shenzhen Grandsun Electronic Co., Ltd. |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |