CN106535060B - A kind of pick-up control method, audio frequency playing method and device - Google Patents

A kind of pick-up control method, audio frequency playing method and device Download PDF

Info

Publication number
CN106535060B
CN106535060B CN201510583338.9A CN201510583338A CN106535060B CN 106535060 B CN106535060 B CN 106535060B CN 201510583338 A CN201510583338 A CN 201510583338A CN 106535060 B CN106535060 B CN 106535060B
Authority
CN
China
Prior art keywords
audio
user
sound
information
frequency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510583338.9A
Other languages
Chinese (zh)
Other versions
CN106535060A (en
Inventor
刘霖
刘琨
田康
刘聪
唐睿智
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201510583338.9A priority Critical patent/CN106535060B/en
Publication of CN106535060A publication Critical patent/CN106535060A/en
Application granted granted Critical
Publication of CN106535060B publication Critical patent/CN106535060B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Stereophonic System (AREA)

Abstract

The invention discloses a kind of pick-up control method, audio frequency playing method and devices, in pickup, carry out user's simulation, determine sound pick-up and the location information of source of sound relative analog user;Determine the first audio frequency parameter;First audio frequency parameter is for characterizing the time difference information that the audio reaches the analog subscriber or so ear from the sound pick-up;It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain the first audio-frequency information;First audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter;When carrying out audio broadcasting, user current location information is obtained;First audio-frequency information is parsed, the audio signal of sound pick-up acquisition, the location information and the first audio frequency parameter of the sound pick-up relative analog user are obtained;The audio play parameter that above- mentioned information based on acquisition adjusts the audio signal carries out audio broadcasting.

Description

A kind of pick-up control method, audio frequency playing method and device
Technical field
The present invention relates to a kind of multimedia technology field more particularly to pick-up control method, audio frequency playing method and devices.
Background technology
With being constantly progressive for multimedia technology, user increasingly cannot be satisfied the sound quality damage that low bit rate audio coding is brought It loses, and pursues high code check, high-fidelity, stereosonic audio frequency effect.
The characteristics of human ear can perceive the generations such as level difference, time difference, phase difference is utilized in existing stereo equipment, So that user generates sense of space direction to the audio heard, however, since existing stereo equipment is when carrying out audio broadcasting It is not aware that the specific location of user, stereophonic effect can not be restored well.
Therefore it provides the technical solution that a kind of pickup control and audio play, can carry out user's simulation in pickup, and Physical location according to user carries out audio broadcasting, realizes that best sound field is rebuild, improves user experience, it has also become urgently to be resolved hurrily Problem.
Invention content
In view of this, an embodiment of the present invention is intended to provide a kind of pick-up control method, audio frequency playing method and device, it can User's simulation is carried out in pickup, and is played according to the physical location of user control audio, realizes that best sound field is rebuild, improves and use It experiences at family.
In order to achieve the above objectives, the technical solution of the embodiment of the present invention is realized in:
An embodiment of the present invention provides a kind of pick-up control method, the method includes:
User's simulation is carried out, and determines sound pick-up and the location information of source of sound relative analog user;
The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;First sound Frequency parameter is for characterizing the time difference information that the audio reaches the analog subscriber or so ear from the sound pick-up;
It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain First audio-frequency information;First audio-frequency information carries the location information of the sound pick-up relative analog user and first sound Frequency parameter.
In said program, the location information based on the sound pick-up and source of sound relative analog user determines the first audio Parameter includes:
It determines the second audio frequency parameter, and is based on second audio frequency parameter, the sound pick-up and source of sound relative analog user Location information determine the first audio frequency parameter;Wherein, second audio frequency parameter is for characterizing audio from sound source position to described The time difference information of the left and right ear of analog subscriber.
In said program, it is described collected audio signal is handled to obtain the first audio-frequency information include:
Collected audio signal is converted into digital audio and video signals, the position based on the sound pick-up relative analog user Information and first audio frequency parameter encode the digital audio and video signals to obtain the first audio-frequency information, so that described first Audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter.
It is described that collected audio signal is handled after obtaining the first audio-frequency information in said program, the side Method further includes:
It sends first audio-frequency information or first audio-frequency information is stored as audio file.
The embodiment of the present invention additionally provides a kind of audio frequency playing method, obtains the first audio-frequency information, the first audio letter Breath carries the location information and the first audio frequency parameter of sound pick-up relative analog user;First audio frequency parameter is for characterizing audio The time difference information of the analog subscriber or so ear is reached from the sound pick-up;The method further includes:
Audio play instruction is received, user current location information is obtained according to the audio play instruction;
First audio-frequency information is parsed, the audio signal of the sound pick-up acquisition, the sound pick-up relative analog are obtained The location information of user and the first audio frequency parameter;
Relative position information based on user current location information, sound pick-up and analog subscriber and first audio ginseng Number, the audio play parameter for adjusting the audio signal carry out audio broadcasting.
In said program, the first audio-frequency information of the acquisition includes:
It receives the first audio-frequency information or reads the first audio-frequency information in current audio file.
It is described to include according to audio play instruction acquisition user current location information in said program:
User is positioned according to the audio play instruction, obtains user current location information;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction Breath.
In said program, the relative position letter based on the user current location information, sound pick-up and analog subscriber Breath and first audio frequency parameter, the audio play parameter progress audio broadcasting for adjusting the audio signal include:
Relative position information based on the user current location information, sound pick-up and analog subscriber and first audio The audio play parameter of the audio signal is adjusted in parameter, and plays the audio signal after being adjusted, so as to play Audio signal to reach user or so the time difference of ear identical as the value of the first audio frequency parameter;Wherein, the audio plays Parameter is used to characterize the characteristic of the audio signal.
The embodiment of the present invention additionally provides a kind of pickup control device, and described device includes:First determining module, second are really Cover half block and control module;
First determining module for carrying out user's simulation, and determines sound pick-up and the position of source of sound relative analog user Confidence ceases;
Second determining module, for determining based on the location information of the sound pick-up and source of sound relative analog user One audio frequency parameter;First audio frequency parameter reaches the analog subscriber or so ear for characterizing the audio from the sound pick-up Time difference information;
The control module carries out audio signal sample for controlling the sound pick-up to source of sound, and to collected sound Frequency signal is handled to obtain the first audio-frequency information;First audio-frequency information carries the position of the sound pick-up relative analog user Confidence ceases and first audio frequency parameter.
In said program, second determining module is specifically used for determining the second audio frequency parameter, and is based on second sound The location information of frequency parameter, the sound pick-up and source of sound relative analog user determines the first audio frequency parameter;Wherein, second sound Frequency parameter is used to characterize the time difference information of left and right ear of the audio from sound source position to the analog subscriber.
In said program, the control module, specifically for collected audio signal is converted into digital audio and video signals, Location information and first audio frequency parameter based on the sound pick-up relative analog user carry out the digital audio and video signals Coding obtains the first audio-frequency information, so that first audio-frequency information carries the location information of the sound pick-up relative analog user And first audio frequency parameter.
In said program, described device further includes sending module, for sending first audio-frequency information or by described One audio-frequency information is stored as audio file.
The embodiment of the present invention additionally provides a kind of audio playing apparatus, and described device includes:Acquisition module, receiving module, Parsing module and processing module;
The acquisition module, for obtaining the first audio-frequency information, first audio-frequency information carries sound pick-up relative analog The location information of user and the first audio frequency parameter;First audio frequency parameter is for characterizing audio from described in sound pick-up arrival The time difference information of analog subscriber or so ear;
The receiving module obtains user's present bit for receiving audio play instruction according to the audio play instruction Confidence ceases;
The parsing module obtains audio signal, the institute of the sound pick-up acquisition for parsing first audio-frequency information State the location information and the first audio frequency parameter of sound pick-up relative analog user;
The processing module is used for the relative position information based on user current location information, sound pick-up and analog subscriber And first audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting.
In said program, the acquisition module is specifically used for receiving the first audio-frequency information or read in current audio file The first audio-frequency information.
In said program, the receiving module is obtained specifically for being positioned to user according to the audio play instruction Take family current location information;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction Breath.
In said program, the processing module is specifically used for being based on the user current location information, sound pick-up and simulation The audio play parameter of the audio signal is adjusted in the relative position information of user and first audio frequency parameter, and broadcasts The audio signal after being adjusted is put, so that the audio signal played reaches user or so the time difference of ear and first audio The value of parameter is identical;Wherein, the audio play parameter is used to characterize the characteristic of the audio signal.
Pick-up control method, audio frequency playing method and the device that the embodiment of the present invention is provided carry out user in pickup Simulation, and determine sound pick-up and the location information of source of sound relative analog user;It is used based on the sound pick-up and source of sound relative analog The location information at family determines the first audio frequency parameter;First audio frequency parameter is for characterizing audio from described in sound pick-up arrival The time difference information of analog subscriber or so ear;It controls the sound pick-up and audio signal sample is carried out to source of sound, and to collecting Audio signal handled to obtain the first audio-frequency information;First audio-frequency information carries the sound pick-up relative analog user Location information and first audio frequency parameter;When carrying out audio broadcasting, user's present bit is obtained according to audio play instruction Confidence ceases;It parses first audio-frequency information, obtains the audio signal of sound pick-up acquisition, the sound pick-up relative analog user Location information and the first audio frequency parameter;Relative position information based on user current location information, sound pick-up and analog subscriber and First audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting;In this way, by carrying out user Simulation determines that the relative position information and audio of user and sound pick-up when user is in best sound field reach institute from the sound pick-up The time difference information of analog subscriber or so ear is stated, and audio signal is adjusted based on the relative position information and time difference information Audio play parameter, to realize that best sound field is rebuild, improves user experience.
Description of the drawings
Fig. 1 is pick-up control method flow diagram of the embodiment of the present invention;
Fig. 2 is that user of the embodiment of the present invention simulates schematic diagram;
Fig. 3 is audio frequency playing method flow diagram of the embodiment of the present invention;
Fig. 4 is that audio of the embodiment of the present invention plays schematic diagram of a scenario;
Fig. 5 is pickup control device composed structure schematic diagram of the embodiment of the present invention;
Fig. 6 is audio playing apparatus composed structure schematic diagram of the embodiment of the present invention.
Specific implementation mode
In embodiments of the present invention, in pickup, user's simulation is carried out, and determine sound pick-up and source of sound relative analog user Location information;The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;Described One audio frequency parameter is for characterizing the time difference information that audio reaches the analog subscriber or so ear from the sound pick-up;Control institute It states sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain the first audio-frequency information; First audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter;Carry out When audio plays, user current location information is obtained according to audio play instruction;First audio-frequency information is parsed, pickup is obtained The audio signal of device acquisition, the location information and the first audio frequency parameter of the sound pick-up relative analog user;It is current based on user Location information, the relative position information of sound pick-up and analog subscriber and first audio frequency parameter, adjust the audio signal Audio play parameter carries out audio broadcasting;The audio play parameter is used to characterize the characteristic of the audio signal.
Embodiment one
Fig. 1 show one pick-up control method flow diagram of the embodiment of the present invention, as shown in Figure 1, the embodiment of the present invention Pick-up control method includes:
Step 101:User's simulation is carried out, and determines sound pick-up and the location information of source of sound relative analog user;
Here, the sound pick-up at least one, in one embodiment, there are two the sound pick-ups, two sound pick-ups it Between distance can empirically be worth and set;
Source of sound when carrying out audio collection at least one, but when the source of sound when carrying out audio collection has multiple, institute The location information for stating source of sound relative analog user is the location information of the crucial sounding point relative analog user in multiple sources of sound, if When in the multiple source of sound without key sounding point, the position of the source of sound relative analog user is empirically worth determination.
In one embodiment, the progress user, which simulates, includes:
Pickup control device carries out user's simulation according to the position relationship of preset analog subscriber and sound pick-up, so that described Analog subscriber is in best sound field, and then hears that effect is the most true stereo;Wherein, the preset analog subscriber with The position relationship of sound pick-up can empirically be worth determination, such as:When sound pick-up there are two when, analog subscriber is located at two sound pick-ups Perpendicular bisector on and away from sound pick-up vertical range be three meters of place, be illustrated in figure 2 user and simulate schematic diagram.
Further, the determining sound pick-up and the location information of source of sound relative analog user include:
Using the position for carrying out the analog subscriber after user's simulation as reference position, determine current sound pick-up and source of sound relative to The relative position information of the reference position is sound pick-up and the location information of source of sound relative analog user;
In embodiments of the present invention, the sound pick-up includes two, respectively sound pick-up 1 and sound pick-up 2, it is assumed that simulation is used The position at family is coordinate origin (0,0), then the coordinate position of analog subscriber or so ear respectively (t, 0), (- t, 0), sound pick-up 1, The position of 2 relative analog users is respectively (- x, y), (x, y), and the position of source of sound relative analog user is (p, q), such as Fig. 2 institutes Show;Wherein, t values can empirically be worth and be set.
Step 102:The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;
Here, first audio frequency parameter reaches the analog subscriber or so ear for characterizing audio from the sound pick-up Time difference information;
In order to ensure that the analog subscriber is in best sound field, that is, hears best stereo of effect, need to ensure audio The time difference that the analog subscriber or so ear is reached from the sound source position reaches institute from source of sound with audio through the sound pick-up The time difference for stating analog subscriber or so ear is identical;In embodiments of the present invention, it is Δ to enable first audio frequency parameter, based on picking up Sound device 2 can be obtained according to Fig. 2:(n-m)/v=(e+c)/v+ Δs-(b+d)/v can be obtained due to d=e:Δ=(n-m+b-c)/v; (1), wherein n, m are respectively distance of the source of sound to the analog subscriber or so ear, and d is sound pick-up 1 to the distance of user's auris dextra, e It is sound pick-up 2 to the distance of the left ear of user, b, c are respectively distance of the source of sound to sound pick-up 1,2, and v is voice transmission speed;I.e.:
The first audio frequency parameter value can be obtained according to (2) formula, i.e. audio reaches the analog subscriber or so ear from the sound pick-up Time difference, and sound field rebuild, i.e., when the audio collected being played out, audio quilt of the audio as a certain sound channel Audio playing apparatus plays, and need to only ensure that audio reaches the time difference of user or so ear and audio from institute from audio playing apparatus State sound pick-up reach the analog subscriber or so ear time difference it is identical, user can hear best stereo of effect.
Step 103:It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is carried out Processing obtains the first audio-frequency information;
Here, it is described collected audio signal is handled to obtain the first audio-frequency information include:
Collected audio signal is converted into digital audio and video signals, the position based on the sound pick-up relative analog user Information and first audio frequency parameter encode the digital audio and video signals to obtain the first audio-frequency information, so that described first Audio-frequency information carries the location information of the sound pick-up relative analog user and first audio frequency parameter;
Wherein, it is described collected audio signal is converted into digital audio and video signals after, the method can also include: Denoising is filtered to transformed digital audio and video signals, to improve audio quality.
In one embodiment, after this step, the method further includes:Send first audio-frequency information or by described One audio-frequency information is stored as audio file;
Wherein, transmission first audio-frequency information includes:Pickup control device is by first audio-frequency information with code The form of stream is sent to audio playing apparatus, so that the audio playing apparatus plays after handling it;Therefore, the pickup control Device processed can be both individually present, and can also be integrated with the audio playing apparatus;
It is described first audio-frequency information is stored as audio file to include:First audio-frequency information is burned onto record Disk generates audio file;Or first audio-frequency information is stored in the form of audio file to memory;The memory It can be mobile memory.
Embodiment two
Fig. 3 is audio frequency playing method flow diagram of the embodiment of the present invention, as shown in figure 3, audio of the embodiment of the present invention is broadcast The method of putting includes:
Step 300:Obtain the first audio-frequency information;
Here, first audio-frequency information is to be obtained after pickup control device handles collected audio signal Audio-frequency information;First audio-frequency information carries the location information and the first audio frequency parameter of sound pick-up relative analog user;It is described First audio frequency parameter is for characterizing the time difference information that audio reaches the analog subscriber or so ear from the sound pick-up.
In one embodiment, the first audio-frequency information of the acquisition includes:
It receives the first audio-frequency information or reads the first audio-frequency information in current audio file;
Wherein, the first audio-frequency information of the reception includes:Receive the first sound that pickup control device is sent in the form of code stream Frequency information;Correspondingly, after audio playing apparatus receives first audio-frequency information, the method can also include:The sound First audio-frequency information that the storage of frequency playing device receives;In this way, the follow-up audio playing apparatus is repeatable to play the sound Frequency is received without repeating;
The first audio-frequency information in the reading current audio file includes:It directly reads memory or records and stored in disk First audio-frequency information existing in the form of audio file.
Step 301:Audio play instruction is received, user current location information is obtained according to the audio play instruction;
Here, the audio play instruction can be key command or the phonetic order etc. that user sends;
It is described to include according to audio play instruction acquisition user current location information:
User is positioned according to the audio play instruction, obtains user current location information;Such as:The audio Play instruction is phonetic order, can be based on phase difference to sound source, i.e. user positions;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction Breath.
Step 302:First audio-frequency information is parsed, the audio signal of the sound pick-up acquisition, the sound pick-up are obtained The location information of relative analog user and the first audio frequency parameter;
Here, since pickup control device has been mixed into the pickup when handling the audio signal that sound pick-up acquires The location information and the first audio frequency parameter of device relative analog user to get to first audio-frequency information carry sound pick-up it is opposite The location information of analog subscriber and the first audio frequency parameter, therefore, audio playing apparatus can by decoding first audio-frequency information To obtain the audio signal of the sound pick-up acquisition, the location information of the sound pick-up relative analog user and the first audio ginseng Number.
Step 303:Relative position information based on user current location information, sound pick-up and analog subscriber and described first Audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting;
Here, the audio play parameter is used to characterize the characteristic of the audio signal, such as:Phase, frequency, loudness etc..
In one embodiment, this step specifically includes:Based on the user current location information, sound pick-up and analog subscriber Relative position information and first audio frequency parameter audio play parameter of the audio signal is adjusted, and play into Audio signal after row adjusting, so that the audio signal played reaches user or so the time difference of ear and first audio frequency parameter Value it is identical;
Audio playing apparatus of the present invention includes at least two players, because for stereo sound field, at least Need the player of two separate channels;
In embodiments of the present invention, the audio playing apparatus includes two players, respectively player 1 and player 2, as shown in figure 4, being based on player 2, according to the relative position information of sound pick-up and analog subscriber, the position of analog subscriber is enabled to sit It is designated as (0,0), the position coordinates of the relatively described analog subscriber of the player 2 are (x, y), due in practical applications, playing Device 1 between player 2 at a distance from it is not necessarily equal at a distance from sound pick-up 2 with sound pick-up 1, therefore, enable player 1 relatively described The position coordinates of analog subscriber are (i, j), and the position coordinates for the relatively described analog subscriber of ear of assuming active user or so be (- W ,-f), (- z ,-f);
Since the time difference that the audio signal of broadcasting reaches user or so ear need to be identical as the value of the first audio frequency parameter, Analog subscriber or so the time difference of ear to be reached from sound pick-up identical with audio when carrying out user's simulation;Based on player 2, when broadcasting Put device 1 between player 2 at a distance from it is equal at a distance from sound pick-up 2 with sound pick-up 1 when, player 1 is relative to analog subscriber Position coordinates are (- x, y), therefore, Δ=g/v+ Δs1- h/v, wherein g is distance of the player 2 to the left ear of user, and h is to play Device 1 to user's auris dextra distance;And then
It adjusts player 2 and carries out the slow Δ of audio Playout delay1
When at a distance from player 1 is between player 2 with sound pick-up 1 and unequal at a distance from sound pick-up 2, i.e. player 1 When coordinate position is different from the coordinate position of sound pick-up 1, it is equivalent to audio when carrying out user's simulation and reaches simulation use from sound pick-up The time difference of family or so ear is changed, and then obtains, Δ+e/v-d '/v=g/v+ Δs2- h/v, i.e. Δ2=Δ+e/v-d '/v-g/ V+h/v,
It adjusts player 2 and carries out the slow Δ of audio Playout delay2
It should be noted that the calculating of the embodiment of the present invention is all based on player 2, and optionally, the calculation based on player 1 Method is identical.
Embodiment three
Fig. 5 is pickup control device composed structure schematic diagram of the embodiment of the present invention;As shown in figure 5, the embodiment of the present invention is picked up Sound control device includes:First determining module 51, the second determining module 52 and control module 53;
First determining module 51 for carrying out user's simulation, and determines sound pick-up and source of sound relative analog user Location information;
Second determining module 52, for being determined based on the sound pick-up and the location information of source of sound relative analog user First audio frequency parameter;First audio frequency parameter reaches described analog subscriber or so for characterizing the audio from the sound pick-up The time difference information of ear;
The control module 53 carries out audio signal sample for controlling the sound pick-up to source of sound, and to collected Audio signal is handled to obtain the first audio-frequency information;First audio-frequency information carries the sound pick-up relative analog user's Location information and first audio frequency parameter;
Here, the sound pick-up at least one, in one embodiment, there are two the sound pick-ups, two sound pick-ups it Between distance can empirically be worth and set;
Source of sound when carrying out audio collection at least one, but when the source of sound when carrying out audio collection has multiple, institute The location information for stating source of sound relative analog user is the location information of the crucial sounding point relative analog user in multiple sources of sound, if When in the multiple source of sound without key sounding point, the position of the source of sound relative analog user is empirically worth determination.
In one embodiment, first determining module 51 is specifically used for according to preset analog subscriber and sound pick-up Position relationship carries out user's simulation, so that the analog subscriber is in best sound field, and then hears that effect is the most really stood Body sound;Wherein, the position relationship of the preset analog subscriber and sound pick-up can empirically be worth determination, such as:Work as sound pick-up There are two when, analog subscriber be located on the perpendicular bisector of two sound pick-ups and be three meters away from sound pick-up vertical range place, such as Fig. 2 It show user and simulates schematic diagram.
In one embodiment, first determining module 51, specifically for carry out the analog subscriber after user's simulation Position is reference position, determine current sound pick-up and source of sound relative to the reference position relative position information be sound pick-up and The location information of source of sound relative analog user;
In embodiments of the present invention, the sound pick-up includes two, respectively sound pick-up 1 and sound pick-up 2, it is assumed that simulation is used The position at family is coordinate origin (0,0), then the coordinate position of analog subscriber or so ear respectively (t, 0), (- t, 0), sound pick-up 1, The position of 2 relative analog users is respectively (- x, y), (x, y), and the position of source of sound relative analog user is (p, q), such as Fig. 2 institutes Show;Wherein, t values can empirically be worth and be set.
In one embodiment, second determining module 52 is specifically used for determining the second audio frequency parameter, and based on described the The location information of two audio frequency parameters, the sound pick-up and source of sound relative analog user determines the first audio frequency parameter;Wherein, described Two audio frequency parameters are used to characterize the time difference information of left and right ear of the audio from sound source position to the analog subscriber;
In order to ensure that the analog subscriber is in best sound field, that is, hears best stereo of effect, need to ensure audio The time difference that the analog subscriber or so ear is reached from the sound source position reaches institute from source of sound with audio through the sound pick-up The time difference for stating analog subscriber or so ear is identical;In embodiments of the present invention, it is Δ to enable first audio frequency parameter, based on picking up Sound device 2 can be obtained according to Fig. 2:(n-m)/v=(e+c)/v+ Δs-(b+d)/v can be obtained due to d=e:Δ=(n-m+b-c)/v; (1), wherein n, m are respectively distance of the source of sound to the analog subscriber or so ear, and d is sound pick-up 1 to the distance of user's auris dextra, e It is sound pick-up 2 to the distance of the left ear of user, b, c are respectively distance of the source of sound to sound pick-up 1,2, and v is voice transmission speed;I.e.:
The first audio frequency parameter value can be obtained according to (2) formula, i.e. audio reaches the analog subscriber or so ear from the sound pick-up Time difference, and sound field rebuild, i.e., when the audio collected being played out, audio quilt of the audio as a certain sound channel Audio playing apparatus plays, and need to only ensure that audio reaches the time difference of user or so ear and audio from institute from audio playing apparatus State sound pick-up reach the analog subscriber or so ear time difference it is identical, user can hear best stereo of effect.
In one embodiment, the control module 53, specifically for collected audio signal is converted into digital audio Signal, location information and first audio frequency parameter based on the sound pick-up relative analog user are to the digital audio and video signals It is encoded to obtain the first audio-frequency information, so that first audio-frequency information carries the position of the sound pick-up relative analog user Information and first audio frequency parameter.
Further, the control module 53 is additionally operable to be filtered denoising to transformed digital audio and video signals, To improve audio quality.
In one embodiment, described device further includes sending module 54, for sending first audio-frequency information or by institute It states the first audio-frequency information and is stored as audio file.
In one embodiment, the sending module 54 is specifically used for sending out first audio-frequency information in the form of code stream It send to audio playing apparatus, so that the audio playing apparatus plays after handling it;
And for first audio-frequency information to be burned onto record disk, generate audio file;Or by first audio Information is stored in the form of audio file to memory.
It should be noted that pickup control device described in the embodiment of the present invention can be both individually present, it also can be with the audio Playing device integrates.
Example IV
Fig. 6 is audio playing apparatus composed structure schematic diagram of the embodiment of the present invention;As shown in fig. 6, sound of the embodiment of the present invention Frequency playing device includes:Acquisition module 61, receiving module 62, parsing module 63 and processing module 64;
The acquisition module 61, for obtaining the first audio-frequency information, first audio-frequency information carries sound pick-up with respect to mould The location information and the first audio frequency parameter of quasi- user;First audio frequency parameter reaches institute for characterizing audio from the sound pick-up State the time difference information of analog subscriber or so ear;
It is current to obtain user for receiving audio play instruction according to the audio play instruction for the receiving module 62 Location information;
The parsing module 63, for parsing first audio-frequency information, obtain the sound pick-up acquisition audio signal, The location information and the first audio frequency parameter of the sound pick-up relative analog user;
The processing module 64, for the relative position letter based on user current location information, sound pick-up and analog subscriber Breath and first audio frequency parameter, the audio play parameter for adjusting the audio signal carry out audio broadcasting.
In one embodiment, the acquisition module 61 is specifically used for receiving the first audio-frequency information or reads present video text The first audio-frequency information in part.
Further, the acquisition module 61 is specifically used for receiving pickup control device is sent in the form of code stream first Audio-frequency information stores first audio-frequency information, or directly reads memory or record the shape with audio file stored in disk First audio-frequency information existing for formula.
In one embodiment, the receiving module 62, specifically for determining user according to the audio play instruction Position obtains user current location information;Such as:The audio play instruction is phonetic order, and the receiving module 62 is based on phase Potential difference positions sound source, i.e. user;
Alternatively, being parsed to the audio play instruction, extracts user current location in the audio play instruction and believe Breath;
Alternatively, being believed as user current location using the location information of the analog subscriber according to the audio play instruction Breath;
Here, the audio play instruction can be key command or the phonetic order etc. that user sends.
In one embodiment, described device further includes player 65, correspondingly, the processing module 64, is specifically used for base In the relative position information of the user current location information, sound pick-up and analog subscriber and first audio frequency parameter to described The audio play parameter of audio signal is adjusted, and plays the audio signal after being adjusted by player 65, so as to broadcast It is identical as the value of the first audio frequency parameter that the audio signal put reaches user or so the time difference of ear;Wherein, the audio is broadcast Put characteristic of the parameter for characterizing the audio signal;
Here, the characteristic of the audio signal can be phase, frequency, loudness etc..
Audio playing apparatus of the present invention includes at least two players, because for stereo sound field, at least Need the player of two separate channels;
In embodiments of the present invention, the audio playing apparatus includes two players, respectively player 1 and player 2, as shown in figure 4, being based on player 2, according to the relative position information of sound pick-up and analog subscriber, the position of analog subscriber is enabled to sit It is designated as (0,0), the position coordinates of the relatively described analog subscriber of the player 2 are (x, y), due in practical applications, playing Device 1 between player 2 at a distance from it is not necessarily equal at a distance from sound pick-up 2 with sound pick-up 1, therefore, enable player 1 relatively described The position coordinates of analog subscriber are (i, j), and the position coordinates for the relatively described analog subscriber of ear of assuming active user or so be (- W ,-f), (- z ,-f);
Since the time difference that the audio signal of broadcasting reaches user or so ear need to be identical as the value of the first audio frequency parameter, Analog subscriber or so the time difference of ear to be reached from sound pick-up identical with audio when carrying out user's simulation;Based on player 2, when broadcasting Put device 1 between player 2 at a distance from it is equal at a distance from sound pick-up 2 with sound pick-up 1 when, player 1 is relative to analog subscriber Position coordinates are (- x, y), therefore, Δ=g/v+ Δs1- h/v, wherein g is distance of the player 2 to the left ear of user, and h is to play Device 1 to user's auris dextra distance;And then:
I.e. Δ is calculated according to above-mentioned formula in the processing module 641, and control player 2 and carry out audio Playout delay Slow Δ1
When at a distance from player 1 is between player 2 with sound pick-up 1 and unequal at a distance from sound pick-up 2, i.e. player 1 When coordinate position is different from the coordinate position of sound pick-up 1, it is equivalent to audio when carrying out user's simulation and reaches simulation use from sound pick-up The time difference of family or so ear is changed, and then obtains, Δ+e/v-d '/v=g/v+ Δs2- h/v, i.e. Δ2=Δ+e/v-d '/v-g/ V+h/v,
I.e. Δ is calculated according to above-mentioned formula in the processing module 642, and control player 2 and carry out audio Playout delay Slow Δ2
It should be noted that the calculating of processing module 64 described in the embodiment of the present invention is all based on player 2, optionally, Algorithm based on player 1 is identical;In practical applications, the audio playing apparatus can be stereo set, such as speaker;
In embodiments of the present invention, the first determining module 51 in the pickup control device, the second determining module, control Module 53 and sending module 54, the acquisition module 61, receiving module 62, parsing module 63 in the audio playing apparatus and processing Module 64 can be by the central processing unit (CPU, Central Processing Unit) or digital signal in terminal or server Processor (DSP, Digital Signal Processor) or field programmable gate array (FPGA, Field Programmable Gate Array) or integrated circuit (ASIC, Application Specific Integrated Circuit it) realizes.
The above, only present pre-ferred embodiments, are not intended to limit the scope of the present invention.

Claims (16)

1. a kind of pick-up control method, which is characterized in that the method includes:
User's simulation is carried out, and determines sound pick-up and the location information of source of sound relative analog user;
The first audio frequency parameter is determined based on the location information of the sound pick-up and source of sound relative analog user;The first audio ginseng Number reaches the time difference information of the analog subscriber or so ear for characterizing audio from the sound pick-up;
It controls the sound pick-up and audio signal sample is carried out to source of sound, and collected audio signal is handled to obtain first Audio-frequency information;First audio-frequency information carries the location information and first audio ginseng of the sound pick-up relative analog user Number;
Wherein, the time difference of left and right ear of the audio from sound source position to the analog subscriber and the first audio frequency parameter phase Together.
2. method according to claim 1, which is characterized in that described based on the sound pick-up and source of sound relative analog user Location information determines that the first audio frequency parameter includes:
Determine the second audio frequency parameter, and based on the position of second audio frequency parameter, the sound pick-up and source of sound relative analog user Confidence breath determines the first audio frequency parameter;Wherein, second audio frequency parameter is for characterizing audio from sound source position to the simulation The time difference information of the left and right ear of user.
3. method according to claim 1 or claim 2, which is characterized in that described to be handled to obtain to collected audio signal First audio-frequency information includes:
Collected audio signal is converted into digital audio and video signals, the location information based on the sound pick-up relative analog user And first audio frequency parameter encodes the digital audio and video signals to obtain the first audio-frequency information, so that first audio Information carries the location information of the sound pick-up relative analog user and first audio frequency parameter.
4. method according to claim 1 or claim 2, which is characterized in that described to be handled to obtain to collected audio signal After first audio-frequency information, the method further includes:
It sends first audio-frequency information or first audio-frequency information is stored as audio file.
5. a kind of audio frequency playing method, which is characterized in that obtain the first audio-frequency information, first audio-frequency information carries sound pick-up The location information of relative analog user and the first audio frequency parameter;First audio frequency parameter is for characterizing audio from the sound pick-up Reach the time difference information of the analog subscriber or so ear;The method further includes:
Audio play instruction is received, user current location information is obtained according to the audio play instruction;
First audio-frequency information is parsed, the audio signal of the sound pick-up acquisition, the sound pick-up relative analog user are obtained Location information and the first audio frequency parameter;
Relative position information based on user current location information, sound pick-up and analog subscriber and first audio frequency parameter are adjusted The audio play parameter for saving the audio signal carries out audio broadcasting so that the audio signal of broadcasting reach user or so ear when Between difference it is identical as first audio frequency parameter.
6. method according to claim 5, which is characterized in that the first audio-frequency information of the acquisition includes:
It receives the first audio-frequency information or reads the first audio-frequency information in current audio file.
7. according to claim 5 or 6 the methods, which is characterized in that described to work as according to audio play instruction acquisition user Front position information includes:
User is positioned according to the audio play instruction, obtains user current location information;
Alternatively, being parsed to the audio play instruction, user current location information in the audio play instruction is extracted;
Alternatively, according to the audio play instruction using the location information of the analog subscriber as user current location information.
8. according to claim 5 or 6 the methods, which is characterized in that described based on the user current location information, sound pick-up Relative position information with analog subscriber and first audio frequency parameter, the audio play parameter for adjusting the audio signal carry out Audio plays:
Relative position information based on the user current location information, sound pick-up and analog subscriber and first audio frequency parameter The audio play parameter of the audio signal is adjusted, and plays the audio signal after being adjusted, so that the sound played It is identical as the value of the first audio frequency parameter that frequency signal reaches user or so the time difference of ear;Wherein, the audio play parameter Characteristic for characterizing the audio signal.
9. a kind of pickup control device, which is characterized in that described device includes:First determining module, the second determining module and control Molding block;
First determining module for carrying out user's simulation, and determines sound pick-up and the position letter of source of sound relative analog user Breath;
Second determining module, for determining the first sound based on the location information of the sound pick-up and source of sound relative analog user Frequency parameter;First audio frequency parameter is for characterizing the time difference that audio reaches the analog subscriber or so ear from the sound pick-up Value information;
The control module carries out audio signal sample to source of sound for controlling the sound pick-up, and believes collected audio It number is handled to obtain the first audio-frequency information;First audio-frequency information carries the position letter of the sound pick-up relative analog user Breath and first audio frequency parameter;
Wherein, the time difference of left and right ear of the audio from sound source position to the analog subscriber and the first audio frequency parameter phase Together.
10. device according to claim 9, which is characterized in that second determining module is specifically used for determining the second audio Parameter, and the first sound is determined based on the location information of second audio frequency parameter, the sound pick-up and source of sound relative analog user Frequency parameter;Wherein, second audio frequency parameter be used for characterize left and right ear of the audio from sound source position to the analog subscriber when Between difference information.
11. according to claim 9 or 10 described devices, which is characterized in that the control module is specifically used for collected sound Frequency signal is converted into digital audio and video signals, the location information based on the sound pick-up relative analog user and first audio ginseng It is several that the digital audio and video signals are encoded to obtain the first audio-frequency information, so that first audio-frequency information carries the pickup The location information of device relative analog user and first audio frequency parameter.
12. according to claim 9 or 10 described devices, which is characterized in that described device further includes sending module, for sending It states the first audio-frequency information or first audio-frequency information is stored as audio file.
13. a kind of audio playing apparatus, which is characterized in that described device includes:Acquisition module, receiving module, parsing module and Processing module;
The acquisition module, for obtaining the first audio-frequency information, first audio-frequency information carries sound pick-up relative analog user Location information and the first audio frequency parameter;First audio frequency parameter reaches the simulation for characterizing audio from the sound pick-up The time difference information of user or so ear;
The receiving module obtains user current location letter for receiving audio play instruction according to the audio play instruction Breath;
The parsing module obtains the audio signal of the sound pick-up acquisition, described picks up for parsing first audio-frequency information The location information and the first audio frequency parameter of sound device relative analog user;
The processing module is used for the relative position information based on user current location information, sound pick-up and analog subscriber and institute The first audio frequency parameter is stated, the audio play parameter for adjusting the audio signal carries out audio broadcasting so that the audio signal of broadcasting It is identical as first audio frequency parameter to reach user or so the time difference of ear.
14. according to claim 13 described device, which is characterized in that the acquisition module is specifically used for receiving the first audio letter The first audio-frequency information in breath or reading current audio file.
15. according to claim 13 or 14 described devices, which is characterized in that the receiving module is specifically used for according to the sound Frequency play instruction positions user, obtains user current location information;
Alternatively, being parsed to the audio play instruction, user current location information in the audio play instruction is extracted;
Alternatively, according to the audio play instruction using the location information of the analog subscriber as user current location information.
16. according to claim 13 or 14 described devices, which is characterized in that the processing module is specifically used for being based on the use Family current location information, the relative position information of sound pick-up and analog subscriber and first audio frequency parameter are to the audio signal Audio play parameter be adjusted, and play be adjusted after audio signal so that play audio signal reach user The time difference of left and right ear is identical as the value of the first audio frequency parameter;Wherein, the audio play parameter is for characterizing the sound The characteristic of frequency signal.
CN201510583338.9A 2015-09-14 2015-09-14 A kind of pick-up control method, audio frequency playing method and device Active CN106535060B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510583338.9A CN106535060B (en) 2015-09-14 2015-09-14 A kind of pick-up control method, audio frequency playing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510583338.9A CN106535060B (en) 2015-09-14 2015-09-14 A kind of pick-up control method, audio frequency playing method and device

Publications (2)

Publication Number Publication Date
CN106535060A CN106535060A (en) 2017-03-22
CN106535060B true CN106535060B (en) 2018-08-10

Family

ID=58349036

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510583338.9A Active CN106535060B (en) 2015-09-14 2015-09-14 A kind of pick-up control method, audio frequency playing method and device

Country Status (1)

Country Link
CN (1) CN106535060B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106954125A (en) * 2017-03-29 2017-07-14 联想(北京)有限公司 Information processing method and audio frequency apparatus
CN107968974A (en) * 2017-12-07 2018-04-27 北京小米移动软件有限公司 Microphone control method, system, microphone and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1991011079A1 (en) * 1990-01-19 1991-07-25 Sony Corporation Apparatus for reproducing acoustic signals
CN101583064A (en) * 2009-06-26 2009-11-18 电子科技大学 Micro audio directional loudspeaker with three dimension soundeffect
CN102804806A (en) * 2009-06-23 2012-11-28 诺基亚公司 Method and apparatus for processing audio signals
CN103796150A (en) * 2012-10-30 2014-05-14 华为技术有限公司 Processing method, device and system of audio signals
CN104125524A (en) * 2013-04-23 2014-10-29 华为技术有限公司 Sound effect adjustment method, apparatus and devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1991011079A1 (en) * 1990-01-19 1991-07-25 Sony Corporation Apparatus for reproducing acoustic signals
CN102804806A (en) * 2009-06-23 2012-11-28 诺基亚公司 Method and apparatus for processing audio signals
CN101583064A (en) * 2009-06-26 2009-11-18 电子科技大学 Micro audio directional loudspeaker with three dimension soundeffect
CN103796150A (en) * 2012-10-30 2014-05-14 华为技术有限公司 Processing method, device and system of audio signals
CN104125524A (en) * 2013-04-23 2014-10-29 华为技术有限公司 Sound effect adjustment method, apparatus and devices

Also Published As

Publication number Publication date
CN106535060A (en) 2017-03-22

Similar Documents

Publication Publication Date Title
JP6883636B2 (en) Metadata for ducking control
KR101844388B1 (en) Systems and methods for delivery of personalized audio
US20130003981A1 (en) Calibration of Headphones to Improve Accuracy of Recorded Audio Content
CN106535059B (en) Rebuild stereosonic method and speaker and position information processing method and sound pick-up
EP2926572A1 (en) Collaborative sound system
CN104981869A (en) Signaling audio rendering information in a bitstream
US9756437B2 (en) System and method for transmitting environmental acoustical information in digital audio signals
CN108616800A (en) Playing method and device, storage medium, the electronic device of audio
CN103618986A (en) Sound source acoustic image body extracting method and device in 3D space
US9373335B2 (en) Processing audio objects in principal and supplementary encoded audio signals
KR20160061315A (en) Method for processing of sound signals
CN106535060B (en) A kind of pick-up control method, audio frequency playing method and device
CN109117110B (en) Data processing method and device for dynamic voice fusion
CN103347199A (en) Method and system for voice frequency live broadcast
CN105392088A (en) Wireless connection sound system
KR102534802B1 (en) Multi-channel binaural recording and dynamic playback
CN104506588B (en) A kind of method and device for the mobile rehearsal for realizing band
JP6988889B2 (en) Voice processing device and voice processing method
CN112346694B (en) Display device
CN208861661U (en) A kind of audio collecting device
CN104200827B (en) Method and device for obtaining internet audio file
CN105979468A (en) Audio frequency processing method and device
JP6321514B2 (en) Audio output control apparatus and audio output control method
CN108932953A (en) A kind of audio balance function determines method, audio equalizing method and equipment
JP6564489B2 (en) Acoustic signal processing device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant