CN112637755A - Audio playing control method, device and playing system based on wireless connection - Google Patents
Audio playing control method, device and playing system based on wireless connection Download PDFInfo
- Publication number
- CN112637755A CN112637755A CN202011524634.9A CN202011524634A CN112637755A CN 112637755 A CN112637755 A CN 112637755A CN 202011524634 A CN202011524634 A CN 202011524634A CN 112637755 A CN112637755 A CN 112637755A
- Authority
- CN
- China
- Prior art keywords
- audio playing
- user
- audio
- head
- wireless
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/307—Frequency adjustment, e.g. tone control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/14—Direct-mode setup
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Computer Networks & Wireless Communication (AREA)
- Stereophonic System (AREA)
Abstract
The invention discloses an audio playing control method, an audio playing control device and an audio playing control system based on wireless connection, wherein the method comprises the following steps: the audio playing controller establishes wireless connection with the wireless audio playing device; the audio playing controller receives the deflection angle of the head of the user collected by the wireless audio playing equipment in real time; the audio playing controller calculates the relative position coordinates of the head of the user in the coordinate system based on the deflection angle; updating the head-related transformation function based on the current relative position coordinates of the head of the user; extracting corresponding audio data to be played from a playing buffer area in an audio playing controller; superposing the audio data to be played by adopting frequency domain synthesis based on the updated head related transformation function; and transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection. In the embodiment of the invention, when the user changes the shaking head, the corresponding parameters can be automatically adjusted, and the optimal playing sound effect can be realized.
Description
Technical Field
The invention relates to the technical field of audio playing control, in particular to an audio playing control method, an audio playing control device and an audio playing control system based on wireless connection.
Background
The current common stereo playback technology, surround sound effect, is common in the sound systems of commercial cinema and home cinema; simply speaking, the surround sound is that sound generating devices are placed in different directions of a person, so that a listener can distinguish sounds from all directions, and the stereo and reality sense of the sounds is increased; the existing stereo system generally relies on that a plurality of sound boxes are arranged in a space to simulate an actual sound field, the requirement on the position of the sound box arrangement is high, the stereo system is large in size and not suitable for being carried by a user, and the user cannot experience the optimal stereo sound effect in real time in a portable wireless earphone playing system.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and provides an audio playing control method, an audio playing control device and an audio playing control system based on wireless connection, so that a user can automatically adjust corresponding parameters when changing the shaking head, and the optimal stereo sound effect can be experienced in real time.
In order to solve the above technical problem, an embodiment of the present invention provides an audio playing control method based on wireless connection, where the method includes:
the audio playing controller establishes wireless connection with the wireless audio playing device based on a target transmission protocol;
the audio playing controller receives the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction in real time, wherein the deflection angle is acquired by the wireless audio playing equipment;
the audio playing controller calculates the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user;
updating the head related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head related transformation function;
extracting corresponding audio data to be played from a playing buffer area in the audio playing controller;
superposing the audio data to be played by adopting frequency domain synthesis based on the updated head related transformation function to obtain a superposed signal;
and transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection.
Optionally, the establishing, by the audio playback controller, a wireless connection with a wireless audio playback device based on a target transmission protocol includes:
the playing controller detects whether the wireless audio playing equipment to be wirelessly connected supports a target transmission protocol or not;
if not, the playing controller sends an updating instruction to the wireless audio playing device until the wireless audio playing device updates the supported transmission protocol to the target transmission protocol;
and the audio playing controller establishes wireless connection with the wireless audio playing device based on the target transmission protocol.
Optionally, an accelerometer and a gyroscope are arranged on the wireless audio playing device;
the wireless audio playing device obtains the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction based on an accelerometer and a gyroscope.
Optionally, the calculating, by the audio playback controller, the relative position coordinate of the head of the user in the coordinate system based on the deflection angle to obtain the current relative position coordinate of the head of the user includes:
and the audio playing controller updates and calculates the position of the binaural coordinates of the user in a coordinate system according to the deflection angle, the preset binaural distance of the user and the height of the X axis of the coordinate system of the binaural distance of the user, so as to obtain the current relative position coordinates of the binaural of the user.
Optionally, the audio playing controller performs update calculation of the position of the binaural coordinate of the user in the coordinate system according to the deflection angle, the preset binaural distance of the user, and the height of the X axis of the coordinate system of the binaural distance of the user, including:
the audio playing controller obtains the moving distance of the ears of the user in the vertical direction and/or the horizontal direction by utilizing a trigonometric function formula according to the deflection angle, the preset distance between the ears of the user and the height of the ears of the user from the X axis of the coordinate system;
and updating and calculating the coordinate positions of the two ears of the user in a coordinate system according to the moving distance of the two ears of the user in the vertical direction and/or the horizontal direction and the original coordinate positions of the two ears of the user.
Optionally, the updating the head-related transformation function based on the current relative position coordinate of the head of the user to obtain an updated head-related transformation function includes:
and gradually updating the head related transformation function in an interpolation mode based on the current relative coordinate positions of the two ears of the user to obtain the updated head related transformation function.
Optionally, the play buffer area is an area opened in the memory of the audio play controller and used for buffering audio data to be played according to a play sequence;
the extracting corresponding audio data to be played from a play buffer in the audio play controller includes:
and extracting corresponding audio data to be played in a playing buffer area in the audio playing controller according to a playing sequence.
Optionally, the superimposing, by frequency domain synthesis, the audio data to be played based on the updated head related transform function to obtain a superimposed signal, including:
performing Fourier transform according to the audio data to be played to obtain transformed audio data to be played;
substituting the converted audio data to be played into the updated head related transformation function to perform analog superposition calculation to obtain an analog superposition signal;
and carrying out Fourier inversion on the analog superposed signal to obtain a superposed signal.
In addition, an embodiment of the present invention further provides an audio playing control device based on wireless connection, where the device includes:
a wireless connection establishing module: the audio playing controller is used for establishing wireless connection with the wireless audio playing equipment based on a target transmission protocol;
deflection angle receiving module: the audio playing controller is used for receiving the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction, which is acquired by the wireless audio playing equipment in real time;
a calculation module: the audio playing controller is used for calculating the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user;
an update module: the head related transformation function is updated based on the current relative position coordinates of the head of the user, and the updated head related transformation function is obtained;
an extraction module: the audio playing controller is used for extracting corresponding audio data to be played from a playing buffer area in the audio playing controller;
a superposition module: the audio data to be played is superposed by adopting frequency domain synthesis based on the updated head related transform function to obtain a superposed signal;
an output playing module: and the device is used for transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection.
In addition, the embodiment of the invention also provides an audio playing control system based on wireless connection, which comprises an audio playing controller and wireless audio playing equipment, wherein,
the audio playback controller and the wireless audio playback device are configured to perform the audio playback control method of any of the above.
In the embodiment of the invention, the audio playing controller establishes wireless connection with the wireless audio playing device based on the target transmission protocol; the audio playing controller receives the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction in real time, wherein the deflection angle is acquired by the wireless audio playing equipment; the audio playing controller calculates the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user; updating the head related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head related transformation function; extracting corresponding audio data to be played from a playing buffer area in the audio playing controller; superposing the audio data to be played by adopting frequency domain synthesis based on the updated head related transformation function to obtain a superposed signal; transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection; the head shaking device has the advantages that corresponding parameters can be automatically adjusted when the head shaking device is changed by a user, the optimal stereo sound effect can be experienced in real time, and the experience feeling of the user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of an audio playing control method based on wireless connection in an embodiment of the present invention;
fig. 2 is a schematic structural composition diagram of an audio playing control device based on wireless connection in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an audio playing control system based on wireless connection in an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Examples
Referring to fig. 1, fig. 1 is a flowchart illustrating an audio playing control method based on wireless connection according to an embodiment of the present invention.
As shown in fig. 1, an audio playing control method based on wireless connection includes:
s11: the audio playing controller establishes wireless connection with the wireless audio playing device based on a target transmission protocol;
in the specific implementation process of the present invention, the establishing of the wireless connection between the audio playback controller and the wireless audio playback device based on the target transmission protocol includes: the audio playing controller detects whether the wireless audio playing equipment to be wirelessly connected supports a target transmission protocol; if not, the audio playing controller sends an updating instruction to the wireless audio playing device until the wireless audio playing device updates the supported transmission protocol to the target transmission protocol; and the audio playing controller establishes wireless connection with the wireless audio playing device based on the target transmission protocol.
Specifically, the audio playing controller is generally an intelligent terminal device, and may specifically be a smart phone, a tablet device, or a personal PC, and the like, and the wireless audio playing device may be a wireless earphone device; after the wireless audio playing device is started, starting a pairing program, firstly sending a protocol inquiry instruction to the wireless audio playing device by an audio playing controller to inquire whether a target transmission protocol is supported, and under the condition of not supporting, sending an updating instruction to the wireless audio playing device by the audio playing controller until the wireless audio playing device updates the supported transmission protocol to be the target transmission protocol; then the audio playing controller establishes wireless connection with the wireless audio playing device according to the target transmission protocol, and under a general condition, the wireless connection is bluetooth connection, namely, the audio playing controller and the wireless audio playing device are in bluetooth pairing connection.
S12: the audio playing controller receives the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction in real time, wherein the deflection angle is acquired by the wireless audio playing equipment;
in the specific implementation process of the invention, an accelerometer and a gyroscope are arranged on the wireless audio playing equipment; the wireless audio playing device obtains the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction based on an accelerometer and a gyroscope.
Specifically, an accelerometer and a gyroscope are arranged on the wireless audio playing device and used for collecting related data, and after a user wears the wireless audio playing device and establishes connection with an audio playing controller, the data are collected through the accelerometer and the gyroscope, so that the deflection angle of the head of the user relative to a coordinate system established by a central point in the vertical direction is obtained; specifically, the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction is obtained by combining an accelerometer and a gyroscope with a Kalman filtering algorithm, so that the problem of instability possibly existing when the accelerometer is used singly or the problem of large error possibly existing when the gyroscope is used singly can be solved.
Specifically, a straight line formed between the two ears is taken as an X axis, a middle point is taken as an origin, the upper and lower sides are taken as Z axes, and the front and rear sides are taken as Y axes, and the constructed coordinate system is that when the user does not deflect, the coordinates of the two ears are (a,0,0) and (-a,0,0) respectively.
S13: the audio playing controller calculates the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user;
in a specific implementation process of the present invention, the audio playback controller calculates the relative position coordinates of the head of the user in the coordinate system based on the deflection angle, and obtains the current relative position coordinates of the head of the user, including: and the audio playing controller updates and calculates the position of the binaural coordinates of the user in a coordinate system according to the deflection angle, the preset binaural distance of the user and the height of the X axis of the coordinate system of the binaural distance of the user, so as to obtain the current relative position coordinates of the binaural of the user.
Further, the audio playing controller performs the update calculation of the position of the binaural coordinate of the user in the coordinate system according to the deflection angle, the preset binaural distance of the user and the height of the X axis of the coordinate system of the binaural distance of the user, including: the audio playing controller obtains the moving distance of the ears of the user in the vertical direction and/or the horizontal direction by utilizing a trigonometric function formula according to the deflection angle, the preset distance between the ears of the user and the height of the ears of the user from the X axis of the coordinate system; and updating and calculating the coordinate positions of the two ears of the user in a coordinate system according to the moving distance of the two ears of the user in the vertical direction and/or the horizontal direction and the original coordinate positions of the two ears of the user.
Specifically, in a coordinate system, a straight line formed between two ears is taken as an X axis, a middle point is taken as an origin, an upper axis and a lower axis are taken as Z axes, and a front axis and a rear axis are taken as Y axes, when the coordinate system is constructed, the height of two ears of a user from the X axis of the coordinate system is 0 when the two ears of the user are static (under the condition of an original state), and at this time, the audio play controller can update and calculate the position of the two ears of the user in the coordinate system according to the deflection angle, the preset distance of the two ears of the user and the height of the two ears of the user from the X axis of the coordinate; the preset user binaural distance can be obtained by estimating and collecting by wireless audio playing equipment.
The audio playing controller obtains the moving distance of the ears of the user in the vertical direction and/or the horizontal direction by utilizing a trigonometric function formula according to the deflection angle, the preset distance between the ears of the user and the height of the ears of the user from the X axis of the coordinate system; and then updating and calculating the coordinate positions of the two ears of the user in a coordinate system according to the moving distance of the two ears of the user in the vertical direction and/or the horizontal direction and the original coordinate positions of the two ears of the user, and finally obtaining the current relative position coordinates of the two ears of the user.
S14: updating the head related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head related transformation function;
in a specific implementation process of the present invention, the updating the head-related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head-related transformation function includes: and gradually updating the head related transformation function in an interpolation mode based on the current relative coordinate positions of the two ears of the user to obtain the updated head related transformation function.
In the specific implementation process of the invention, according to the current relative coordinate position of the ears of the user and the head related transformation function, the head related transformation function is gradually updated in an interpolation mode to obtain the updated head related transformation function.
S15: extracting corresponding audio data to be played from a playing buffer area in the audio playing controller;
in the specific implementation process of the present invention, the play buffer area is an area opened up in the memory of the audio play controller and used for buffering the audio data to be played according to the play sequence; the extracting corresponding audio data to be played from a play buffer in the audio play controller includes: and extracting corresponding audio data to be played in a playing buffer area in the audio playing controller according to a playing sequence.
Specifically, the playing buffer area is an area opened up in the memory of the audio playing controller and used for buffering audio data to be played according to a playing sequence; after the user selects the corresponding audio data to be played, the audio playing controller loads the audio data to be played selected by the user and caches the area of the audio data to be played according to the playing sequence; in the playing process, corresponding audio data to be played are extracted from a playing buffer area in the audio playing controller according to the playing sequence.
S16: superposing the audio data to be played by adopting frequency domain synthesis based on the updated head related transformation function to obtain a superposed signal;
in a specific implementation process of the present invention, the superimposing the audio data to be played by frequency domain synthesis based on the updated head related transform function to obtain a superimposed signal includes: performing Fourier transform according to the audio data to be played to obtain transformed audio data to be played; substituting the converted audio data to be played into the updated head related transformation function to perform analog superposition calculation to obtain an analog superposition signal; and carrying out Fourier inversion on the analog superposed signal to obtain a superposed signal.
Specifically, the audio playing controller performs fourier transform on audio data to be played through a built-in algorithm to obtain transformed audio data to be played; then, substituting the converted audio data to be played into the updated head related transformation function to perform analog superposition calculation to obtain an analog superposition signal; and then carrying out Fourier inversion on the analog superposed signal to obtain a superposed signal.
S17: and transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection.
In the specific implementation process of the invention, the audio playing controller transmits the superposed signal to the wireless audio playing device in a wireless connection mode for corresponding playing.
In the embodiment of the invention, the audio playing controller establishes wireless connection with the wireless audio playing device based on the target transmission protocol; the audio playing controller receives the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction in real time, wherein the deflection angle is acquired by the wireless audio playing equipment; the audio playing controller calculates the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user; updating the head related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head related transformation function; extracting corresponding audio data to be played from a playing buffer area in the audio playing controller; superposing the audio data to be played by adopting frequency domain synthesis based on the updated head related transformation function to obtain a superposed signal; transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection; the head shaking device has the advantages that corresponding parameters can be automatically adjusted when the head shaking device is changed by a user, the optimal stereo sound effect can be experienced in real time, and the experience feeling of the user is improved.
Examples
Referring to fig. 2, fig. 2 is a schematic structural assembly diagram of an audio playback control apparatus based on wireless connection according to an embodiment of the present invention.
As shown in fig. 2, an audio playback control apparatus based on wireless connection, the apparatus comprising:
wireless connection establishment module 21: the audio playing controller is used for establishing wireless connection with the wireless audio playing equipment based on a target transmission protocol;
in the specific implementation process of the present invention, the establishing of the wireless connection between the audio playback controller and the wireless audio playback device based on the target transmission protocol includes: the audio playing controller detects whether the wireless audio playing equipment to be wirelessly connected supports a target transmission protocol; if not, the audio playing controller sends an updating instruction to the wireless audio playing device until the wireless audio playing device updates the supported transmission protocol to the target transmission protocol; and the audio playing controller establishes wireless connection with the wireless audio playing device based on the target transmission protocol.
Specifically, the audio playing controller is generally an intelligent terminal device, and may specifically be a smart phone, a tablet device, or a personal PC, and the like, and the wireless audio playing device may be a wireless earphone device; after the wireless audio playing device is started, starting a pairing program, firstly sending a protocol inquiry instruction to the wireless audio playing device by an audio playing controller to inquire whether a target transmission protocol is supported, and under the condition of not supporting, sending an updating instruction to the wireless audio playing device by the audio playing controller until the wireless audio playing device updates the supported transmission protocol to be the target transmission protocol; then the audio playing controller establishes wireless connection with the wireless audio playing device according to the target transmission protocol, and under a general condition, the wireless connection is bluetooth connection, namely, the audio playing controller and the wireless audio playing device are in bluetooth pairing connection.
Deflection angle receiving module 22: the audio playing controller is used for receiving the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction, which is acquired by the wireless audio playing equipment in real time;
in the specific implementation process of the invention, an accelerometer and a gyroscope are arranged on the wireless audio playing equipment; the wireless audio playing device obtains the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction based on an accelerometer and a gyroscope.
Specifically, an accelerometer and a gyroscope are arranged on the wireless audio playing device and used for collecting related data, and after a user wears the wireless audio playing device and establishes connection with an audio playing controller, the data are collected through the accelerometer and the gyroscope, so that the deflection angle of the head of the user relative to a coordinate system established by a central point in the vertical direction is obtained; specifically, the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction is obtained by combining an accelerometer and a gyroscope with a Kalman filtering algorithm, so that the problem of instability possibly existing when the accelerometer is used singly or the problem of large error possibly existing when the gyroscope is used singly can be solved.
Specifically, a straight line formed between the two ears is taken as an X axis, a middle point is taken as an origin, the upper and lower sides are taken as Z axes, and the front and rear sides are taken as Y axes, and the constructed coordinate system is that when the user does not deflect, the coordinates of the two ears are (a,0,0) and (-a,0,0) respectively.
The calculation module 23: the audio playing controller is used for calculating the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user;
in a specific implementation process of the present invention, the audio playback controller calculates the relative position coordinates of the head of the user in the coordinate system based on the deflection angle, and obtains the current relative position coordinates of the head of the user, including: and the audio playing controller updates and calculates the position of the binaural coordinates of the user in a coordinate system according to the deflection angle, the preset binaural distance of the user and the height of the X axis of the coordinate system of the binaural distance of the user, so as to obtain the current relative position coordinates of the binaural of the user.
Further, the audio playing controller performs the update calculation of the position of the binaural coordinate of the user in the coordinate system according to the deflection angle, the preset binaural distance of the user and the height of the X axis of the coordinate system of the binaural distance of the user, including: the audio playing controller obtains the moving distance of the ears of the user in the vertical direction and/or the horizontal direction by utilizing a trigonometric function formula according to the deflection angle, the preset distance between the ears of the user and the height of the ears of the user from the X axis of the coordinate system; and updating and calculating the coordinate positions of the two ears of the user in a coordinate system according to the moving distance of the two ears of the user in the vertical direction and/or the horizontal direction and the original coordinate positions of the two ears of the user.
Specifically, in a coordinate system, a straight line formed between two ears is taken as an X axis, a middle point is taken as an origin, an upper axis and a lower axis are taken as Z axes, and a front axis and a rear axis are taken as Y axes, when the coordinate system is constructed, the height of two ears of a user from the X axis of the coordinate system is 0 when the two ears of the user are static (under the condition of an original state), and at this time, the audio play controller can update and calculate the position of the two ears of the user in the coordinate system according to the deflection angle, the preset distance of the two ears of the user and the height of the two ears of the user from the X axis of the coordinate; the preset user binaural distance can be obtained by estimating and collecting by wireless audio playing equipment.
The audio playing controller obtains the moving distance of the ears of the user in the vertical direction and/or the horizontal direction by utilizing a trigonometric function formula according to the deflection angle, the preset distance between the ears of the user and the height of the ears of the user from the X axis of the coordinate system; and then updating and calculating the coordinate positions of the two ears of the user in a coordinate system according to the moving distance of the two ears of the user in the vertical direction and/or the horizontal direction and the original coordinate positions of the two ears of the user, and finally obtaining the current relative position coordinates of the two ears of the user.
The update module 24: the head related transformation function is updated based on the current relative position coordinates of the head of the user, and the updated head related transformation function is obtained;
in a specific implementation process of the present invention, the updating the head-related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head-related transformation function includes: and gradually updating the head related transformation function in an interpolation mode based on the current relative coordinate positions of the two ears of the user to obtain the updated head related transformation function.
In the specific implementation process of the invention, according to the current relative coordinate position of the ears of the user and the head related transformation function, the head related transformation function is gradually updated in an interpolation mode to obtain the updated head related transformation function.
The extraction module 25: the audio playing controller is used for extracting corresponding audio data to be played from a playing buffer area in the audio playing controller;
in the specific implementation process of the present invention, the play buffer area is an area opened up in the memory of the audio play controller and used for buffering the audio data to be played according to the play sequence; the extracting corresponding audio data to be played from a play buffer in the audio play controller includes: and extracting corresponding audio data to be played in a playing buffer area in the audio playing controller according to a playing sequence.
Specifically, the playing buffer area is an area opened up in the memory of the audio playing controller and used for buffering audio data to be played according to a playing sequence; after the user selects the corresponding audio data to be played, the audio playing controller loads the audio data to be played selected by the user and caches the area of the audio data to be played according to the playing sequence; in the playing process, corresponding audio data to be played are extracted from a playing buffer area in the audio playing controller according to the playing sequence.
The superposition module 26: the audio data to be played is superposed by adopting frequency domain synthesis based on the updated head related transform function to obtain a superposed signal;
in a specific implementation process of the present invention, the superimposing the audio data to be played by frequency domain synthesis based on the updated head related transform function to obtain a superimposed signal includes: performing Fourier transform according to the audio data to be played to obtain transformed audio data to be played; substituting the converted audio data to be played into the updated head related transformation function to perform analog superposition calculation to obtain an analog superposition signal; and carrying out Fourier inversion on the analog superposed signal to obtain a superposed signal.
Specifically, the audio playing controller performs fourier transform on audio data to be played through a built-in algorithm to obtain transformed audio data to be played; then, substituting the converted audio data to be played into the updated head related transformation function to perform analog superposition calculation to obtain an analog superposition signal; and then carrying out Fourier inversion on the analog superposed signal to obtain a superposed signal.
The output playing module 27: and the device is used for transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection.
In the specific implementation process of the invention, the audio playing controller transmits the superposed signal to the wireless audio playing device in a wireless connection mode for corresponding playing.
In the embodiment of the invention, the audio playing controller establishes wireless connection with the wireless audio playing device based on the target transmission protocol; the audio playing controller receives the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction in real time, wherein the deflection angle is acquired by the wireless audio playing equipment; the audio playing controller calculates the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user; updating the head related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head related transformation function; extracting corresponding audio data to be played from a playing buffer area in the audio playing controller; superposing the audio data to be played by adopting frequency domain synthesis based on the updated head related transformation function to obtain a superposed signal; transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection; the head shaking device has the advantages that corresponding parameters can be automatically adjusted when the head shaking device is changed by a user, the optimal stereo sound effect can be experienced in real time, and the experience feeling of the user is improved.
Examples
Referring to fig. 3, fig. 3 is a schematic structural diagram of an audio playing control system based on wireless connection according to an embodiment of the present invention.
As shown in fig. 3, an audio playback control system based on wireless connection comprises an audio playback controller and a wireless audio playback device, wherein,
the audio playback controller and the wireless audio playback device are configured to perform the audio playback control method of any of the above.
The detailed description of the system items can be found in the above embodiments and will not be repeated herein.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
In addition, the audio playing control method, the audio playing control device and the audio playing control system based on wireless connection provided by the embodiment of the present invention are described in detail above, a specific embodiment should be adopted herein to explain the principle and the implementation manner of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. An audio playing control method based on wireless connection, the method comprising:
the audio playing controller establishes wireless connection with the wireless audio playing device based on a target transmission protocol;
the audio playing controller receives the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction in real time, wherein the deflection angle is acquired by the wireless audio playing equipment;
the audio playing controller calculates the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user;
updating the head related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head related transformation function;
extracting corresponding audio data to be played from a playing buffer area in the audio playing controller;
superposing the audio data to be played by adopting frequency domain synthesis based on the updated head related transformation function to obtain a superposed signal;
and transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection.
2. The audio playback control method of claim 1, wherein the audio playback controller establishes a wireless connection with a wireless audio playback device based on a target transport protocol, and the method comprises:
the audio playing controller detects whether the wireless audio playing equipment to be wirelessly connected supports a target transmission protocol;
if not, the audio playing controller sends an updating instruction to the wireless audio playing device until the wireless audio playing device updates the supported transmission protocol to the target transmission protocol;
and the audio playing controller establishes wireless connection with the wireless audio playing device based on the target transmission protocol.
3. The audio playback control method according to claim 1, wherein an accelerometer and a gyroscope are provided on the wireless audio playback device;
the wireless audio playing device obtains the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction based on an accelerometer and a gyroscope.
4. The audio playing control method according to claim 1, wherein the audio playing controller calculates the relative position coordinates of the head of the user in the coordinate system based on the deflection angle, and obtains the current relative position coordinates of the head of the user, including:
and the audio playing controller updates and calculates the position of the binaural coordinates of the user in a coordinate system according to the deflection angle, the preset binaural distance of the user and the height of the X axis of the coordinate system of the binaural distance of the user, so as to obtain the current relative position coordinates of the binaural of the user.
5. The audio playing control method according to claim 4, wherein the audio playing controller performs the user binaural coordinate position updating calculation in the coordinate system according to the deflection angle, the preset user binaural distance, and the height of the user binaural distance from the X-axis of the coordinate system, and includes:
the audio playing controller obtains the moving distance of the ears of the user in the vertical direction and/or the horizontal direction by utilizing a trigonometric function formula according to the deflection angle, the preset distance between the ears of the user and the height of the ears of the user from the X axis of the coordinate system;
and updating and calculating the coordinate positions of the two ears of the user in a coordinate system according to the moving distance of the two ears of the user in the vertical direction and/or the horizontal direction and the original coordinate positions of the two ears of the user.
6. The audio playing control method according to claim 4, wherein the updating the head-related transformation function based on the current relative position coordinates of the head of the user to obtain an updated head-related transformation function comprises:
and gradually updating the head related transformation function in an interpolation mode based on the current relative coordinate positions of the two ears of the user to obtain the updated head related transformation function.
7. The audio playback control method according to claim 1, wherein the playback buffer area is an area opened up in a memory of the audio playback controller for buffering audio data to be played in a playback order;
the extracting corresponding audio data to be played from a play buffer in the audio play controller includes:
and extracting corresponding audio data to be played in a playing buffer area in the audio playing controller according to a playing sequence.
8. The audio playing control method according to claim 1, wherein the obtaining a superimposed signal by superimposing the audio data to be played by frequency domain synthesis based on the updated head related transform function comprises:
performing Fourier transform according to the audio data to be played to obtain transformed audio data to be played;
substituting the converted audio data to be played into the updated head related transformation function to perform analog superposition calculation to obtain an analog superposition signal;
and carrying out Fourier inversion on the analog superposed signal to obtain a superposed signal.
9. An audio playback control apparatus based on wireless connection, the apparatus comprising:
a wireless connection establishing module: the audio playing controller is used for establishing wireless connection with the wireless audio playing equipment based on a target transmission protocol;
deflection angle receiving module: the audio playing controller is used for receiving the deflection angle of the head of the user relative to a coordinate system constructed by a central point in the vertical direction, which is acquired by the wireless audio playing equipment in real time;
a calculation module: the audio playing controller is used for calculating the relative position coordinates of the head of the user in a coordinate system based on the deflection angle to obtain the current relative position coordinates of the head of the user;
an update module: the head related transformation function is updated based on the current relative position coordinates of the head of the user, and the updated head related transformation function is obtained;
an extraction module: the audio playing controller is used for extracting corresponding audio data to be played from a playing buffer area in the audio playing controller;
a superposition module: the audio data to be played is superposed by adopting frequency domain synthesis based on the updated head related transform function to obtain a superposed signal;
an output playing module: and the device is used for transmitting the superposed signals to wireless audio playing equipment for corresponding playing based on wireless connection.
10. An audio playing control system based on wireless connection is characterized in that the system comprises an audio playing controller and a wireless audio playing device, wherein,
the audio playback controller and the wireless audio playback device are configured to perform the audio playback control method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011524634.9A CN112637755A (en) | 2020-12-22 | 2020-12-22 | Audio playing control method, device and playing system based on wireless connection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011524634.9A CN112637755A (en) | 2020-12-22 | 2020-12-22 | Audio playing control method, device and playing system based on wireless connection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112637755A true CN112637755A (en) | 2021-04-09 |
Family
ID=75320751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011524634.9A Pending CN112637755A (en) | 2020-12-22 | 2020-12-22 | Audio playing control method, device and playing system based on wireless connection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112637755A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024088135A1 (en) * | 2022-10-27 | 2024-05-02 | 安克创新科技股份有限公司 | Audio processing method, audio playback device, and computer readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183421A (en) * | 2015-08-11 | 2015-12-23 | 中山大学 | Method and system for realizing virtual reality three-dimensional sound effect |
| CN105302752A (en) * | 2015-10-20 | 2016-02-03 | 北京小鸟听听科技有限公司 | Connection method of audio equipment and audio playing device |
| CN107018460A (en) * | 2015-12-29 | 2017-08-04 | 哈曼国际工业有限公司 | Ears headphone with head tracking is presented |
| CN109450851A (en) * | 2018-09-30 | 2019-03-08 | Oppo广东移动通信有限公司 | Equipment connection method, device, electronic equipment and computer-readable medium |
| CN111050271A (en) * | 2018-10-12 | 2020-04-21 | 北京微播视界科技有限公司 | Method and apparatus for processing audio signal |
| WO2020176532A1 (en) * | 2019-02-27 | 2020-09-03 | Robert Likamwa | Method and apparatus for time-domain crosstalk cancellation in spatial audio |
-
2020
- 2020-12-22 CN CN202011524634.9A patent/CN112637755A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183421A (en) * | 2015-08-11 | 2015-12-23 | 中山大学 | Method and system for realizing virtual reality three-dimensional sound effect |
| CN105302752A (en) * | 2015-10-20 | 2016-02-03 | 北京小鸟听听科技有限公司 | Connection method of audio equipment and audio playing device |
| CN107018460A (en) * | 2015-12-29 | 2017-08-04 | 哈曼国际工业有限公司 | Ears headphone with head tracking is presented |
| CN109450851A (en) * | 2018-09-30 | 2019-03-08 | Oppo广东移动通信有限公司 | Equipment connection method, device, electronic equipment and computer-readable medium |
| CN111050271A (en) * | 2018-10-12 | 2020-04-21 | 北京微播视界科技有限公司 | Method and apparatus for processing audio signal |
| WO2020176532A1 (en) * | 2019-02-27 | 2020-09-03 | Robert Likamwa | Method and apparatus for time-domain crosstalk cancellation in spatial audio |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024088135A1 (en) * | 2022-10-27 | 2024-05-02 | 安克创新科技股份有限公司 | Audio processing method, audio playback device, and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10880665B2 (en) | Method and system for surround sound processing in a headset | |
| JP6668661B2 (en) | Parameter control device and parameter control program | |
| US9906885B2 (en) | Methods and systems for inserting virtual sounds into an environment | |
| US20240030882A1 (en) | Method and system for a headset with integrated environmental sensors | |
| JP5992210B2 (en) | Information processing program, information processing apparatus, information processing system, and information processing method | |
| JP6243595B2 (en) | Information processing system, information processing program, information processing control method, and information processing apparatus | |
| JP6147486B2 (en) | GAME SYSTEM, GAME PROCESSING CONTROL METHOD, GAME DEVICE, AND GAME PROGRAM | |
| CN105101027A (en) | Real-time Control Of An Acoustic Environment | |
| CN112911065B (en) | Audio playing method and device for terminal, electronic equipment and storage medium | |
| CN109086027B (en) | Audio signal playing method and terminal | |
| CN112543250B (en) | Audio play control method, smart phone, device and readable storage medium | |
| CN103329570A (en) | Audio processing device | |
| JP6055651B2 (en) | Information processing system, information processing program, information processing control method, and information processing apparatus | |
| CN108028999A (en) | For providing device, the method and computer program of audio reproduction | |
| JP3740518B2 (en) | GAME DEVICE, COMPUTER CONTROL METHOD, AND PROGRAM | |
| CN112637755A (en) | Audio playing control method, device and playing system based on wireless connection | |
| JPH08107600A (en) | Sound image localization device | |
| JP2013110702A (en) | Mobile communication terminal, mobile communication method, and mobile communication program | |
| CN106302974B (en) | information processing method and electronic equipment | |
| CN113365191A (en) | Music playing method, device, equipment and storage medium | |
| CN115273431B (en) | Device retrieving method and device, storage medium and electronic device | |
| WO2020102994A1 (en) | 3d sound effect realization method and apparatus, and storage medium and electronic device | |
| JP2013034107A (en) | Sound source localization control program and sound source localization controller | |
| JP2012169783A (en) | Sound processing device and method | |
| CN116744215B (en) | Audio processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210409 |
|
| RJ01 | Rejection of invention patent application after publication |