CN112770228A - Audio playing method and device, audio playing equipment, electronic equipment and medium - Google Patents
Audio playing method and device, audio playing equipment, electronic equipment and medium Download PDFInfo
- Publication number
- CN112770228A CN112770228A CN202011589502.4A CN202011589502A CN112770228A CN 112770228 A CN112770228 A CN 112770228A CN 202011589502 A CN202011589502 A CN 202011589502A CN 112770228 A CN112770228 A CN 112770228A
- Authority
- CN
- China
- Prior art keywords
- audio data
- ultrasonic signal
- audio
- ultrasonic
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000000694 effects Effects 0.000 claims abstract description 40
- 238000006243 chemical reaction Methods 0.000 claims description 20
- 230000005540 biological transmission Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 210000005069 ears Anatomy 0.000 description 4
- 230000008054 signal transmission Effects 0.000 description 4
- 238000009432 framing Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000010030 laminating Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
The embodiment of the application provides an audio playing method, an audio playing device, an electronic device and a medium, which belong to the technical field of data processing, and the method comprises the following steps: acquiring first audio data; converting the first audio data into a first ultrasonic signal and transmitting the first ultrasonic signal; receiving a second ultrasonic signal, and converting the second ultrasonic signal into second audio data, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment; and playing the second audio data. According to the scheme, the audio data are converted into the ultrasonic signals to be sent to the current environment, the ultrasonic signals of the sent ultrasonic signals reflected back through the propagation medium are received, the received ultrasonic signals are converted into the audio data to be played, and the audio data can be conveniently played in a three-dimensional effect.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to an audio playing method and apparatus, an audio playing device, an electronic device, and a medium.
Background
With the increasing demand of users for practical listening feeling, audio playing technologies such as mono, stereo, quad, virtual surround, etc. have been diversified.
The 3D (Three Dimensional) sound effect technology is a simulation technology that is most realistic for sound reproduction, and mainly simulates and reproduces the listening effect of human ears in a real environment through a complex recording mode, that is, a user wears a human head recording device, so that the user can feel the sound reception effect of different sound source positions from the surrounding environment, and a very high realistic sense of hearing can be given to the user.
However, the 3D sound effect technology not only requires the cooperation of a complex external device for playing, but also has a complex recording process of 3D audio data, so how to conveniently play the 3D sound effect on the audio data becomes a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The embodiment of the application provides an audio playing method, an audio playing device, an electronic device and a medium, which can solve the problems that in the prior art, not only is the recording process of 3D audio data complex, but also complex external equipment is needed to cooperate for playing.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides an audio playing method, where the method includes:
acquiring first audio data;
converting the first audio data into a first ultrasonic signal and transmitting the first ultrasonic signal;
receiving a second ultrasonic signal, and converting the second ultrasonic signal into second audio data, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment;
and playing the second audio data.
In a second aspect, an embodiment of the present application provides an audio playing device, where the apparatus includes:
the acquisition module is used for acquiring first audio data to be played;
the first conversion module is used for converting the first audio data into a first ultrasonic signal and transmitting the first ultrasonic signal;
the second conversion module is used for receiving a second ultrasonic signal and converting the second ultrasonic signal into second audio data, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment;
and the playing module is used for playing the second audio data.
In a third aspect, an embodiment of the present application provides an audio playing device, where the audio playing device at least includes: the ultrasonic wave transmitting module, the ultrasonic wave receiving module, the processor and the audio output module;
the processor is used for acquiring first audio data to be played;
the ultrasonic transmitting module is used for converting the first audio data into a first ultrasonic signal and sending the first ultrasonic signal outwards;
the ultrasonic receiving module is used for receiving a second ultrasonic signal and converting the second ultrasonic signal into second audio data with a three-dimensional effect, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment;
and the audio output module is used for playing the second audio data.
In a fourth aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the audio playing method according to the first aspect.
In a fifth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, and when executed by a processor, the program or instructions implement the steps of the audio playing method according to the first aspect.
In a sixth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the audio playing method according to the first aspect.
The embodiment of the application provides an audio playing method, an audio playing device, electronic equipment and a medium, the scheme converts audio data into ultrasonic signals to be sent outwards, the ultrasonic signals are reflected by the propagation medium in the current environment, a part of energy is absorbed by the propagation medium, first ultrasonic signals with attenuation delay are generated, then the first ultrasonic signals are superposed to be received as second ultrasonic signals, therefore, the audio data obtained by playing the second ultrasonic signals in a conversion mode have a three-dimensional effect just like that sound waves generated by a sound source of the audio data are reflected and superposed by the surrounding environment in a real scene, and therefore the audio data can be conveniently played in a three-dimensional effect.
Drawings
Fig. 1 is a flowchart illustrating steps of an audio playing method according to an embodiment of the present application;
fig. 2 is a schematic diagram illustrating an audio playing method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating steps of another audio playing method according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating steps of another audio playing method according to an embodiment of the present application;
fig. 5 is a block diagram illustrating an audio playing apparatus according to an embodiment of the present application;
fig. 6 shows a block diagram of an audio playing device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 8 shows a hardware structure diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
An audio playing method, an audio playing device, an electronic device, and a storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
Referring to fig. 1, an embodiment of the present application provides a flowchart of steps of an audio playing method, where the method includes:
In the embodiment of the application, the scheme can be applied to electronic equipment with functions of data processing, data transmission, data storage, audio output and the like, and the audio playing equipment is also provided with an ultrasonic transducer, wherein the ultrasonic transducer is a device which can convert electromagnetic energy signals such as electric signals and the like into mechanical energy such as sound wave signals and convert the sound wave signals into electromagnetic energy signals such as electric signals and the like.
The first audio data refers to audio data that needs to be played, and may specifically be specified by a user, or may be automatically selected by a system, and may specifically be determined according to actual needs, which is not limited herein. It should be noted that, because the scheme of the application is to play the audio data without the three-dimensional sound effect, the first audio data may be the original audio data without the three-dimensional sound effect, and of course, the first audio data may also be the audio data with the three-dimensional sound effect, and the audio play with the three-dimensional sound effect may also be implemented by the scheme, so as to improve the effect of the three-dimensional sound effect.
In the embodiment of the present application, the first ultrasonic signal is a signal in an ultrasonic form obtained by directly converting first audio data to be played through an ultrasonic transducer. After the ultrasonic transducer converts the first audio data into a first ultrasonic signal, the first ultrasonic signal is then sent to the current environment where the audio playing device is located. It should be noted that, since the sound frequency that can be perceived by the human ear hearing is 20 to 20000Hz, and the ultrasonic waves generally exceed 20000Hz, even exceed 25000Hz, it is impossible for the user to perceive the first ultrasonic signal transmitted by the audio playing device.
In this embodiment of the application, after a first ultrasonic signal sent by an ultrasonic transducer is sent to a current environment, due to a reflection effect of the ultrasonic wave, a propagation medium of the first ultrasonic signal in the current environment changes, for example, the first ultrasonic signal is reflected when encountering propagation media such as the ground, a wall, a glass window, a water surface, and the like, so as to generate an effect of reflecting an echo, obtain a second ultrasonic signal, send the second ultrasonic signal back to an audio playing device, and receive the second ultrasonic signal by the ultrasonic transducer. It should be noted that, after the first ultrasonic signal is reflected by the propagation medium, a part of energy is absorbed by the propagation medium, and the first ultrasonic signal with attenuation delay is generated and then superimposed on the first ultrasonic signal subsequently emitted by the ultrasonic transducer on the way of being transmitted back to the ultrasonic transducer, so as to form a second ultrasonic signal. Therefore, after the second ultrasonic signal is converted into the second audio data through the ultrasonic transducer, the second audio data also has the characteristic of attenuation delay, just like the original sound waves emitted by the sound source in a real scene are reflected by the propagation medium of the surrounding environment and then are overlapped with the original sound waves emitted by the sound source to be perceived by the hearing of the user, so that the three-dimensional effect that the user feels personally on the scene is generated.
And 104, playing the second audio data.
In this application embodiment, in order to make the three-dimensional effect of the second audio data well manifest, this audio playback device may set up audio output modules that can make sounds respectively for both ears of the user, such as headphone, earplug earphone, of course, the audio output module in the audio playback device may also be a functional module that has an audio output function, such as stereo set, specifically may be determined according to actual needs, and here does not limit.
For example, referring to fig. 2, the scheme can be applied to a headset, wherein 1 is an ultrasonic transducer and is arranged in an ear hook 4 of the headset, and 2 is an ultrasonic transducer and is arranged in left and right channel earphones 3 of the headset. When a user needs to play first audio data by wearing the headset, the audio data are converted into first ultrasonic signals through the ultrasonic transducer 1 and then are sent to the current environment, the first ultrasonic signals transmitted at the previous time are reflected after encountering a reflecting medium in the current environment, second ultrasonic signals obtained by superposition of the first ultrasonic signals transmitted at the later time are received by the ultrasonic transducer 2 and are converted into second audio data, and the second audio data obtained by conversion of the ultrasonic transducers arranged on the left and right channel earphones 3 are played to the user through the last two left and right channel earphones.
Of course, this is merely an exemplary illustration, and the embodiments of the present application may also be applied to other types of audio playing devices, such as an ear plug type earphone, a stereo, and the like, and the ultrasonic transducer may also be disposed in an audio output module of the audio playing device, or outside the audio output module.
The ultrasonic transducer is actually used for simulating an actual sound source, so that the ultrasonic transducer is arranged at different positions, and the sound source is sensed by the auditory sense of a user at different positions; the ultrasonic transducer has an actual audio receiving function, and one ultrasonic transducer can acquire audio data of one sound audio channel, so that the ultrasonic transducer can be set according to the number of actually required audio channels, for example, in a headset and an earplug type earphone which are used for sounding two ears of a user, a left audio channel and a right audio channel are generally adopted, so that two ultrasonic transducers can be set, and the ultrasonic transducer can be specifically determined according to time requirements, and is not limited here.
According to the audio playing method provided by the embodiment of the application, the audio data are converted into the ultrasonic signals to be sent outwards, the ultrasonic signals are reflected by the propagation medium of the current environment, part of energy is absorbed by the propagation medium, the first ultrasonic signals with attenuation delay are generated, the first ultrasonic signals are superposed and received as the second ultrasonic signals, therefore, the audio data obtained by playing the second ultrasonic signals have the three-dimensional effect that the sound waves generated by the sound source of the audio data are reflected and superposed by the surrounding environment in the real scene, and therefore the audio data can be conveniently played with the three-dimensional effect.
Referring to fig. 3, an embodiment of the present application further provides a flowchart of steps of another audio playing method, where the method includes:
in step 201, first audio data is obtained.
This step can refer to the detailed description of step 101, which is not repeated herein.
In this embodiment of the application, the preset encoding format is an encoding format for performing framing processing on the first audio data, and may be specifically set in advance according to actual requirements. Under the condition that the data volume of the audio data is large, the audio data is directly converted into the ultrasonic signal for transmission, and under the condition that data loss may occur, the first audio data needs to be subjected to framing processing before being converted into the first ultrasonic signal, so that the stability of the transmission of the audio data converted into the ultrasonic signal is ensured.
In an embodiment of the application, the ultrasonic transducers respectively convert a plurality of first audio data frames into first ultrasonic signals in the form of ultrasonic waves.
In this application embodiment, the preset beam angle refers to an angle at which the extension line of the central axis of the ultrasonic transducer is outward when the ultrasonic transducer transmits ultrasonic waves and the energy intensity is reduced by half. The first ultrasonic signal sent according to the preset beam angle is a beam type ultrasonic wave, and the first ultrasonic signal is sent around the current environment according to the preset beam angle. Because what first ultrasonic signal sent is the ultrasonic signal of beam type according to predetermineeing the beam angle for first ultrasonic signal can be by current environment's propagation medium reflection echo playback devices all around, just as after the sound production of reality sound source, former sound wave can be to propagation all around, is reflected the back by user's sense of hearing perception with former sound wave stack back, thereby makes the real sound source of laminating more of first ultrasonic signal's transmission, has strengthened the three-dimensional effect of follow-up obtained second audio data.
This step can refer to the detailed description of step 103, which is not repeated herein.
In this embodiment of the application, since the second ultrasonic signal is a first ultrasonic signal including a plurality of first audio data frames, and after being reflected by the propagation medium, the first ultrasonic signal is absorbed by the propagation medium, so that a part of energy is generated, and the first ultrasonic signal is generated with attenuation delay, and then is superimposed on the first ultrasonic signal and received by the ultrasonic transducer, the second ultrasonic signal is converted by the ultrasonic transducer, so that a plurality of second audio data frames corresponding to the plurality of first audio data frames are obtained.
And step 207, decoding the plurality of second audio data frames according to a preset coding format to obtain second audio data.
According to the embodiment of the application, the audio data are divided into the plurality of audio data frames according to the preset coding format and then converted into the ultrasonic signals for transmission, so that the problem of data loss caused by overlong audio data is avoided, and the stability of ultrasonic signal transmission is improved.
And step 208, playing the second audio data.
This step can refer to the detailed description of step 104, which is not repeated here.
Optionally, step 204 includes: and sending the first ultrasonic signal outwards according to a preset beam angle and a preset vibration frequency.
The step 205 includes: and receiving a second ultrasonic signal with a preset vibration frequency through the ultrasonic transducer.
In the embodiment of the present application, the preset vibration frequency refers to a vibration frequency at which the first ultrasonic signal is emitted. In practical application, irrelevant ultrasonic signals which are not sent by the audio playing equipment may exist in the current environment, the first ultrasonic signals can be sent through the preset vibration frequency, the audio playing equipment can distinguish that the first ultrasonic signals are reflected by the propagation medium according to the preset vibration frequency when receiving the ultrasonic signals, and then the first ultrasonic signals are absorbed by the propagation medium to generate first ultrasonic signals with attenuation delay, and then the second ultrasonic signals obtained by superimposing the first ultrasonic signals are superposed, so that the interference of the irrelevant ultrasonic signals on the transmission of the ultrasonic signals is avoided, and the quality of audio playing with a three-dimensional effect is improved.
Optionally, the second audio data frame at least includes: a start code and an end code, wherein the preset coding format at least comprises: the corresponding relation between the start code and the end code, and the length of the preset data frame.
Referring to fig. 4, the step 202 includes:
In the embodiment of the present application, the start code and the end code refer to identification codes in the audio data frames, and the precedence relationship between the audio data frames can be identified according to the preset corresponding relationship between the start code and the end code. The start code, the end code, and the predetermined correspondence between the start code and the end code are preset. The preset data frame length refers to a data frame length for dividing an audio data frame, and the preset data frame length may be a plurality of different lengths or a uniform length, and may be specifically determined according to actual requirements, which is not limited herein.
In this embodiment of the present application, after dividing first audio data into N audio data frames according to a preset data frame length, adding a start code to a1 st bit of the nth audio data frame, adding an end code corresponding to a start code of an N-1 st audio frame to a2 nd bit, where the last two bits are audio data, so as to obtain a plurality of first audio data frames, where N, N is a positive integer, N is less than or equal to N, and when N is 1, the start code of the audio data frame may be a null value.
Referring to fig. 4, the step 207 includes:
In the embodiment of the present application, for example, three audio data frames (a1, b1, data1), (b2, c1, data2), (c2, d1, data3) are received, where data is audio data, the first bit is a start code, the second bit is an end code, it is determined that data2 is audio data after data1 according to that the end code corresponding to a1 is null, data1 is start audio data, the end code b1 corresponds to the start code b2, it is determined that data2 is audio data after data1, the end code c1 corresponds to a start code c2 and the end code d1 is null, it is determined that data3 is audio data after data2 and data3 is end audio data, data1, data2, and data3 may be sequentially spliced to obtain second audio data, although the splicing manner may be exemplarily illustrated, and is determined according to actual needs, and is not limited herein.
According to the embodiment of the application, the start code and the end code are added into the audio data frame, so that the audio data frame is spliced according to the corresponding relation between the start code and the end code, the audio data is guaranteed to be converted into the ultrasonic signals for transmission, and the audio data cannot be maliciously acquired even if being received by other equipment, and the safety of the audio data converted into the ultrasonic data for transmission is guaranteed.
Another audio playing method provided in the embodiment of the present application, converts audio data into an ultrasonic signal to be sent to the outside, where the ultrasonic signal is reflected by a propagation medium in the current environment, and then is absorbed by the propagation medium, so as to generate a first ultrasonic signal with attenuation delay, and then superimposes the first ultrasonic signal to be received as a second ultrasonic signal, so that the audio data obtained by playing the second ultrasonic signal conversion has a three-dimensional effect that is just like that of a sound wave generated by a sound source of the audio data is reflected and superimposed by the surrounding environment in a real scene, thereby being capable of conveniently playing the three-dimensional effect on the audio data. And audio data are divided into a plurality of audio data frames according to a preset coding format and then are converted into ultrasonic signals for transmission, so that the problem of data loss caused by overlong audio data is avoided, and the stability of ultrasonic signal transmission is improved. And still through adding the start code and the end code in giving the audio data frame to splice the audio data frame according to the corresponding relation between start code and the end code, when guaranteeing that audio data is converted into ultrasonic signal and transmits, even received by other equipment, also can not be acquireed maliciously, guaranteed that audio data converts into ultrasonic data and transmits's security.
It should be noted that, in the audio playing method provided in the embodiment of the present application, the execution main body may be an audio playing device, or a control module used for executing the audio playing method in the audio playing device. In the embodiment of the present application, an audio playing device is taken as an example to execute an audio playing method, and the audio playing method provided in the embodiment of the present application is described.
Referring to fig. 5, an embodiment of the present application further provides a block diagram of an audio playing apparatus 30, where the apparatus includes:
an obtaining module 301, configured to obtain first audio data;
a first conversion module 302 for converting the first audio data into a first ultrasonic signal and transmitting the first ultrasonic signal;
a second conversion module 303, configured to receive a second ultrasonic signal and convert the second ultrasonic signal into second audio data, where the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium in a current environment;
a playing module 304, configured to play the second audio data.
Optionally, the first converting module 302 is further configured to transmit the first ultrasonic signal according to a preset beam angle.
Optionally, the first conversion module 302 is further configured to transmit the first ultrasonic signal according to a preset beam angle and a preset vibration frequency;
the second conversion module 303 is further configured to receive a second ultrasonic signal with a preset vibration frequency.
Optionally, the first conversion module 302 is further configured to encode the first audio data according to a preset encoding format to obtain a plurality of first audio data frames;
converting the plurality of first audio data frames into a first ultrasonic signal;
the second conversion module 303 is further configured to convert the second ultrasonic signal into a plurality of second audio data frames;
and decoding the plurality of second audio data frames according to a preset coding format to obtain second audio data.
Optionally, the second audio data frame comprises at least: a start code and an end code, wherein the preset coding format at least comprises: the corresponding relation between the start code and the end code and the length of a preset data frame;
optionally, the first conversion module 302 is further configured to split the first audio data according to a length of a preset data frame to obtain multiple audio data frames;
according to the sequence relation of the audio data frames, respectively adding a start code and an end code with a preset corresponding relation to the adjacent audio data frames to obtain a plurality of first audio data frames;
the second conversion module 303 is further configured to splice the plurality of second audio data frames according to the preset corresponding relationship between the start code and the end code, so as to obtain second audio data.
The utility model provides an audio playback equipment, through outwards sending audio data conversion ultrasonic signal, this ultrasonic signal is after the propagation medium reflection of current environment, absorbed some energy by the propagation medium, first ultrasonic signal with decay delay has been produced, it is received as second ultrasonic signal to superpose first ultrasonic signal again, consequently, the audio data that the conversion of this second ultrasonic signal obtained has the sound source sound wave of just as audio data by the superimposed three-dimensional effect of reflection of surrounding environment in the real scene, thereby can carry out the broadcast of three-dimensional effect to audio data conveniently.
The audio playing device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The audio playing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The audio playing device provided in the embodiment of the present application can implement each process implemented by the audio playing device in the method embodiments of fig. 1 to fig. 3, and is not described herein again to avoid repetition.
Referring to fig. 6, an embodiment of the present application further provides a block diagram of an audio playing device 40, where the audio playing device at least includes: an ultrasonic transmitting module 402, an ultrasonic receiving module 403, a processor 401 and an audio output module 404;
the processor 401 is configured to obtain first audio data to be played;
the ultrasonic transmitting module 402 is configured to convert the first audio data into a first ultrasonic signal, and send the first ultrasonic signal to the outside;
the ultrasonic receiving module 403 is configured to receive a second ultrasonic signal, and convert the second ultrasonic signal into second audio data with a three-dimensional effect, where the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium in a current environment;
the audio output module 404 is configured to play the second audio data.
Optionally, the audio output module 404 includes a left channel earphone and a right channel earphone, and the left channel earphone and the right channel earphone are respectively connected to one of the ultrasonic receiving modules 403.
In the embodiment of the application, the audio playing device including the left and right channel earphones correspondingly, in order to enable the audio effects heard by the user through the left and right channel earphones to be different, the second ultrasonic signal can be received by respectively arranging one ultrasonic receiving module in the left and right channel earphones, so that the effect that the user receives the environmental sound through two ears can be simulated, and the three-dimensional effect of the played audio data can be enhanced.
The utility model provides an audio playback equipment, through outwards sending audio data conversion ultrasonic signal, this ultrasonic signal is after the propagation medium reflection of current environment, absorbed some energy by the propagation medium, first ultrasonic signal with decay delay has been produced, it is received as second ultrasonic signal to superpose first ultrasonic signal again, consequently, the audio data that the conversion of this second ultrasonic signal obtained has the sound source sound wave of just as audio data by the superimposed three-dimensional effect of reflection of surrounding environment in the real scene, thereby can carry out the broadcast of three-dimensional effect to audio data conveniently.
Optionally, as shown in fig. 7, an electronic device 500 is further provided in this embodiment of the present application, and includes a processor 501, a memory 502, and a program or an instruction stored in the memory 502 and executable on the processor 501, where the program or the instruction is executed by the processor 501 to implement each process of the foregoing audio playing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 600 includes, but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, a processor 610, and the like.
Those skilled in the art will appreciate that the electronic device 600 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 610 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The processor 610 is configured to obtain first audio data to be played;
the radio frequency unit 601 is configured to convert the first audio data into a first ultrasonic signal through the ultrasonic transducer, and send the first ultrasonic signal to the outside;
receiving a second ultrasonic signal through the ultrasonic transducer, and converting the second ultrasonic signal into second audio data with a three-dimensional effect, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment;
an audio output unit 604, configured to play the second audio data.
The embodiment of the application converts the audio data into the ultrasonic signal to be sent outwards, the ultrasonic signal is reflected by the propagation medium of the current environment, and then is absorbed by the propagation medium, so that the first ultrasonic signal with attenuation delay is generated, and the first ultrasonic signal is superposed to be received as the second ultrasonic signal, therefore, the audio data obtained by playing the second ultrasonic signal conversion has the three-dimensional effect just like that the sound waves generated by the sound source of the audio data are reflected and superposed by the surrounding environment in the real scene, and therefore, the audio data can be conveniently played with the three-dimensional effect.
Optionally, the radio frequency unit 601 is further configured to transmit the first ultrasonic signal according to a preset beam angle.
Optionally, the radio frequency unit 601 is further configured to transmit the first ultrasonic signal according to a preset beam angle and a preset vibration frequency;
and receiving a second ultrasonic signal with a preset vibration frequency.
Optionally, the processor 610 is further configured to encode the first audio data according to a preset encoding format to obtain a plurality of first audio data frames;
converting the plurality of first audio data frames into a first ultrasonic signal;
converting the second ultrasonic signal into a plurality of second audio data frames;
and decoding the plurality of second audio data frames according to a preset coding format to obtain second audio data.
Optionally, the second audio data frame comprises at least: a start code and an end code, wherein the preset coding format at least comprises: the corresponding relation between the start code and the end code and the length of a preset data frame;
optionally, the processor 610 is further configured to split the first audio data according to a length of a preset data frame to obtain a plurality of audio data frames;
according to the sequence relation of the audio data frames, respectively adding a start code and an end code with a preset corresponding relation to the adjacent audio data frames to obtain a plurality of first audio data frames;
and splicing the plurality of second audio data frames according to the preset corresponding relation between the start code and the end code to obtain second audio data.
The scheme also converts the audio data into the ultrasonic signals for transmission after dividing the audio data into a plurality of audio data frames according to the preset coding format, thereby avoiding the problem of data loss caused by overlong audio data and improving the stability of ultrasonic signal transmission. And still through adding the start code and the end code in giving the audio data frame to splice the audio data frame according to the corresponding relation between start code and the end code, when guaranteeing that audio data is converted into ultrasonic signal and transmits, even received by other equipment, also can not be acquireed maliciously, guaranteed that audio data converts into ultrasonic data and transmits's security.
It is to be understood that, in the embodiment of the present application, the input Unit 604 may include a Graphics Processing Unit (image processor) 6041 and a microphone 6042, and the Graphics processor 6041 processes image data of a still picture or a video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 607 includes a touch panel 6071 and other input devices 6072. A touch panel 6071, also referred to as a touch screen. The touch panel 6071 may include two parts of a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 609 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 610 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 610.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned audio playing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above-mentioned audio playing method embodiment, and can achieve the same technical effect, and is not described here again to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. An audio playing method, the method comprising:
acquiring first audio data;
converting the first audio data into a first ultrasonic signal and transmitting the first ultrasonic signal;
receiving a second ultrasonic signal, and converting the second ultrasonic signal into second audio data, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment;
and playing the second audio data.
2. The method of claim 1, wherein said transmitting the first ultrasonic signal comprises:
and transmitting the first ultrasonic signal according to a preset beam angle.
3. The method of claim 2, wherein said transmitting said first ultrasonic signal at a preset beam angle comprises:
transmitting the first ultrasonic signal according to a preset beam angle and a preset vibration frequency;
the receiving a second ultrasonic signal includes:
and receiving a second ultrasonic signal with a preset vibration frequency.
4. The method of claim 1, wherein said converting the first audio data into a first ultrasonic signal comprises:
coding the first audio data according to a preset coding format to obtain a plurality of first audio data frames;
converting the plurality of first audio data frames into a first ultrasonic signal;
the converting the second ultrasonic signal into second audio data includes:
converting the second ultrasonic signal into a plurality of second audio data frames;
and decoding the plurality of second audio data frames according to a preset coding format to obtain second audio data.
5. The method of claim 4, wherein the second audio data frame comprises at least: a start code and an end code, wherein the preset coding format at least comprises: the corresponding relation between the start code and the end code and the length of a preset data frame;
the encoding the first audio data according to a preset encoding format to obtain a plurality of first audio data frames includes:
splitting the first audio data according to the length of a preset data frame to obtain a plurality of audio data frames;
according to the sequence relation of the audio data frames, respectively adding a start code and an end code with a preset corresponding relation to the adjacent audio data frames to obtain a plurality of first audio data frames;
the decoding the plurality of second audio data frames according to the preset coding format to obtain second audio data includes:
and splicing the plurality of second audio data frames according to the preset corresponding relation between the start code and the end code to obtain second audio data.
6. An audio playback apparatus, comprising:
the acquisition module is used for acquiring first audio data to be played;
the first conversion module is used for converting the first audio data into a first ultrasonic signal and transmitting the first ultrasonic signal;
the second conversion module is used for receiving a second ultrasonic signal and converting the second ultrasonic signal into second audio data, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment;
and the playing module is used for playing the second audio data.
7. An audio playback apparatus, characterized in that the audio playback apparatus comprises at least: the ultrasonic wave transmitting module, the ultrasonic wave receiving module, the processor and the audio output module;
the processor is used for acquiring first audio data to be played;
the ultrasonic transmitting module is used for converting the first audio data into a first ultrasonic signal and sending the first ultrasonic signal outwards;
the ultrasonic receiving module is used for receiving a second ultrasonic signal and converting the second ultrasonic signal into second audio data with a three-dimensional effect, wherein the second ultrasonic signal is obtained by reflecting the first ultrasonic signal through a propagation medium of the current environment;
and the audio output module is used for playing the second audio data.
8. The audio playback device of claim 7, wherein the audio output module comprises a left channel earphone and a right channel earphone, and the left channel earphone and the right channel earphone are respectively connected to one of the ultrasonic receiving modules.
9. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the audio playback method of any of claims 1-5.
10. A readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the audio playback method according to claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011589502.4A CN112770228A (en) | 2020-12-28 | 2020-12-28 | Audio playing method and device, audio playing equipment, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011589502.4A CN112770228A (en) | 2020-12-28 | 2020-12-28 | Audio playing method and device, audio playing equipment, electronic equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112770228A true CN112770228A (en) | 2021-05-07 |
Family
ID=75696892
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011589502.4A Pending CN112770228A (en) | 2020-12-28 | 2020-12-28 | Audio playing method and device, audio playing equipment, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112770228A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116366169A (en) * | 2023-06-01 | 2023-06-30 | 浙江大学 | Ultrasonic channel modeling method, electronic device and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1507701A (en) * | 2001-05-07 | 2004-06-23 | Parametric virtual speaker and surround-sound system | |
| CN101199441A (en) * | 2006-12-15 | 2008-06-18 | 游志军 | Sterosonic ultrasonic blindman-helping tool |
| CN103825660A (en) * | 2014-01-28 | 2014-05-28 | 华南理工大学 | Encoding and decoding methods and system in secondary ultrasonic communication |
| CN103995483A (en) * | 2014-05-07 | 2014-08-20 | 北京爱信德科技有限公司 | Control method, device and system of ultrasonic transducer |
| JP2016001775A (en) * | 2014-06-11 | 2016-01-07 | サクサ株式会社 | Super-directional microphone system |
| CN107371096A (en) * | 2017-08-28 | 2017-11-21 | 深圳传音通讯有限公司 | The method that orientation broadcast loudspeaker and orientation play audio |
| CN107786299A (en) * | 2016-08-25 | 2018-03-09 | 华为技术有限公司 | A kind of method, apparatus and network system for sending and receiving business |
| CN110519450A (en) * | 2019-07-31 | 2019-11-29 | Oppo广东移动通信有限公司 | Ultrasonic processing method, device, electronic equipment and computer-readable medium |
| CN110933558A (en) * | 2019-12-17 | 2020-03-27 | 京东方科技集团股份有限公司 | Directional sound production method and device, ultrasonic transducer and electronic equipment |
| CN111917489A (en) * | 2020-07-30 | 2020-11-10 | 维沃移动通信有限公司 | Audio signal processing method and device and electronic equipment |
-
2020
- 2020-12-28 CN CN202011589502.4A patent/CN112770228A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1507701A (en) * | 2001-05-07 | 2004-06-23 | Parametric virtual speaker and surround-sound system | |
| CN101199441A (en) * | 2006-12-15 | 2008-06-18 | 游志军 | Sterosonic ultrasonic blindman-helping tool |
| CN103825660A (en) * | 2014-01-28 | 2014-05-28 | 华南理工大学 | Encoding and decoding methods and system in secondary ultrasonic communication |
| CN103995483A (en) * | 2014-05-07 | 2014-08-20 | 北京爱信德科技有限公司 | Control method, device and system of ultrasonic transducer |
| JP2016001775A (en) * | 2014-06-11 | 2016-01-07 | サクサ株式会社 | Super-directional microphone system |
| CN107786299A (en) * | 2016-08-25 | 2018-03-09 | 华为技术有限公司 | A kind of method, apparatus and network system for sending and receiving business |
| CN107371096A (en) * | 2017-08-28 | 2017-11-21 | 深圳传音通讯有限公司 | The method that orientation broadcast loudspeaker and orientation play audio |
| CN110519450A (en) * | 2019-07-31 | 2019-11-29 | Oppo广东移动通信有限公司 | Ultrasonic processing method, device, electronic equipment and computer-readable medium |
| CN110933558A (en) * | 2019-12-17 | 2020-03-27 | 京东方科技集团股份有限公司 | Directional sound production method and device, ultrasonic transducer and electronic equipment |
| CN111917489A (en) * | 2020-07-30 | 2020-11-10 | 维沃移动通信有限公司 | Audio signal processing method and device and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116366169A (en) * | 2023-06-01 | 2023-06-30 | 浙江大学 | Ultrasonic channel modeling method, electronic device and storage medium |
| CN116366169B (en) * | 2023-06-01 | 2023-10-24 | 浙江大学 | Ultrasonic channel modeling method, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11128976B2 (en) | Representing occlusion when rendering for computer-mediated reality systems | |
| CN102480671B (en) | Audio processing method and device in video communication | |
| US11429340B2 (en) | Audio capture and rendering for extended reality experiences | |
| US11140503B2 (en) | Timer-based access for audio streaming and rendering | |
| CN106664488A (en) | Driving parametric speakers as a function of tracked user location | |
| US11317236B2 (en) | Soundfield adaptation for virtual reality audio | |
| EP4062404B1 (en) | Priority-based soundfield coding for virtual reality audio | |
| US11611841B2 (en) | Audio processing method and apparatus | |
| GB2590256A (en) | Method and device for processing audio signal | |
| WO2021003397A1 (en) | Password-based authorization for audio rendering | |
| CN114041113A (en) | Privacy partitioning and authorization for audio rendering | |
| CN111696513A (en) | Audio signal processing method and device, electronic equipment and storage medium | |
| US20220394414A1 (en) | Sound effect optimization method, electronic device, and storage medium | |
| CN108810860B (en) | Audio transmission method, terminal equipment and main earphone | |
| CN108269460B (en) | Electronic screen reading method and system and terminal equipment | |
| CN114067810A (en) | Audio signal rendering method and device | |
| US20240214765A1 (en) | Signal processing method and apparatus for audio rendering, and electronic device | |
| CN109121069B (en) | 3D sound effect processing method and related product | |
| CN108924705B (en) | 3D sound effect processing method and related product | |
| CN112770228A (en) | Audio playing method and device, audio playing equipment, electronic equipment and medium | |
| CN113115175B (en) | 3D sound effect processing method and related product | |
| CN106371800A (en) | Audio output method and device | |
| JP2024534274A (en) | Vibration motor control method, vibration motor control device, storage medium, and electronic device | |
| CN116939473A (en) | Audio generation method and related device | |
| KR102331229B1 (en) | Spatial voice virtual reality server and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210507 |
|
| RJ01 | Rejection of invention patent application after publication |