CN111432384A - Large data volume audio Bluetooth real-time transmission method for equipment with recording function - Google Patents
Large data volume audio Bluetooth real-time transmission method for equipment with recording function Download PDFInfo
- Publication number
- CN111432384A CN111432384A CN202010193028.7A CN202010193028A CN111432384A CN 111432384 A CN111432384 A CN 111432384A CN 202010193028 A CN202010193028 A CN 202010193028A CN 111432384 A CN111432384 A CN 111432384A
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- bluetooth
- transmission
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 98
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000004590 computer program Methods 0.000 claims abstract description 20
- 230000006835 compression Effects 0.000 claims abstract description 17
- 238000007906 compression Methods 0.000 claims abstract description 17
- 238000012545 processing Methods 0.000 claims description 37
- 230000006870 function Effects 0.000 claims description 36
- 230000015654 memory Effects 0.000 claims description 23
- 238000009432 framing Methods 0.000 claims description 11
- 238000009825 accumulation Methods 0.000 abstract description 2
- 238000005457 optimization Methods 0.000 abstract description 2
- 239000013589 supplement Substances 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 18
- 238000004891 communication Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 238000007689 inspection Methods 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 235000019800 disodium phosphate Nutrition 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000047 product Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000013518 transcription Methods 0.000 description 1
- 230000035897 transcription Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
- H04W28/065—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information using assembly or disassembly of packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/10—Flow control between communication endpoints
- H04W28/14—Flow control between communication endpoints using intermediate storage
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Circuit For Audible Band Transducer (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention discloses a method, a device and equipment for real-time transmission of large-data-volume audio Bluetooth of equipment with a recording function, and correspondingly provides a computer-readable storage medium and a computer program product. The concept of the invention is to segment the audio with large data volume from the perspective of audio transmission according to the limitation of Bluetooth transmission and data format, examine the data accumulation degree based on the compression ratio in stages, and then adopt the follow-up operations of waiting for continuous data supplement or taking a certain amount of data for coding, transmission and the like, and in this way, the data distribution optimization is carried out on the Bluetooth transmission layer, thereby effectively adapting to the requirement of specific equipment and scenes for the Bluetooth real-time transmission of the audio with large data volume.
Description
Technical Field
The invention relates to the technical field of data transmission, in particular to a method, a device and equipment for large-data-volume audio Bluetooth real-time transmission of equipment with a recording function.
Background
Currently, bluetooth transmission mainly aims at data with small data volume or non-real-time transmission, such as instruction transmission of a presenter, data interaction between an intelligent terminal and a PC, and the like.
In the face of the corresponding service requirements of the continuously expanded and extended application scenarios, the existing bluetooth transmission technology cannot better adapt to the requirements of certain specific tasks, for example, but not limited to, in some meeting occasions, continuous large amounts of voice data collected and recorded in real time need to be synchronized to a slave end or a computing platform in real time for processing such as online storage, recognition transcription or no delay translation, however, a targeted scheme for performing real-time large-data-volume audio transmission by using bluetooth by using a device with a recording function is not solved at present.
Disclosure of Invention
The invention aims to provide a method, a device and equipment for Bluetooth real-time transmission of large-data-volume audio frequency of equipment with a recording function, and correspondingly provides a computer readable storage medium and a computer program product, so as to realize real-time transmission of large-data-volume audio frequency data through Bluetooth technology in specific equipment and application scenes.
The technical scheme adopted by the invention is as follows:
in a first aspect, the present invention provides a method for bluetooth real-time transmission of large data volume audio for a device with a recording function, including:
collecting and recording audio data in real time;
continuously adding each frame of received audio data into an array created based on a preset compression ratio; each frame of audio data is obtained by performing framing processing on received continuous audio according to the limit value and the data format of the Bluetooth cache;
continuously checking whether the array reaches a preset data volume;
if not, suspending the Bluetooth transmission to the back end and continuing to wait for the front end data addition;
and if so, the audio data with the preset data volume is taken for coding, and Bluetooth transmission is carried out to the rear end.
In one possible implementation manner, the method further includes: and after the audio data are coded, carrying out byte reference processing on the array.
In one possible implementation manner, the continuously appending each frame of received audio data to an array created based on a preset compression ratio specifically includes:
receiving audio data input by a front end in real time according to a preset time period;
storing the audio data acquired in each time period into the array;
audio data is continuously appended to the array in the manner described above.
In one possible implementation manner, the checking whether the array reaches a preset data amount includes:
checking whether the array reaches a preset data volume at regular time according to a preset time interval;
and, the larger the audio data of each frame obtained by framing, the smaller the time interval.
In one possible implementation, the preset data amount is set based on the compression ratio.
In a second aspect, the present invention provides a large data volume audio bluetooth real-time transmission apparatus for a device with recording function, comprising:
the front-end recording module is used for acquiring and recording audio data in real time;
the array creating module is used for creating an array based on a preset compression ratio;
the data appending module is used for continuously appending each frame of received audio data to the array; each frame of audio data is obtained by performing framing processing on received continuous audio according to the limit value and the data format of the Bluetooth cache;
the data processing module comprises a data volume checking unit, a pause unit and a coding transmission unit;
the data volume checking unit is used for continuously checking whether the array reaches a preset data volume;
the pause unit is used for pausing the Bluetooth transmission to the rear end and continuing to wait for the data addition of the front end when the output of the data quantity check unit is negative;
and the coding transmission unit is used for coding the audio data with the preset data volume and carrying out Bluetooth transmission to the rear end when the output of the data volume checking unit is yes.
In one possible implementation manner, the apparatus further includes: a reference processing module;
the reference processing module is used for performing byte reference processing on the array after the audio data is coded.
In one possible implementation manner, the data appending module is specifically configured to receive audio data collected and recorded in real time at a front end according to a preset time period; storing the audio data acquired in each time period into the array; audio data is continuously appended to the array in the manner described above.
In one possible implementation manner, the data amount checking unit is specifically configured to regularly check whether the array reaches a preset data amount according to a preset time interval; and, the larger the audio data of each frame obtained by framing, the smaller the time interval.
In one possible implementation, the preset data amount is set based on the compression ratio.
In a third aspect, the present invention provides an apparatus having a recording function, including:
one or more processors, memory which may employ a non-volatile storage medium, and one or more computer programs stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the method as in the first aspect or any possible implementation of the first aspect.
In a fourth aspect, the present invention provides a computer-readable storage medium having stored thereon a computer program which, when run on a computer, causes the computer to perform the method as described in the first aspect or any possible implementation manner of the first aspect.
In a fifth aspect, the present invention also provides a computer program product for performing the method of the first aspect or any possible implementation manner of the first aspect, when the computer program product is executed by a computer.
In a possible design of the fifth aspect, the relevant program related to the product may be stored in whole or in part on a memory packaged with the processor, or may be stored in part or in whole on a storage medium not packaged with the processor.
The invention has the conception that when facing audio data with large data volume which cannot be transmitted in real time through Bluetooth, the invention breaks away from the constraint of a system level and avoids the adjustment and adaptation of the Bluetooth technology, and provides the improvement proposal of the aspects from the aspect of audio transmission, in particular, the invention segments the audio with large data volume according to the limitation of the Bluetooth transmission and the data format, examines the data accumulation degree on the basis of the compression ratio in stages, and then waits for continuous data supplement or takes a certain amount of data for subsequent operations such as coding and transmission, and the like, and the invention circularly reciprocates in the way, performs data distribution optimization on the Bluetooth transmission level, and can effectively adapt to the requirements of specific equipment and scenes for the real-time transmission of the audio data with large data volume.
Drawings
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described with reference to the accompanying drawings, in which:
FIG. 1 is a flowchart of an embodiment of a method for Bluetooth real-time transmission of mass data audio for a device with recording capability according to the present invention;
FIG. 2 is a block diagram of an embodiment of the present invention for a mass audio Bluetooth real-time transmission device with recording function;
fig. 3 is a schematic diagram of an embodiment of an apparatus with a recording function according to the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative only and should not be construed as limiting the invention.
Before explaining the technical scheme of the invention, the following steps are also required:
the invention is primarily designed to have pertinence of relevant devices and application environments, firstly (1) about the process of continuously recording audio and transmitting audio in real time, wherein audio data are required to be received and sent from a front end, received and sent from a slave end and then received and stored in a terminal, the process is a non-offline flowing state, secondly (2) about the transmission requirement of large-scale data volume, the pertinence of the invention is further determined, namely, audio data involved in the technical implementation process are not small data because voice content determines that the audio data are not small data, in other words, the invention is more applicable to scenes containing a large amount of speech content, such as conferences, news, classrooms, speeches and the like, and thirdly (3) about transmission based on Bluetooth technology, the invention does not consider scenes of wireless transmission such as WIFI, 4G/5G and the like, but is designed for wireless transmission between devices and platforms under the aforementioned specific scenes and platforms, and the aforementioned devices under the aforementioned specific scenes, and the technical conditions are not limited to a short-distance wireless transmission medium, the invention is also referred to a short-distance wireless transmission medium 354G, the invention is also referred to a short-distance wireless transmission medium, the invention is also referred to a short distance wireless transmission medium, the invention is not limited to a wireless transmission medium, the invention is not only has a short distance calculation medium, and a medium is not only has a medium is referred to a medium, the invention is not limited to a medium is also referred to a medium, and a medium is a medium, and is referred to a medium is not a medium is capable of a medium capable of performing a wireless transmission, and performing a wireless transmission, the invention is not only is not capable of performing a wireless transmission, and performing a wireless.
It is found through research that the specific technical problems mentioned in the background art can avoid a more complex processing idea, that is, the entire operating system or the bluetooth technology itself does not need to be improved, but only a simple and easy way is made from a data transmission level, so that a dilemma can be broken, in other words, the invention provides the following embodiments for optimizing data distribution in a transmission stage on the premise that the bluetooth is not good for transmitting data with large data volume in real time, and is also related to data distribution in bluetooth transmission, and therefore, the invention introduces at least one data transmission scenario applicable to the invention, firstly, a device with a sound pickup part such as a microphone and the like collects a large amount of continuous voice information of a device user in real time, and performs audio coding on the device through a MTK chip, and then sends the coded audio data packet to a first B L E bluetooth module, after receiving the data packet, the first B L E bluetooth module sends the data packet to a second B L E module, the second B L E bluetooth module sends the data packet to a first B L E bluetooth module, and the data transmission scenario is a multi-stage transmission process, and a multi-stage data transmission process is realized by a multi-stage process, which is a multi-stage process data transmission process, and a multi-stage process data transmission process, which is based on a multi-stage data transmission process, wherein the concept of the invention is a multi-stage process, and is realized by adopting a multi-stage process technology process, and a multi-stage transmission scenario.
Specifically, the present invention provides an embodiment of a bluetooth real-time transmission method for large data volume audio of a device with a recording function, as shown in fig. 1, which may include:
step S0, audio data are collected and recorded in real time;
as mentioned above, the present invention is not limited to specific device objects, but it is clear that the device has a recording function, and in actual operation, the device necessarily has a recording component, such as but not limited to a microphone array; in particular, for the application scenario considered by the present invention, the audio data picked up by the recording component here may be streamed, following the speaking process of the user of the device, presenting a continuous recording process with recording and a real-time transmission.
Step S1, creating an array based on a preset compression ratio;
starting from this step, the specific implementation process proposed by the present invention for guiding real-time transmission of a large amount of audio data through bluetooth is provided, and it should be noted that the following transmission method may also not be limited to occur only in a local device, and when an application scenario requires multi-stage bluetooth real-time transmission between multiple devices and multiple platforms, the following transmission strategy may also be applied in any stage involved. Referring back to at least one embodiment of the creation of the array mentioned in this step, for example, but not limited to, for PCM format audio, especially for scenarios applying ADPCM, in order to ensure better sound quality, the preset maximum compression ratio may be 4, and then a static array of N x 4 x 2 (two channels), i.e., N x 8, where N is the size of each data frame, may be constructed in advance in an algorithm such as an MTK chip, which will be described in detail later.
Step S2, continuously adding each frame of received audio data into the array, wherein each frame of audio data is obtained by performing framing processing on received continuous audio according to the limit value and the data format of the Bluetooth cache;
three points need to be expanded specifically here:
first, as mentioned above, the custom array may be pre-fabricated in advance, that is, the operation of creating the array may not be included in the processing stage of the real-time synchronous transmission. However, the present invention does not exclude that in some preferred embodiments, the customized array may also be created in near real-time based on the data object dynamically during the process of picking up and transmitting audio, that is, the process of creating the array for specific device type, data format, etc. and the process of appending the audio picked up by the front end in real time to the array may occur simultaneously after the audio is picked up and recorded in real time, and the present invention is not limited thereto.
Secondly, the invention is to allocate guidance for real-time transmission of audio data with large data volume, and in this way, it is considered how to segment a large amount of input audio data on the premise of ensuring sound quality and time effectiveness, that is, each segmented frame audio cannot lose information and cannot affect transmission speed, so that the basis for segmenting the input audio is to ensure that a limit value of bluetooth buffer is reached on the premise that the data format is known, and if the limit value is exceeded, data can be lost, but if the limit value is not reached, the output quantity is small, so that the transmission speed is delayed, taking an application scenario involving ADPCM format audio and B L E bluetooth as an example, the size of each frame N can be generally understood as being the packet length sent by B L E minus 7, and the specific explanation is that, for example, the buffer limit value of B L E bluetooth 4.0 is 170, because there are 2 bytes before and after the packet, the data is occupied from 0, and at the same time, there is a header of 8 bytes, because N is 170-2-8-1, and B L.161 is 0, and N is 20.11.
And thirdly, when the data is stored specifically, the audio data input by the front end in real time can be received according to a preset time period, the audio data acquired in each time period is stored into the array, and the data is continuously added to the array in such a way. For example, every 20ms, the audio is received from the front end and interrupted, and the audio received this time is stored in an array.
Step S3, continuously checking whether the array reaches a preset data volume;
this data volume can be preset as a threshold for continued post-processing based on the actual requirements of the scene, for example, it can be preferably set based on the compression ratio, and as described in the previous example, it can be checked whether the array has accumulated a data volume greater than or equal to N x 4.
It should be further noted that the continuous inspection described herein refers to a global loop inspection state, and in actual operation, a time interval of each round of inspection may be specifically designed for this inspection step, that is, whether the array reaches a preset data amount is periodically inspected according to a preset time interval, obviously, the time interval herein is related to the size of the data frame, that is, the larger the audio data of each frame obtained by the framing processing, the smaller the time interval.
Continuing with the foregoing, there are necessarily at least two possibilities to examine the amount of accumulated data in an array:
(1) if the amount of data is not larger than the preset amount of data, step S4 in fig. 1 is executed to suspend the bluetooth transmission to the back end and continue to wait for the front end data addition. That is, the front end waits for the array to be complemented without subsequent processing operation.
(2) When the preset data amount is reached, step S5 in fig. 1 is executed, and audio data of the preset data amount is taken for encoding and bluetooth transmission to the back end. Based on the former example, N × 4 audio data may be taken from the array for encoding, transmission to the back end in a separate Block, decoding, etc. Each Block of ADPCM audio, for example, for two channels, will then be output with an 8-byte header to the back end.
In summary, the idea of the present invention is to propose the above embodiments and preferred solutions from the perspective of audio transmission, and in this way to guide the modules in the bluetooth transmission scenario to transmit messages (data packets) cyclically, for example, to perform the distribution of voice data at multiple ends in a block manner. Therefore, the data distribution is optimized for the requirements of real time and large data volume in the Bluetooth transmission layer, the data information is not lost in specific equipment and scenes, and the technical requirement of timeliness is met.
In addition, it may also be supplemented that, in some possible implementations of the present invention, in order to improve audio quality, the information is kept more completely in the process, and the implementation may further include: and after the audio data are coded, carrying out byte reference processing on the array. For example, but not limited to, by using a common reference algorithm such as a standard frame compression algorithm, the array is shifted left by N × 4-4 bytes, that is, the data shifted left by the array in this example is less than the read data by four bytes, and further, in order to ensure that the decoding is error-free, for an implementation mode using the reference processing, it is necessary to instruct a subsequent decoding process to pay attention to this point, and the present invention is not limited to and described in detail herein. The foregoing embodiments and their preferred solutions have been verified to achieve a packet loss rate of 0.37% for data transmitted over a transmission distance of 25 meters without obstacles, which is much higher than the standards in the industry and industry, and thus, the above solutions of the present invention make a significant field contribution to the foregoing specific technical requirements, and those skilled in the art can implement real-time bluetooth transmission for large data volumes, such as text, images, videos, and the like, based on the above technical implementation concepts.
Finally, it should be noted that the foregoing embodiment is described with audio data, but in actual operation, there may be mixed transmission while transmitting audio, that is, there may be instruction data in addition to audio data, and these small data may include data transmission in which, for example, they are transmitted together with the audio, in other words, in some embodiments of the present invention, during the real-time transmission of large data amount of audio data, data transmission of variable small data semaphore in an irregular manner is included, and the present invention is not limited thereto.
Corresponding to the above embodiments and preferred solutions, the present invention further provides an embodiment of a large data volume audio bluetooth real-time transmission apparatus for a device with a recording function, as shown in fig. 2, which may specifically include the following components:
the front-end recording module 0 is used for collecting and recording audio data in real time;
the array creating module 1 is used for creating an array based on a preset compression ratio;
a data appending module 2, configured to append each frame of received audio data to the array continuously; each frame of audio data is obtained by performing framing processing on received continuous audio according to the limit value and the data format of the Bluetooth cache;
a data processing module 3 including a data amount checking unit 31, a suspending unit 32, and an encoding transmission unit 33;
the data amount checking unit 31 is configured to continuously check whether the array reaches a preset data amount;
the pause unit 32 is configured to pause the bluetooth transmission to the back end and continue to wait for the front end data addition when the output of the data amount check unit is yes;
the encoding transmission unit 33 is configured to, when the output of the data amount check unit is negative, take the audio data of the preset data amount to encode, and perform bluetooth transmission to the backend.
In one possible implementation manner, the apparatus further includes: a reference processing module;
the reference processing module is used for performing byte reference processing on the array after the audio data is coded.
In one possible implementation manner, the data appending module is specifically configured to receive audio data input by a front end in real time according to a preset time period; storing the audio data acquired in each time period into the array; audio data is continuously appended to the array in the manner described above.
In one possible implementation manner, the data amount checking unit is specifically configured to regularly check whether the array reaches a preset data amount according to a preset time interval; and, the larger the audio data of each frame obtained by framing, the smaller the time interval.
In one possible implementation, the preset data amount is set based on the compression ratio.
It should be understood that the above division of the components of the apparatus for bluetooth real-time transmission of mass data of a device with recording function shown in fig. 2 is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these components may all be implemented in software invoked by a processing element; or may be implemented entirely in hardware; and part of the components can be realized in the form of calling by the processing element in software, and part of the components can be realized in the form of hardware. For example, a certain module may be a separate processing element, or may be integrated into a certain chip of the electronic device. Other components are implemented similarly. In addition, all or part of the components can be integrated together or can be independently realized. In implementation, each step of the above method or each component above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
For example, the above components may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), one or more microprocessors (DSPs), one or more Field Programmable Gate Arrays (FPGAs), etc. For another example, these components may be integrated together and implemented in the form of a System-On-a-Chip (SOC).
In view of the foregoing examples and their preferred embodiments, it will be appreciated by those skilled in the art that in practice, the invention may be practiced in a variety of embodiments, and that the invention is illustrated schematically in the following vectors:
(1) an apparatus having a recording function may include:
one or more processors, memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions, which when executed by the apparatus, cause the apparatus to perform the steps/functions of the foregoing embodiments or equivalent implementations.
Fig. 3 is a schematic structural diagram of an embodiment of the apparatus with a recording function according to the present invention, wherein the apparatus may be an electronic apparatus or a circuit apparatus built in the electronic apparatus. The electronic equipment can be a cloud server, a mobile terminal (mobile phone), a remote controller, a page turner, a smart screen, an Unmanned Aerial Vehicle (UAV), an intelligent vehicle (ICV), an on-board equipment (OB) or the like. The embodiment does not limit the specific form of the apparatus having the recording function.
As shown in particular in FIG. 3, a device 900 with sound recording capabilities includes a processor 910 and a memory 930. Wherein, the processor 910 and the memory 930 can communicate with each other and transmit control and/or data signals through the internal connection path, the memory 930 is used for storing computer programs, and the processor 910 is used for calling and running the computer programs from the memory 930. The processor 910 and the memory 930 may be combined into a single processing device, or more generally, separate components, and the processor 910 is configured to execute the program code stored in the memory 930 to implement the functions described above. In particular implementations, the memory 930 may be integrated with the processor 910 or may be separate from the processor 910.
In addition, in order to further improve the functions of the apparatus 900 having the sound recording function, the apparatus 900 may further include one or more of an input unit 960, a display unit 970, an audio circuit 980, a camera 990, a sensor 901, and the like, which may further include a speaker 982, a microphone 984, and the like. The display unit 970 may include a display screen, among others.
Further, the device 900 with sound recording function may further include a power supply 950 for supplying power to various devices or circuits in the device 900.
It should be understood that the device 900 with sound recording function shown in fig. 3 can implement the processes of the methods provided by the foregoing embodiments. The operations and/or functions of the various components of the apparatus 900 may each be configured to implement the corresponding flow in the above-described method embodiments. Reference is made in detail to the foregoing description of embodiments of the method, apparatus, etc., and a detailed description is omitted here as appropriate to avoid redundancy.
It should be understood that the processor 910 in the apparatus 900 with sound recording function shown in fig. 3 may be a system on a chip SOC, and the processor 910 may include a Central Processing Unit (CPU), and may further include other types of processors, such as: an image Processing Unit (GPU), etc., which will be described in detail later.
In summary, various portions of the processors or processing units within the processor 910 may cooperate to implement the foregoing method flows, and corresponding software programs for the various portions of the processors or processing units may be stored in the memory 930.
(2) A readable storage medium, on which a computer program or the above-mentioned apparatus is stored, which, when executed, causes the computer to perform the steps/functions of the above-mentioned embodiments or equivalent implementations.
In the several embodiments provided by the present invention, any function, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer readable storage medium. Based on this understanding, some aspects of the present invention may be embodied in the form of software products, which are described below, or portions thereof, which substantially contribute to the art.
(3) A computer program product (which may include the above apparatus) when running on a terminal device, causes the terminal device to execute the method for bluetooth real-time transmission of large data volume audio for a device with recording function of the foregoing embodiment or an equivalent embodiment.
From the above description of the embodiments, it is clear to those skilled in the art that all or part of the steps in the above implementation method can be implemented by software plus a necessary general hardware platform. With this understanding, the above-described computer program products may include, but are not limited to, refer to APP; continuing on, the aforementioned device/terminal may be a computer device (e.g., a mobile phone, a PC terminal, a cloud platform, a server cluster, or a network communication device such as a media gateway). Moreover, the hardware structure of the computer device may further specifically include: at least one processor, at least one communication interface, at least one memory, and at least one communication bus; the processor, the communication interface and the memory can all complete mutual communication through the communication bus. The processor may be a central Processing unit CPU, a DSP, a microcontroller, or a digital Signal processor, and may further include a GPU, an embedded Neural Network Processor (NPU), and an Image Signal Processing (ISP), and may further include a specific integrated circuit ASIC, or one or more integrated circuits configured to implement the embodiments of the present invention, and the processor may have a function of operating one or more software programs, and the software programs may be stored in a storage medium such as a memory; and the aforementioned memory/storage media may comprise: non-volatile memories (non-volatile memories) such as non-removable magnetic disks, U-disks, removable hard disks, optical disks, etc., and Read-Only memories (ROM), Random Access Memories (RAM), etc.
In the embodiments of the present invention, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, and means that there may be three relationships, for example, a and/or B, and may mean that a exists alone, a and B exist simultaneously, and B exists alone. Wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c may represent: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b and c can be single or multiple.
Those of skill in the art will appreciate that the various modules, elements, and method steps described in the embodiments disclosed in this specification can be implemented as electronic hardware, combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In addition, the embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other. In particular, for embodiments of devices, apparatuses, etc., since they are substantially similar to the method embodiments, reference may be made to some of the descriptions of the method embodiments for their relevant points. The above-described embodiments of devices, apparatuses, etc. are merely illustrative, and modules, units, etc. described as separate components may or may not be physically separate, and may be located in one place or distributed in multiple places, for example, on nodes of a system network. Some or all of the modules and units can be selected according to actual needs to achieve the purpose of the above-mentioned embodiment. Can be understood and carried out by those skilled in the art without inventive effort.
The structure, features and effects of the present invention have been described in detail with reference to the embodiments shown in the drawings, but the above embodiments are merely preferred embodiments of the present invention, and it should be understood that technical features related to the above embodiments and preferred modes thereof can be reasonably combined and configured into various equivalent schemes by those skilled in the art without departing from and changing the design idea and technical effects of the present invention; therefore, the invention is not limited to the embodiments shown in the drawings, and all the modifications and equivalent embodiments that can be made according to the idea of the invention are within the scope of the invention as long as they are not beyond the spirit of the description and the drawings.
Claims (10)
1. A large data volume audio Bluetooth real-time transmission method for a device with a recording function is characterized by comprising the following steps:
collecting and recording audio data in real time;
continuously adding each frame of received audio data into an array created based on a preset compression ratio; each frame of audio data is obtained by performing framing processing on received continuous audio according to the limit value and the data format of the Bluetooth cache;
continuously checking whether the array reaches a preset data volume;
if not, suspending the Bluetooth transmission to the back end and continuing to wait for the front end data addition;
and if so, the audio data with the preset data volume is taken for coding, and Bluetooth transmission is carried out to the rear end.
2. The method of claim 1, wherein the method further comprises: and after the audio data are coded, carrying out byte reference processing on the array.
3. The bluetooth real-time transmission method for mass data of audio frequency of a device with recording function as claimed in claim 1, wherein said continuously appending each frame of received audio data to an array created based on a preset compression ratio specifically comprises:
receiving audio data input by a front end in real time according to a preset time period;
storing the audio data acquired in each time period into the array;
audio data is continuously appended to the array in the manner described above.
4. The method of claim 1, wherein the checking whether the array reaches a preset data volume comprises:
checking whether the array reaches a preset data volume at regular time according to a preset time interval;
and, the larger the audio data of each frame obtained by framing, the smaller the time interval.
5. The method for Bluetooth real-time transmission of large data volume audio frequency of a device with a recording function according to any one of claims 1 to 4, wherein the preset data volume is set based on the compression ratio.
6. A real-time transmission device of big data volume audio frequency bluetooth for having recording function equipment, its characterized in that includes:
the front-end recording module is used for acquiring and recording audio data in real time;
the array creating module is used for creating an array based on a preset compression ratio;
the data appending module is used for continuously appending each frame of received audio data to the array; each frame of audio data is obtained by performing framing processing on received continuous audio according to the limit value and the data format of the Bluetooth cache;
the data processing module comprises a data volume checking unit, a pause unit and a coding transmission unit;
the data volume checking unit is used for continuously checking whether the array reaches a preset data volume;
the pause unit is used for pausing the Bluetooth transmission to the rear end and continuing to wait for the data addition of the front end when the output of the data quantity check unit is negative;
and the coding transmission unit is used for coding the audio data with the preset data volume and carrying out Bluetooth transmission to the rear end when the output of the data volume checking unit is yes.
7. The apparatus for Bluetooth real-time transmission of mass data of audio for a device with recording function according to claim 6, wherein said apparatus further comprises: a reference processing module;
the reference processing module is used for performing byte reference processing on the array after the audio data is coded.
8. An apparatus having a recording function, comprising:
one or more processors, a memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the method of any of claims 1-5 for large data volume audio Bluetooth real-time transmission for a recording capable apparatus.
9. A computer-readable storage medium, in which a computer program is stored which, when run on a computer, causes the computer to execute the method for bluetooth real-time transmission of mass data audio for a device with recording functionality as claimed in any one of claims 1 to 5.
10. A computer program product, which, when running on a terminal device, causes the terminal device to execute the method of any one of claims 1 to 5 for real-time transmission of mass audio Bluetooth for a device having a recording function.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010193028.7A CN111432384B (en) | 2020-03-18 | 2020-03-18 | Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010193028.7A CN111432384B (en) | 2020-03-18 | 2020-03-18 | Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111432384A true CN111432384A (en) | 2020-07-17 |
| CN111432384B CN111432384B (en) | 2023-05-09 |
Family
ID=71547550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010193028.7A Active CN111432384B (en) | 2020-03-18 | 2020-03-18 | Large-data-volume audio Bluetooth real-time transmission method for equipment with recording function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111432384B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113342306A (en) * | 2021-06-18 | 2021-09-03 | 广州市保伦电子有限公司 | 2-path audio mixing method and processing terminal |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105405325A (en) * | 2015-12-22 | 2016-03-16 | 深圳市时尚德源文化传播有限公司 | Network teaching method and system |
| CN106603543A (en) * | 2016-12-22 | 2017-04-26 | 努比亚技术有限公司 | Corrected streaming media audio and video synchronizing method and apparatus |
| CN107040832A (en) * | 2017-04-22 | 2017-08-11 | 广州市比丽普电子有限公司 | A kind of handheld terminal formula microphone system based on Bluetooth technology |
| CN108882216A (en) * | 2018-08-17 | 2018-11-23 | 深圳市芯中芯科技有限公司 | A kind of audio data transmission method and system based on bluetooth BLE technology |
| CN109150399A (en) * | 2018-08-14 | 2019-01-04 | Oppo广东移动通信有限公司 | Data transmission method, device, electronic equipment and computer-readable medium |
| CN109348464A (en) * | 2018-11-23 | 2019-02-15 | 深圳时空壶技术有限公司 | Data transmission method and receiving device for low-power consumption bluetooth receiving device |
| US20190104423A1 (en) * | 2017-09-29 | 2019-04-04 | Apple Inc. | Ultra-low latency audio over bluetooth |
| CN109584889A (en) * | 2018-12-28 | 2019-04-05 | 秒针信息技术有限公司 | Audio frequency transmission method and device and storage medium |
| CN110189753A (en) * | 2019-05-28 | 2019-08-30 | 北京百度网讯科技有限公司 | Baffle Box of Bluetooth and its control method, system and storage medium |
| CN110225399A (en) * | 2019-06-19 | 2019-09-10 | 深圳市共进电子股份有限公司 | Streaming Media processing method, device, computer equipment and storage medium |
-
2020
- 2020-03-18 CN CN202010193028.7A patent/CN111432384B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105405325A (en) * | 2015-12-22 | 2016-03-16 | 深圳市时尚德源文化传播有限公司 | Network teaching method and system |
| CN106603543A (en) * | 2016-12-22 | 2017-04-26 | 努比亚技术有限公司 | Corrected streaming media audio and video synchronizing method and apparatus |
| CN107040832A (en) * | 2017-04-22 | 2017-08-11 | 广州市比丽普电子有限公司 | A kind of handheld terminal formula microphone system based on Bluetooth technology |
| US20190104423A1 (en) * | 2017-09-29 | 2019-04-04 | Apple Inc. | Ultra-low latency audio over bluetooth |
| CN109150399A (en) * | 2018-08-14 | 2019-01-04 | Oppo广东移动通信有限公司 | Data transmission method, device, electronic equipment and computer-readable medium |
| CN108882216A (en) * | 2018-08-17 | 2018-11-23 | 深圳市芯中芯科技有限公司 | A kind of audio data transmission method and system based on bluetooth BLE technology |
| CN109348464A (en) * | 2018-11-23 | 2019-02-15 | 深圳时空壶技术有限公司 | Data transmission method and receiving device for low-power consumption bluetooth receiving device |
| CN109584889A (en) * | 2018-12-28 | 2019-04-05 | 秒针信息技术有限公司 | Audio frequency transmission method and device and storage medium |
| CN110189753A (en) * | 2019-05-28 | 2019-08-30 | 北京百度网讯科技有限公司 | Baffle Box of Bluetooth and its control method, system and storage medium |
| CN110225399A (en) * | 2019-06-19 | 2019-09-10 | 深圳市共进电子股份有限公司 | Streaming Media processing method, device, computer equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113342306A (en) * | 2021-06-18 | 2021-09-03 | 广州市保伦电子有限公司 | 2-path audio mixing method and processing terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111432384B (en) | 2023-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110121114B (en) | Method for transmitting stream data and data transmitting apparatus | |
| CN110430441B (en) | Cloud mobile phone video acquisition method, system, device and storage medium | |
| WO2023284445A1 (en) | Video stream processing method and apparatus, device, storage medium, and program product | |
| WO2021052374A1 (en) | Network congestion control method, node, system and storage medium | |
| US20200344497A1 (en) | Method and apparatus for processing multimedia file, storage medium, and electronic apparatus | |
| CN113285931B (en) | Streaming media transmission method, streaming media server and streaming media system | |
| CN103248964A (en) | Vehicle-mounted video transmission system based on Real Time Protocol (RTP)/RTCP (Real-time Transport Control Protocol) | |
| CN109547162B (en) | Data communication method based on two sets of one-way boundaries | |
| CN108881955A (en) | A kind of method and system for realizing the output of distributed node equipment audio video synchronization | |
| CN113490055B (en) | Data processing method and device | |
| CN104506287A (en) | Real-time sound communication method under TD-LTE (time division-long term evolution) emergency communication | |
| CN107613409A (en) | The processing method and processing device of multi-medium data | |
| CN114640886A (en) | Bandwidth-adaptive audio and video transmission method and device, computer equipment and medium | |
| CN111432384A (en) | Large data volume audio Bluetooth real-time transmission method for equipment with recording function | |
| CN108476176A (en) | Real-time transport protocol Research of Congestion Control Techniques in visual telephone | |
| CN107430496A (en) | Frame is abandoned for long-range display | |
| CN109587082A (en) | A kind of asynchronous repeater system of message based on (SuSE) Linux OS and method | |
| CN111277580B (en) | Node data sending method, receiving method and transmission method | |
| CN109951532B (en) | DPDK-based automatic flow model conversion device | |
| CN111787417B (en) | Audio and video transmission control method based on artificial intelligence AI and related equipment | |
| CN114666776A (en) | Data transmission method, device, equipment and readable storage medium | |
| CN113242446B (en) | Video frame caching method, video frame forwarding method, communication server and program product | |
| CN109918325B (en) | Interface conversion bridge based on Avalon bus, interface conversion method and system | |
| CN116346720A (en) | Information transmission device and method | |
| CN108200481B (en) | RTP-PS stream processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |