CN111372107B - Audio transmission method, device, system and computer readable storage medium - Google Patents
Audio transmission method, device, system and computer readable storage medium Download PDFInfo
- Publication number
- CN111372107B CN111372107B CN201811599146.7A CN201811599146A CN111372107B CN 111372107 B CN111372107 B CN 111372107B CN 201811599146 A CN201811599146 A CN 201811599146A CN 111372107 B CN111372107 B CN 111372107B
- Authority
- CN
- China
- Prior art keywords
- audio
- user
- audio data
- application
- receiving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/4221—Dedicated function buttons, e.g. for the control of an EPG, subtitles, aspect ratio, picture-in-picture or teletext
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42222—Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Telephone Function (AREA)
Abstract
The disclosure relates to an audio transmission method, an audio transmission device, an audio transmission system and a computer-readable storage medium, and relates to the technical field of computers. The method of the present disclosure comprises: receiving first audio data input by a user in response to the user triggering a function of a first application; sending the first audio data to a first destination address through a first audio channel for processing; receiving second audio data input by a user in response to the user triggering a function of a second application; and sending the second audio data to a second destination address through a second audio channel for processing. The scheme disclosed by the invention is suitable for a scene that a voice call and other voice services are simultaneously started, can respond to the function that a user triggers different applications, and transmits different audio signals through different audio channels without influencing each other. By the scheme, the user can still normally use voice input search or other voice services in the voice call state, and the requirement that multiple services are overlapped and used without mutual influence is met.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to an audio transmission method, apparatus, system, and computer-readable storage medium.
Background
With the development of internet technology, an IPTV (interactive network television) that integrates internet, multimedia, and communication technologies into a whole by using a broadband network has appeared. The IPTV effectively utilizes network resources to provide multimedia services with richer contents to the user.
With the development of IPTV, more applications and functions, such as voice recognition, voice search, video call, etc., are added to user terminals (e.g., set-top boxes, etc.). At present, an Audio channel Audio Record is generally implemented in a user terminal according to an Android standard, and a voice input by a user can be received through the channel and transmitted to an upper layer application for processing.
Disclosure of Invention
The inventor finds that: under the condition that a plurality of applications of voice search, video or voice call are simultaneously started, multi-sound-source input can only be output to different applications or addresses through the existing audio channel after audio mixing input for processing, the requirements of different sound sources corresponding to different outputs cannot be met, and the change requirements of different businesses of the IPTV cannot be met. And transmitting audio data through the existing audio channel may cause malfunction and misrecognition. For example, the voice of the user video call is regarded as the voice of the voice search input, and the voice search function is triggered, so that the user experience is not good.
One technical problem to be solved by the present disclosure is: how to still normally use voice input search or other voice services in a voice call state, and the requirement that multiple services are overlapped and used without mutual influence is met.
According to some embodiments of the present disclosure, there is provided an audio transmission method including: receiving first audio data input by a user in response to the user triggering a function of a first application; sending the first audio data to a first destination address through a first audio channel for processing; receiving second audio data input by a user in response to the user triggering a function of a second application; and sending the second audio data to a second destination address through a second audio channel for processing.
In some embodiments, sending the first audio data to the first destination address for processing via the first audio channel comprises: the first application calls a reading interface of the integrated circuit interface layer so that a unit corresponding to the reading interface reads first audio data by calling a reading and writing interface of the hardware abstraction layer and sends the first audio data to a first destination address for processing.
In some embodiments, receiving the first audio data input by the user comprises: the first application calls an initialization interface in response to receiving a signal that a user triggers a function of the first application so as to send an audio acquisition signal to the audio acquisition device and control the audio acquisition device to acquire first audio data; receiving first audio data sent by an audio acquisition device; the audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
In some embodiments, receiving the first audio data input by the user comprises: receiving first audio data sent by an audio acquisition device through a wireless signal, wherein the first audio data is input by a user through the audio acquisition device; alternatively, receiving the second audio data input by the user includes: receiving second audio data sent by the audio acquisition device through a wireless signal, wherein the second audio data is input by a user through the audio acquisition device; wherein the wireless signal comprises a bluetooth signal.
In some embodiments, in response to a user triggering a function of the first application, receiving user input of the first audio data comprises: and receiving first audio data input by a user and sent by different audio acquisition devices in response to the user triggering the acquisition switching function of the first application.
In some embodiments, the method further comprises: the first application calls an emptying interface in response to receiving a signal for closing the function of the first application triggered by a user, so that an acquisition stop signal is sent to the audio acquisition device, and the audio acquisition device is controlled to stop acquiring first audio data; the audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
In some embodiments, the method further comprises: and the first application calls the closing interface to close the first audio channel.
In some embodiments, the second channel comprises: and reading the channel of the Audio data through the recorded Audio Record in the android system.
According to further embodiments of the present disclosure, there is provided an audio transmission device including: the first audio receiving module is used for responding to the function that a user triggers the first application and receiving first audio data input by the user; the first audio transmission module is used for sending the first audio data to a first destination address through a first audio channel for processing; the second audio receiving module is used for responding to the function that the user triggers the second application and receiving second audio data input by the user; and the second audio transmission module is used for sending the second audio data to a second destination address through a second audio channel for processing.
In some embodiments, the first audio transmission module is configured to call a read interface of the integrated circuit interface layer through the first application, so that a unit corresponding to the read interface reads the first audio data by calling the read/write interface of the hardware abstraction layer, and sends the first audio data to the first destination address for processing.
In some embodiments, the first audio receiving module is configured to, in response to receiving a signal that a user triggers a function of the first application, call the initialization interface to send an audio collecting signal to the audio collecting apparatus, and control the audio collecting apparatus to collect the first audio data; receiving first audio data sent by an audio acquisition device; the audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with a microphone.
In some embodiments, the first audio receiving module is configured to receive first audio data sent by the audio capturing device through a wireless signal, where the first audio data is input by a user through the audio capturing device; or the second audio receiving module is used for receiving second audio data sent by the audio acquisition device through a wireless signal, and the second audio data is input by a user through the audio acquisition device; wherein the wireless signal comprises a bluetooth signal.
In some embodiments, the first audio receiving module is configured to receive first audio data input by a user and sent by a different audio capturing device in response to a user triggering a capture switching function of the first application.
In some embodiments, the apparatus further comprises: the first stopping module is used for calling an emptying interface through the first application in response to receiving a signal for triggering the function of closing the first application by a user so as to send a collection stopping signal to the audio collection device and control the audio collection device to stop collecting the first audio data; the audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
In some embodiments, the first stopping module is further configured to close the first audio channel by the first application calling a close interface.
In some embodiments, the second channel comprises: and reading the channel of the Audio data through the recorded Audio Record in the android system.
According to still other embodiments of the present disclosure, there is provided an audio transmission device including: a memory; and a processor coupled to the memory, the processor configured to perform the audio transmission method of any of the foregoing embodiments based on instructions stored in the memory.
According to still further embodiments of the present disclosure, there is provided an audio transmission system including: the audio transmission device of any of the preceding embodiments; the audio acquisition device is used for acquiring audio data of a user and sending the audio data to the audio transmission device; wherein, audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with a microphone.
According to still further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein the program, when executed by a processor, implements the audio transmission method of any of the foregoing embodiments.
In the method, a new voice channel is opened up at the user terminal, and the voice data corresponding to different applications are transmitted to the corresponding destination address through different channels for processing. The scheme disclosed by the invention is suitable for a scene that a voice call and other voice services are simultaneously started, can respond to the function that a user triggers different applications, and transmits different audio signals through different audio channels without mutual influence. By the scheme, the user can still normally use voice input search or other voice services in the voice call state, and the requirement that multiple services are overlapped and used without mutual influence is met.
Other features of the present disclosure and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 illustrates a flow diagram of an audio transmission method of some embodiments of the present disclosure.
Fig. 2 illustrates a framework schematic of audio transmission of some embodiments of the present disclosure.
Fig. 3 shows a flow diagram of an audio transmission method of further embodiments of the present disclosure.
Fig. 4 shows a schematic structural diagram of an audio transmission device of some embodiments of the present disclosure.
Fig. 5 shows a schematic structural diagram of an audio transmission device according to further embodiments of the present disclosure.
Fig. 6 shows a schematic structural diagram of an audio transmission device according to further embodiments of the present disclosure.
Fig. 7 illustrates a schematic structural diagram of an audio transmission system of some embodiments of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
The scheme is provided for solving the problems that a single voice channel in a user terminal cannot meet the requirements of different sound sources corresponding to different outputs and cannot meet the change requirements of different IPTV services. Some embodiments of the present solution are described below in conjunction with fig. 1.
Fig. 1 is a flow chart of some embodiments of the disclosed audio transmission method. As shown in fig. 1, the method of this embodiment includes: steps S102 to S108.
In step S102, in response to a user triggering a function of a first application, first audio data input by the user is received.
The first application and the second application are disposed in the user terminal, and the following embodiments will be described by taking the first application as a video call application and the second application as a voice search application as an example. However, the first application and the second application are not limited to the illustrated examples, and are set according to actual requirements. The user can trigger the functions of different applications on a device for controlling the user terminal, such as the user terminal or a remote controller, through operation modes, such as operation keys and the like. For example, the user may press a voice search key on a remote controller to trigger a voice search function, or open a video call application by selecting the video call application to trigger a video call function, or the like. The application may also be automatically started when the user terminal is started or automatically started periodically.
The user terminal can receive first audio data input by a user through the audio acquisition device. The voice acquisition device includes, for example: at least one of a microphone on the user terminal, a camera integrated with the microphone, and a Remote Controller (RC) integrated with the microphone. In some embodiments, the user inputs the first audio data through the audio acquisition device, and the user terminal receives the first audio data transmitted by the audio acquisition device through a wireless signal. The wireless signal includes, for example, a bluetooth signal, a mobile communication signal, a WiFi signal, and the like.
In some embodiments, first audio data input by a user sent by a different audio capture device is received in response to a user triggering a capture switch function of a first application. For example, audio data of a video call application may be input through a microphone on the user terminal or a microphone of a camera, a microphone of a remote controller. The collection switching function key can be set (for example, on a remote controller), and a user can collect audio data through different audio collection devices by pressing the collection switching function key. For example, the user opens a video (or voice) call application, by default, collects audio data through a microphone of the camera, and the video (or voice) call application establishes local Socket communication with an audio library of the user terminal. The user presses the acquisition switching key of the remote controller to switch to the remote controller for sound pickup.
In some embodiments, the user terminal implements the acquisition and transmission process of the first audio data by the first application. The first application calls an initialization interface in response to receiving a signal that a user triggers a function of the first application so as to send an audio acquisition signal to the audio acquisition device and control the audio acquisition device to acquire first audio data; the user terminal further receives first audio data sent by the audio acquisition device. The audio acquisition device receives the audio acquisition signal and can automatically start the audio acquisition function.
For example, the remote controller may establish a bluetooth connection with the user terminal (Host terminal), and the user presses an operation key of the video call function to input voice through the remote controller. The video call application monitors a signal pressed by a key of a remote controller, an initialization interface is called at first, an initialization unit informs an audio library (for example, audio. b. tm. default. so) that a user needs to pick up sound through the remote controller through a Socket, the audio library receives an instruction, an audio acquisition signal is sent to the remote controller through a Bluetooth signal, the remote controller receives the audio acquisition signal and automatically starts an audio acquisition function, and the effect that the user can pick up sound without pressing a voice key is achieved.
In order to save the bluetooth bandwidth and reduce packet loss when bluetooth is wirelessly blocked, the audio acquisition device may increase the pickup distance, compress the sampled data at a compression ratio of 8:1 (original sampled data: compressed data), and send the compressed data to the bluetooth protocol stack (e.g.,/dev/hidraw) of the user terminal through the bluetooth transmission protocol.
In step S104, the first audio data is transmitted to the first destination address through the first audio channel for processing.
In some embodiments, the first audio channel comprises: the user terminal receives a data transmission channel of units of audio data (e.g., a bluetooth protocol stack) to a first destination address. The first audio channel may further include at least one functional unit and a corresponding interface besides the units at the two ends, and different units may communicate with each other through the interface (or socket). In some embodiments, the first application calls a reading interface of the integrated circuit interface layer, so that a unit corresponding to the reading interface reads the first audio data by calling a reading and writing interface of the hardware abstraction layer, and sends the first audio data to the first destination address for processing. An element in this disclosure may refer to a correlation function that implements a function.
For example, as shown in fig. 2, after the first application determines that the initialization Interface is successful, that is, after the Audio acquisition device automatically starts Audio, a Read Interface (e.g., Read Audio Data Interface in fig. 1) of an integrated circuit Interface (INREGRATED CIRCUITINTERFACE) layer is called, a unit corresponding to the Read Interface notifies an Audio library (audio.b. default) of a Hardware Abstraction Layer (HAL) through Socket communication (one end is a Client Read Interface, and the other end is a Service Write Interface), and the Read/Write Interface of the Audio library acquires Data from a bluetooth protocol stack (/ dev/hdaw).
The first destination address is, for example, a first application, or a correspondent address (e.g., a video call counterpart address). In the event that the sampling pattern of the audio capture device is inconsistent with the desired sampling pattern for the first application, the audio library may resample the data received from the audio capture device and transmit to the first destination address. For example, the sampling mode of the remote controller is 16k, 16bit, and the sampling mode required by the first application is 48k, 16bit, so that the audio data acquired by the remote controller needs to be resampled and transmitted to the first application.
In step S106, in response to the user triggering the function of the second application, second audio data input by the user is received.
Steps S102 to S104 and steps S106 to S108 may be parallel steps without any order. For example, the user triggers a voice search function by pressing a voice search function key on the remote control. The method that is the same as or similar to the method that is used for receiving the first audio data input by the user in the synchronization step S102 is adopted to receive the second audio data input by the user, which is not described herein again. For example, second audio data sent by the audio acquisition device through a wireless signal is received, and the second audio data is input by a user through the audio acquisition device.
In step S108, the second audio data is transmitted to the second destination address through the second audio channel for processing.
The second audio channel includes: the user terminal receives a data transmission channel of units of audio data (e.g., a bluetooth protocol stack) to a second destination address. The second channel includes: the channel of Audio data is read by an Audio Record in the android system. The second destination address is for example a second application.
For example, the remote controller establishes a bluetooth connection with the user terminal, and the user presses a voice search key of the remote controller to sample audio data. In order to save Bluetooth bandwidth, reduce packet loss and increase pickup distance when Bluetooth is in wireless blocking, the remote controller compresses the sampled data in a compression ratio of 8:1 (original sampled data: compressed data), and sends the compressed data to a Bluetooth protocol stack (/ dev/hidraw) of the user terminal through a Bluetooth transmission protocol. The audio library of the hardware abstraction layer reads data from the bluetooth protocol stack (/ dev/hidraw;) and stores the data in a buffer (for lost voice when bluetooth radio blocks). And the second application, namely the voice search application, sequentially calls the reading interface through an Android standard Audio Record channel, calls the reading interface of an Android Framework layer standard, finally calls an interface of an Audio library, reads Audio data and realizes the pickup process of the second application.
In the method of the embodiment, a new voice channel is opened up at the user terminal, and the voice data corresponding to different applications are transmitted to the corresponding destination address through different channels for processing. The scheme of the embodiment is suitable for a scene that a voice call and other voice services are simultaneously started, can respond to the function that a user triggers different applications, and transmits different audio signals through different audio channels without influencing each other. Through the scheme of the embodiment, the user can still normally use voice input search or other voice services in the voice call state, and the requirement that multiple services are overlapped and used without mutual influence is met.
Further embodiments of the audio transmission method of the present disclosure are described below in conjunction with fig. 3.
Fig. 3 is a flow chart of some embodiments of the disclosed audio transmission method. As shown in fig. 3, the method of this embodiment includes: steps S302 to S308.
In step S302, in response to the user triggering a function of the first application, the user terminal receives first audio data input by the user.
In step S304, the user terminal sends the first audio data to the first destination address through the first audio channel for processing.
In step S306, in response to receiving a user trigger to turn off the function of the first application, the user terminal controls the audio collection device to send a collection stop signal.
In some embodiments, the first application calls the clearing interface in response to receiving a signal that a user triggers to close a function of the first application, so as to send an acquisition stop signal to the audio acquisition device, controlling the audio acquisition device to stop acquiring the first audio data.
For example, the user ends a video or voice call (e.g., hangs up the phone or no longer uses the remote control to pick up sound via the capture toggle key or otherwise), the first application calls a flush (flush) interface, notifies the user terminal via Socket that the remote control is no longer picking up sound, the user terminal receives an instruction, and sends a capture stop signal to the remote control (e.g., sends the capture stop signal via GATT (Generic Attribute protocol)). And the remote controller receives the acquisition stop signal of the user terminal to close automatic pickup, and the pickup of the remote controller is finished.
In step S308, the user terminal closes the first audio channel.
In some embodiments, the first application calls a close interface to close the first audio channel. For example, the first application closes the socket channel by calling a close (deinit) interface so that the next call can be picked up normally.
The method for stopping the second application from collecting data and closing the channel may refer to the method corresponding to the first application, or may take other existing manners, which is not limited to the illustrated example.
The present disclosure also provides a voice transmission apparatus, which can be disposed in the user terminal in the foregoing embodiment, and is described below with reference to fig. 4.
Fig. 4 is a block diagram of some embodiments of a voice transmission device of the present disclosure. As shown in fig. 4, the apparatus 40 of this embodiment includes: a first audio receiving module 402, a first audio transmitting module 404, a second audio receiving module 406, and a second audio transmitting module 408.
The first audio receiving module 402 is configured to receive first audio data input by a user in response to a user triggering a function of a first application.
In some embodiments, the first audio receiving module 402 is configured to, in response to receiving a signal that a user triggers a function of the first application, call the initialization interface to send an audio collecting signal to the audio collecting apparatus, and control the audio collecting apparatus to collect the first audio data; receiving first audio data sent by an audio acquisition device; the audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
In some embodiments, the first audio receiving module 402 is configured to receive first audio data transmitted by an audio capturing apparatus through a wireless signal, where the first audio data is input by a user through the audio capturing apparatus. The wireless signal includes, for example, a bluetooth signal.
In some embodiments, the first audio receiving module 402 is configured to receive user-input first audio data sent by a different audio capturing device in response to a user triggering a capture switching function of the first application.
The first audio transmission module 404 is configured to send the first audio data to the first destination address through the first audio channel for processing.
In some embodiments, the first audio transmission module 404 is configured to call, by the first application, a read interface of an interface layer of the integrated circuit, so that a unit corresponding to the read interface reads the first audio data by calling a read/write interface of a hardware abstraction layer, and sends the first audio data to the first destination address for processing.
A second audio receiving module 406, configured to receive second audio data input by the user in response to the user triggering a function of the second application.
In some embodiments, the second audio receiving module 406 is configured to receive second audio data sent by the audio capturing device through a wireless signal, where the second audio data is input by the user through the audio capturing device; wherein the wireless signal comprises a bluetooth signal.
And a second audio transmission module 408, configured to send the second audio data to a second destination address through a second audio channel for processing.
In some embodiments, the second channel comprises: and reading the channel of the Audio data through the recorded Audio Record in the android system.
In some embodiments, the apparatus 40 further comprises: the first stopping module 410 is configured to invoke, by the first application, an emptying interface in response to receiving a signal that a user triggers a function of closing the first application, so as to send a collection stopping signal to the audio collection device and control the audio collection device to stop collecting the first audio data; the audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone. In some embodiments, the first stopping module is further configured to close the first audio channel by the first application calling a close interface.
The audio transmission apparatus in the embodiments of the present disclosure may each be implemented by various computing devices or computer systems, which are described below in conjunction with fig. 5 and 6.
Fig. 5 is a block diagram of some embodiments of an audio transmission device of the present disclosure. As shown in fig. 5, the apparatus 50 of this embodiment includes: a memory 510 and a processor 520 coupled to the memory 510, the processor 520 configured to perform the audio transmission method in any of the embodiments of the present disclosure based on instructions stored in the memory 510.
Fig. 6 is a block diagram of further embodiments of an audio transmission device of the present disclosure. As shown in fig. 6, the apparatus 60 of this embodiment includes: memory 610 and processor 620 are similar to memory 510 and processor 520, respectively. An input output interface 630, a network interface 640, a storage interface 650, and the like may also be included. These interfaces 630, 640, 650 and the connections between the memory 610 and the processor 620 may be, for example, via a bus 660. The input/output interface 630 provides a connection interface for input/output devices such as a display, a mouse, a keyboard, and a touch screen. The network interface 640 provides a connection interface for various networking devices, such as a database server or a cloud storage server. The storage interface 650 provides a connection interface for external storage devices such as an SD card and a usb disk.
The present disclosure also provides an audio transmission system, described below in conjunction with fig. 7.
Fig. 7 is a block diagram of some embodiments of the audio transmission system of the present disclosure. As shown in fig. 7, the system 7 of this embodiment includes: the audio transmitting means 40/50/60 of any of the preceding embodiments; and an audio acquisition device 72.
The audio capturing device 72 is used for capturing audio data of the user and sending the audio data to the audio transmission device 40/50/60. The audio capture device 72 includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
The audio acquisition device 72 is configured to receive an audio acquisition signal sent by the audio transmission device 40/50/60, start an automatic acquisition function according to the audio acquisition signal, and receive audio data input by a user.
The audio collecting means 72 is also used for the first audio data transmitted by wireless signal or the second audio data transmitted by wireless signal. The wireless signals include bluetooth signals.
The audio capturing device 72 is further configured to receive a capturing stop signal sent by the audio transmitting device 40/50/60, and stop receiving the audio data input by the user.
As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only exemplary of the present disclosure and is not intended to limit the present disclosure, so that any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.
Claims (10)
1. An audio transmission method, comprising:
receiving first audio data input by a user in response to the user triggering a function of a first application;
sending the first audio data to a first destination address through a first audio channel for processing;
receiving second audio data input by the user in response to the user triggering a function of a second application;
sending the second audio data to a second destination address through a second audio channel for processing;
wherein the sending the first audio data to a first destination address for processing through a first audio channel comprises:
calling a reading interface of an integrated circuit interface layer through the first application so that a unit corresponding to the reading interface reads the first audio data by calling a reading and writing interface of a hardware abstraction layer and sends the first audio data to a first destination address for processing;
the second audio channel includes: and reading the channel of the Audio data through the recorded Audio Record in the android system.
2. The audio transmission method according to claim 1,
the receiving the first audio data of the user input comprises:
the first application calls an initialization interface in response to receiving a signal that the user triggers a function of the first application so as to send an audio acquisition signal to an audio acquisition device and control the audio acquisition device to acquire the first audio data;
receiving the first audio data sent by the audio acquisition device;
the audio acquisition apparatus includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
3. The audio transmission method according to claim 1,
the receiving the first audio data of the user input comprises:
receiving the first audio data sent by an audio acquisition device through a wireless signal, wherein the first audio data is input by the user through the audio acquisition device;
or, the receiving the second audio data input by the user comprises:
receiving second audio data sent by an audio acquisition device through a wireless signal, wherein the second audio data is input by the user through the audio acquisition device;
wherein the wireless signal comprises a Bluetooth signal.
4. The audio transmission method according to claim 1,
the receiving the user-input first audio data in response to a user triggering a function of a first application comprises:
and receiving first audio data input by a user and sent by different audio acquisition devices in response to the user triggering the acquisition switching function of the first application.
5. The audio transmission method according to claim 1, further comprising:
the first application calls an emptying interface in response to receiving a signal that the user triggers to close the function of the first application, so that an acquisition stopping signal is sent to an audio acquisition device, and the audio acquisition device is controlled to stop acquiring the first audio data;
the audio acquisition apparatus includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
6. The audio transmission method of claim 5, further comprising:
and the first application calls a closing interface to close the first audio channel.
7. An audio transmission device comprising:
the first audio receiving module is used for responding to the function that a user triggers a first application and receiving first audio data input by the user;
the first audio transmission module is used for sending the first audio data to a first destination address through a first audio channel for processing;
the second audio receiving module is used for responding to the triggering of a function of a second application by the user and receiving second audio data input by the user;
the second audio transmission module is used for sending the second audio data to a second destination address through a second audio channel for processing;
the first audio transmission module is used for calling a reading interface of an integrated circuit interface layer through the first application, so that a unit corresponding to the reading interface reads the first audio data by calling a reading and writing interface of a hardware abstraction layer, and sends the first audio data to a first destination address for processing;
the second audio channel includes: and reading the channel of the Audio data through the recorded Audio Record in the android system.
8. An audio transmission device comprising:
a memory; and
a processor coupled to the memory, the processor configured to perform the audio transmission method of any of claims 1-6 based on instructions stored in the memory.
9. An audio transmission system comprising: the audio transmission device of any of claims 7-8; and
the audio acquisition device is used for acquiring audio data of a user and sending the audio data to the audio transmission device;
wherein, the audio acquisition device includes: at least one of a camera integrated with a microphone and a remote controller integrated with the microphone.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811599146.7A CN111372107B (en) | 2018-12-26 | 2018-12-26 | Audio transmission method, device, system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811599146.7A CN111372107B (en) | 2018-12-26 | 2018-12-26 | Audio transmission method, device, system and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111372107A CN111372107A (en) | 2020-07-03 |
| CN111372107B true CN111372107B (en) | 2022-06-03 |
Family
ID=71211468
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811599146.7A Active CN111372107B (en) | 2018-12-26 | 2018-12-26 | Audio transmission method, device, system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111372107B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112004154A (en) * | 2020-08-31 | 2020-11-27 | 四川长虹电器股份有限公司 | Recording method and system of intelligent terminal and intelligent terminal |
| CN113360117B (en) * | 2021-06-28 | 2024-06-25 | 北京字节跳动网络技术有限公司 | Control method, device, terminal and storage medium of electronic equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102821214B (en) * | 2012-06-29 | 2015-01-21 | 苏州思必驰信息科技有限公司 | System and method for realizing voice interaction between terminal user and third-party application in communication process |
| US11238854B2 (en) * | 2016-12-14 | 2022-02-01 | Google Llc | Facilitating creation and playback of user-recorded audio |
| CN108132770A (en) * | 2017-12-13 | 2018-06-08 | 青岛海信移动通信技术股份有限公司 | A kind of method and apparatus for carrying out audio frequency process |
-
2018
- 2018-12-26 CN CN201811599146.7A patent/CN111372107B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111372107A (en) | 2020-07-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021114952A1 (en) | Data processing method, terminal device, bluetooth device, and storage medium | |
| KR101203516B1 (en) | Mobile communications terminal and method for manageing photograph image file thereof | |
| CN106385621A (en) | Intelligent device control method and device | |
| CN111372107B (en) | Audio transmission method, device, system and computer readable storage medium | |
| CN110531913B (en) | Video color ring processing method, communication equipment and computer readable storage medium | |
| RU2609147C2 (en) | Method and device for transmitting images | |
| US20180014063A1 (en) | Method and Apparatus for Accessing a Terminal Device Camera to a Target Device | |
| KR102053689B1 (en) | Compressing Method of image data for camera and Electronic Device supporting the same | |
| CN111880865A (en) | Multimedia data pushing method and device, electronic equipment and storage medium | |
| CN102045441A (en) | Data communication method and system using mobile terminal | |
| CN112799891A (en) | iOS device test method, device, system, storage medium and computer device | |
| CN107483729B (en) | Method and system for selecting captured image by multi-image display | |
| CN107040825B (en) | Terminal, television, multi-screen interaction system and screen capture parameter setting method | |
| CN111917813A (en) | Communication method, device, equipment, system and storage medium | |
| CN115022570B (en) | Method for acquiring video frame, electronic equipment and readable storage medium | |
| WO2019033800A1 (en) | Terminal video call display control method, device, terminal and storage medium | |
| CA3102425C (en) | Video processing method, device, terminal and storage medium | |
| CN105978663A (en) | Data transmission method and device | |
| CN103297725A (en) | Method and device for controlling electronic equipment and remote control | |
| CN116528209B (en) | Bluetooth scanning method, device, chip system and storage medium | |
| CN102783176A (en) | Content selection system, provision device, transfer device, and content selection method | |
| CN104754261A (en) | Projection equipment and projection method | |
| CN204031363U (en) | A kind of multifunction wireless personal portable digital device | |
| CN104980780A (en) | Multifunctional wireless personal portable digital apparatus | |
| CN112948046A (en) | Screen capturing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |