CN114237545B - Audio input method and device, electronic equipment and storage medium - Google Patents
Audio input method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114237545B CN114237545B CN202111538709.3A CN202111538709A CN114237545B CN 114237545 B CN114237545 B CN 114237545B CN 202111538709 A CN202111538709 A CN 202111538709A CN 114237545 B CN114237545 B CN 114237545B
- Authority
- CN
- China
- Prior art keywords
- audio data
- audio
- audio input
- data sent
- analog
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/382—Information transfer, e.g. on bus using universal interface adapter
- G06F13/385—Information transfer, e.g. on bus using universal interface adapter for adaptation of a particular data processing system to different peripheral devices
Abstract
The disclosure provides an audio input method, an audio input device, electronic equipment and a storage medium, and relates to the field of artificial intelligence, in particular to a voice technology. The specific implementation scheme is as follows: receiving audio data sent by N audio input units cascaded in a Time Division Multiplexing (TDM) mode; wherein N is a natural number greater than 1; merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel; and inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface. The embodiment of the application can realize multi-channel audio cascade input through one TDM audio input interface without adding an additional chip circuit, thereby reducing the complexity of circuit design and lowering the product cost.
Description
Technical Field
The present disclosure relates to the field of artificial intelligence technologies, and further relates to a speech technology, and in particular, to an audio input method, apparatus, electronic device, and storage medium.
Background
Along with the popularization of intelligent voice technology, the quantity of microphones and loudspeakers on the current voice product is more and more, a microphone array can be formed by multiple paths of microphones, and the tone quality of multiple paths of loudspeakers can be better. Therefore, the situation that the audio input port of the CPU in the device is not enough often occurs, and then an additional circuit design needs to be added to meet the product requirement.
In the prior art, when reference signals of multiple microphones and multiple loudspeakers are input to a CPU, the following method is generally adopted: 1) Reference signals of the Analog microphone and the loudspeaker are respectively connected to different audio input interfaces of the CPU after passing through Analog-to-Digital converters (ADC for short). When the scheme needs to access reference signals of multiple microphones and multiple loudspeakers, an audio input interface of a CPU is not enough. 2) A chip circuit, such as a Field Programmable Gate Array (FPGA) or a Micro Control Unit (MCU), is additionally added, and after recombining reference signals of the microphone and the speaker, the reference signals are sent to the CPU through a high-speed Interface such as a Serial Peripheral Interface (SPI). The scheme needs to add an additional chip circuit, the design complexity is high, and the cost is increased.
Disclosure of Invention
The disclosure provides an audio input method, an audio input device, an electronic device and a storage medium.
In a first aspect, the present application provides an audio input method, the method comprising:
receiving audio data sent by N audio input units cascaded in a Time Division Multiplexing (TDM) mode; wherein N is a natural number greater than 1;
merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel;
and inputting the N paths of audio data into an audio receiving unit through a TDM audio input interface.
In a second aspect, the present application provides an audio input device, the device comprising: the device comprises a receiving module, a merging module and an input module; wherein the content of the first and second substances,
the receiving module is used for receiving audio data sent by the N audio input units cascaded in the TDM mode; wherein N is a natural number greater than 1;
the merging module is configured to merge the audio data sent by the N audio input units into N audio data in a multi-channel;
the input module is used for inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface.
In a third aspect, an embodiment of the present application provides an electronic device, including:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the audio input method of any embodiment of the present application.
In a fourth aspect, the present application provides a storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the audio input method according to any embodiment of the present application.
In a fifth aspect, a computer program product is provided, which when executed by a computer device implements the audio input method of any of the embodiments of the present application.
According to the technical problem that in the prior art, reference signals of an analog microphone and a loudspeaker are respectively connected to different audio input interfaces of a CPU after passing through an analog-to-digital converter (ADC), the audio input interfaces of the CPU are not enough, and the technical problems that an additional chip circuit is required to be added, so that the design complexity is high and the cost is increased are solved. According to the technical scheme, multi-channel audio cascade input can be achieved through the TDM audio input interface, extra chip circuits do not need to be added, circuit design complexity is reduced, and product cost is reduced.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
fig. 1 is a first flowchart of an audio input method provided by an embodiment of the present application;
FIG. 2 is a second flowchart of an audio input method provided by an embodiment of the present application;
FIG. 3 is a third flowchart of an audio input method provided in an embodiment of the present application;
FIG. 4 is a schematic structural diagram of an audio input system provided in an embodiment of the present application;
FIG. 5 is a schematic structural diagram of an audio input device according to an embodiment of the present application;
fig. 6 is a block diagram of an electronic device for implementing an audio input method according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Example one
Fig. 1 is a first flowchart of an audio input method provided in an embodiment of the present application, where the method may be performed by an audio input apparatus or an electronic device, where the apparatus or the electronic device may be implemented by software and/or hardware, and the apparatus or the electronic device may be integrated in any intelligent device with a network communication function. As shown in fig. 1, the audio input method may include the steps of:
s101, receiving audio data sent by N audio input units cascaded in a TDM mode; wherein N is a natural number greater than 1.
In this step, the electronic device may receive audio data sent by N audio input units cascaded in a Time-Division Multiplexing (TDM) manner; wherein N is a natural number greater than 1. Specifically, if the audio data sent by the N audio input units are analog audio data, the electronic device may receive the analog audio data sent by the N audio input units through the N ADCs; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through respective corresponding audio transmission channels; and then converts the analog audio data transmitted from the N audio input units into digital audio data. Optionally, if the audio data sent by the N audio input units are analog audio data, the electronic device may receive the analog audio data sent by the N audio input units through any one of the N ADCs; the N ADCs are cascaded in a TDM mode; n audio input units send digital audio data through respective corresponding TDM paths; then, the analog audio data sent by the N audio input units are respectively converted into digital audio data through any one ADC.
S102, merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel.
In this step, the electronic device may combine the audio data sent by the N audio input units into N audio data in one multi-channel. Specifically, the electronic device may merge audio data sent by N audio input units into N audio data in a multi-channel according to a preset channel configuration; or, configuring a corresponding TDM path for the audio data sent by each audio input unit, and setting the audio data sent by the corresponding audio input unit as one path of audio data in the multiple channels through the TDM path.
And S103, inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface.
In this step, the electronic device may input N-way audio data into the audio receiving unit through the TDM audio input interface. The audio input unit in the embodiment of the present application may include: an analog audio input unit and a digital audio input unit; the audio data sent by the analog audio input unit is analog audio data; the audio data sent by the digital audio input unit is digital audio data; the analog audio input unit can be a loudspeaker and an analog microphone; the digital audio input unit may be a digital microphone. Optionally, the electronic device may merge the audio data of the N speakers into audio data in the multiple channels; the audio data of the N microphones can also be merged into the audio data in the multi-channel; the audio data of the N loudspeakers and the audio data of the N microphones can be simultaneously combined into the audio data in the multipath channel.
The audio input method provided by the embodiment of the application firstly receives audio data sent by N audio input units cascaded in a TDM manner; then merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel; and then the N paths of audio data are input into the audio receiving unit through the TDM audio input interface. That is to say, the TDM cascade characteristic of the audio input unit can be fully utilized, and the audio data sent by the multiple audio input units are mounted on one TDM audio input interface without adding an additional chip circuit. In the existing audio input method, reference signals of an analog microphone and a loudspeaker are respectively connected to different audio input interfaces of a CPU after passing through an ADC; or additional chip circuitry may be added. Because the technical means of combining the audio data sent by the N audio input units into N audio data in a multi-channel and inputting the N audio data into the audio receiving unit through the TDM audio input interface is adopted, the technical problems that in the prior art, reference signals of an analog microphone and a loudspeaker are respectively connected into different audio input interfaces of a CPU after passing through an analog-to-digital converter (ADC), and the audio input interfaces of the CPU are not enough and additional chip circuits are required to be added, so that the design complexity is high and the cost is increased are solved; moreover, the technical scheme of the embodiment of the application is simple and convenient to implement, convenient to popularize and wide in application range.
Example two
Fig. 2 is a second flowchart of an audio input method provided by an embodiment of the present application. Further optimization and expansion are performed based on the technical scheme, and the method can be combined with the various optional embodiments. As shown in fig. 2, the audio input method may include the steps of:
s201, if the audio data sent by the N audio input units are analog audio data, receiving the analog audio data sent by the N audio input units through the N ADCs; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through the corresponding audio transmission channels.
In this step, if the audio data sent by the N audio input units are analog audio data, the electronic device may receive the analog audio data sent by the N audio input units through the N ADCs; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through the corresponding audio transmission channels. Specifically, the electronic device may receive analog audio data sent by a first speaker through the AD 1; analog audio data sent by the second loudspeaker are received through the ADC 2; 8230; receiving analog audio data sent by an Nth loudspeaker through an ADC (analog to digital converter); wherein N is a natural number greater than 1.
S202, converting the analog audio data sent by the N audio input units into digital audio data.
In this step, the electronic device may convert the analog audio data sent by the N audio input units into digital audio data; the N audio input units send analog audio data through the corresponding audio transmission channels. Specifically, the electronic device may convert analog audio data sent by the first speaker into a digital audio signal through the ADC 1; converting the analog audio data sent by the second loudspeaker into digital audio signals through an ADC 2; 8230; the analog audio data sent by the nth speaker is converted into a digital audio signal by the ADC N.
And S203, merging the converted data audio data into N paths of audio data in a multi-path channel.
And S204, inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface.
In a specific embodiment of the present application, if the audio data sent by the N audio input units are digital audio data, the electronic device may receive the digital audio data sent by the N audio input units through any one ADC of the N ADCs; the N ADCs are cascaded in a TDM mode; n audio input units send digital audio data through respective corresponding TDM paths; then merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel; and then inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface.
The audio input method provided by the embodiment of the application firstly receives audio data sent by N audio input units cascaded in a TDM manner; then merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel; and then the N paths of audio data are input into the audio receiving unit through the TDM audio input interface. That is to say, the TDM cascade characteristic of the audio input unit can be fully utilized, and the audio data sent by the multiple audio input units are mounted on one TDM audio input interface without adding an additional chip circuit. In the existing audio input method, reference signals of an analog microphone and a loudspeaker are respectively connected to different audio input interfaces of a CPU after passing through an ADC; or additional chip circuitry may be added. Because the technical means of combining the audio data sent by the N audio input units into N audio data in a multi-channel and inputting the N audio data into the audio receiving unit through the TDM audio input interface is adopted, the technical problems that in the prior art, reference signals of an analog microphone and a loudspeaker are respectively connected with different audio input interfaces of a CPU after passing through an analog-to-digital converter (ADC), and the audio input interfaces of the CPU are not enough and additional chip circuits are needed to be added, so that the design complexity is high and the cost is increased are solved; moreover, the technical scheme of the embodiment of the application is simple and convenient to implement, convenient to popularize and wide in application range.
EXAMPLE III
Fig. 3 is a third flow chart of an audio input method according to an embodiment of the present application. Further optimization and expansion are performed based on the technical scheme, and the method can be combined with the various optional embodiments. As shown in fig. 3, the audio input method may include the steps of:
s301, if the audio data sent by the N audio input units are analog audio data, receiving the analog audio data sent by the N audio input units through any one ADC in the N ADCs; the N ADCs are cascaded in a TDM mode; the N audio input units transmit analog audio data through respective corresponding TDM paths.
In this step, if the audio data sent by the N audio input units are analog audio data, the electronic device may receive the analog audio data sent by the N audio input units through any one of the N ADCs; the N ADCs are cascaded in a TDM mode; the N audio input units transmit analog audio data through respective corresponding TDM paths. Specifically, the electronic device may receive, through the ACD1, analog audio data sent by the N microphones through the respective corresponding TDM paths.
And S302, respectively converting the analog audio data sent by the N audio input units into digital audio data through any ADC.
In this step, the electronic device may convert the analog audio data sent by the N audio input units into digital audio data through the any one ADC, respectively. Specifically, the electronic device can convert analog audio data sent by the microphone 1 through the TDM path 1 into digital audio data by the ADC 1; analog audio data sent by the microphone 2 through the TDM path 2 is converted into digital audio data by the ADC 1; 8230; analog audio data transmitted by the microphone N through the TDM path N is converted into digital audio data by the ADC 1.
And S303, merging the converted data audio data into N paths of audio data in a multi-path channel.
And S304, inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface.
Fig. 4 is a schematic structural diagram of an audio input system according to an embodiment of the present application. As shown in fig. 4, the system may include an audio receiving unit, N speakers, and N ADCs; wherein, N horns are respectively horn 1, horn 2, \ 8230and horn N; n ADCs are ADC1, ADC2, \ 8230, ADC N, respectively; the N ADCs are connected in a TDM cascade mode; the loudspeaker 1 sends the analog audio data sent by the loudspeaker to the ADC 1; the loudspeaker 2 sends the analog audio signal sent by the loudspeaker to the ADC 2; 8230; the loudspeaker N sends the analog audio signal sent by the loudspeaker N to the ADC N. The ADC1 converts the analog audio data sent by the loudspeaker 1 into corresponding digital audio data; the ADC2 converts the analog audio data sent by the loudspeaker 2 into corresponding digital audio data; 8230; the ADC N converts the analog audio data sent by the loudspeaker N into corresponding digital audio data; then merging the digital audio data converted by the N ADCs into N paths of audio data in a multi-path channel; and then the N paths of audio data are input into the audio receiving unit through the TDM audio input interface. In addition, the system may further include N microphones, respectively: microphone 1, microphone 2, \ 8230;, microphone N; the N microphones are connected in a TDM cascade mode; the microphone in the embodiment of the application can be a digital microphone or an analog microphone; if the microphone is an analog microphone, converting analog audio data sent by the N microphones into corresponding digital audio data through the ADC 1; then merging the converted digital audio data into N paths of audio data in a multi-path channel; and inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface. If the microphone is a digital microphone, receiving digital audio data sent by N microphones through an ADC 1; then, the N-channel audio data is input into the audio receiving unit through the TDM audio input interface.
The audio input method provided by the embodiment of the application firstly receives audio data sent by N audio input units cascaded in a TDM manner; then merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel; and then inputting the N paths of audio data into the audio receiving unit through the TDM audio input interface. That is to say, the TDM cascade characteristic of the audio input unit can be fully utilized, and the audio data sent by the multiple audio input units is mounted on one TDM audio input interface without adding an additional chip circuit. In the existing audio input method, reference signals of an analog microphone and a loudspeaker are respectively connected to different audio input interfaces of a CPU after passing through an ADC; or additional chip circuitry may be added. Because the technical means of combining the audio data sent by the N audio input units into N audio data in a multi-channel and inputting the N audio data into the audio receiving unit through the TDM audio input interface is adopted, the technical problems that in the prior art, reference signals of an analog microphone and a loudspeaker are respectively connected into different audio input interfaces of a CPU after passing through an analog-to-digital converter (ADC), and the audio input interfaces of the CPU are not enough and additional chip circuits are required to be added, so that the design complexity is high and the cost is increased are solved; moreover, the technical scheme of the embodiment of the application is simple and convenient to implement, convenient to popularize and wide in application range.
Example four
Fig. 5 is a schematic structural diagram of an audio input device according to an embodiment of the present application. As shown in fig. 5, the apparatus 500 includes: a receiving module 501, a combining module 502 and an input module 503; wherein the content of the first and second substances,
the receiving module 501 is configured to receive audio data sent by N audio input units cascaded in a TDM manner; wherein N is a natural number greater than 1;
the merging module 502 is configured to merge the audio data sent by the N audio input units into N audio data in a multiple channel;
the input module 503 is configured to input the N channels of audio data into the audio receiving unit through the TDM audio input interface.
Further, the receiving module 501 is specifically configured to receive, if the audio data sent by the N audio input units are analog audio data, the analog audio data sent by the N audio input units through the N analog-to-digital converters ADC; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through respective corresponding audio transmission channels; and converting the analog audio data sent by the N audio input units into digital audio data.
Further, the receiving module 501 is specifically configured to receive, by using any one of the N ADCs, the analog audio data sent by the N audio input units if the audio data sent by the N audio input units are analog audio data; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through the corresponding TDM paths; and respectively converting the analog audio data sent by the N audio input units into digital audio data through any ADC.
Further, the receiving module 501 is specifically configured to receive, by using any one of the N ADCs, the digital audio data sent by the N audio input units if the audio data sent by the N audio input units are digital audio data; the N ADCs are cascaded in a TDM mode; the N audio input units transmit digital audio data through respective corresponding TDM paths.
Further, the merging module 502 is specifically configured to merge the audio data sent by the N audio input units into N audio data in the multiple channels according to a preset channel configuration; or configuring a corresponding TDM path for the audio data sent by each audio input unit, and setting the audio data sent by the corresponding audio input unit as one path of audio data in the multiple channels through the TDM path.
Further, the audio input unit includes: an analog audio input unit and a digital audio input unit; the audio data sent by the analog audio input unit is analog audio data; the audio data sent by the digital audio input unit is digital audio data; the analog audio input unit is a loudspeaker and an analog microphone; the digital audio input unit is a digital microphone.
The audio input device can execute the method provided by any embodiment of the application, and has corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the audio input method provided in any embodiment of the present application.
In the technical scheme of the disclosure, the acquisition, storage, application and the like of the personal information of the related user all accord with the regulations of related laws and regulations, and do not violate the good customs of the public order.
EXAMPLE five
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
FIG. 6 illustrates a schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the device 600 comprises a computing unit 601, which may perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM) 602 or loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The calculation unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
A number of components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, a mouse, or the like; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 601 performs the respective methods and processes described above, such as an audio input method. For example, in some embodiments, the audio input method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of a computer program may be loaded onto and/or installed onto device 600 via ROM 602 and/or communications unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the audio input method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the audio input method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the protection scope of the present disclosure.
Claims (10)
1. An audio input method, the method comprising:
receiving audio data sent by N audio input units cascaded in a Time Division Multiplexing (TDM) mode; wherein N is a natural number greater than 1;
merging the audio data sent by the N audio input units into N paths of audio data in a multi-path channel;
inputting the N paths of audio data into an audio receiving unit through a TDM audio input interface;
the receiving of the audio data sent by the N audio input units cascaded in the TDM manner includes:
if the audio data sent by the N audio input units are analog audio data, receiving the analog audio data sent by the N audio input units through the N analog-to-digital converters (ADC); the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through respective corresponding audio transmission channels;
converting the analog audio data sent by the N audio input units into digital audio data; wherein the audio input unit comprises an analog audio input unit; the audio data sent by the analog audio input unit is analog audio data; the analog audio input unit is a loudspeaker;
the merging the audio data sent by the N audio input units into N audio data in a multi-channel includes:
merging the audio data sent by the N audio input units into N paths of audio data in the multi-path channel according to preset channel configuration;
wherein, the receiving adopts the audio data that N audio input units cascaded of TDM way sent, still include:
if the audio data sent by the N audio input units are analog audio data, receiving the analog audio data sent by the N audio input units through any one ADC in the N ADCs; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through the corresponding TDM paths;
and respectively converting the analog audio data sent by the N audio input units into digital audio data through any ADC.
2. The method of claim 1, wherein the receiving audio data transmitted by N audio input units cascaded in a TDM manner further comprises:
if the audio data sent by the N audio input units are digital audio data, receiving the digital audio data sent by the N audio input units through any one ADC in the N ADCs; the N ADCs are cascaded in a TDM mode; the N audio input units transmit digital audio data through respective corresponding TDM paths.
3. The method of claim 1, wherein the merging the audio data transmitted by the N audio input units into N audio data in one multiplex channel further comprises:
configuring a corresponding TDM path for the audio data sent by each audio input unit according to preset channel configuration, and setting the audio data sent by the corresponding audio input unit as one path of audio data in the multi-path channel through the TDM path.
4. The method of claim 1, the audio input unit further comprising a digital audio input unit; the audio data sent by the digital audio input unit is digital audio data; the analog audio input unit is also an analog microphone; the digital audio input unit is a digital microphone.
5. An audio input device, the device comprising: the device comprises a receiving module, a merging module and an input module; wherein the content of the first and second substances,
the receiving module is used for receiving audio data sent by N audio input units cascaded in a Time Division Multiplexing (TDM) mode; wherein N is a natural number greater than 1;
the merging module is configured to merge the audio data sent by the N audio input units into N audio data in a multi-channel;
the input module is used for inputting the N paths of audio data into an audio receiving unit through a TDM audio input interface;
the receiving module is specifically configured to receive, by using the N analog-to-digital converters ADC, analog audio data sent by the N audio input units if the audio data sent by the N audio input units are analog audio data; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through respective corresponding audio transmission channels; converting the analog audio data sent by the N audio input units into digital audio data; wherein the audio input unit comprises an analog audio input unit; the audio data sent by the analog audio input unit is analog audio data; the analog audio input unit is a loudspeaker;
the merging module is specifically configured to merge the audio data sent by the N audio input units into N audio data in the multiple channels according to a preset channel configuration;
the receiving module is further specifically configured to receive, by using any one of the N ADCs, the analog audio data sent by the N audio input units if the audio data sent by the N audio input units are analog audio data; the N ADCs are cascaded in a TDM mode; the N audio input units send analog audio data through the corresponding TDM paths; and respectively converting the analog audio data sent by the N audio input units into digital audio data through any ADC.
6. The apparatus according to claim 5, wherein the receiving module is further specifically configured to receive, by any one of the N ADCs, the digital audio data sent by the N audio input units if the audio data sent by the N audio input units are digital audio data; the N ADCs are cascaded in a TDM mode; the N audio input units transmit digital audio data through respective corresponding TDM paths.
7. The apparatus according to claim 5, wherein the merging module is further specifically configured to configure a corresponding TDM path for the audio data sent by each audio input unit according to a preset channel configuration, and set the audio data sent by the corresponding audio input unit as one path of audio data in the multiple channels through the TDM path.
8. The apparatus of claim 5, the audio input unit further comprising a digital audio input unit; the audio data sent by the digital audio input unit is digital audio data; the analog audio input unit is also an analog microphone; the digital audio input unit is a digital microphone.
9. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the first and the second end of the pipe are connected with each other,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-4.
10. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111538709.3A CN114237545B (en) | 2021-12-15 | 2021-12-15 | Audio input method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111538709.3A CN114237545B (en) | 2021-12-15 | 2021-12-15 | Audio input method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114237545A CN114237545A (en) | 2022-03-25 |
| CN114237545B true CN114237545B (en) | 2023-04-07 |
Family
ID=80756598
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111538709.3A Active CN114237545B (en) | 2021-12-15 | 2021-12-15 | Audio input method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114237545B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9300635B1 (en) * | 2015-06-15 | 2016-03-29 | Tempered Networks, Inc. | Overlay network with position independent insertion and tap points |
| CN109660933A (en) * | 2019-01-30 | 2019-04-19 | 北京视通科技有限公司 | A kind of device of simultaneous transmission multi-channel analog audio |
| EP3902147A1 (en) * | 2020-04-26 | 2021-10-27 | Yealink (Xiamen) Network Technology Co., Ltd. | Wireless communication device, and method and apparatus for processing voice data |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2066540C (en) * | 1991-06-13 | 1998-01-20 | Edwin A. Kelley | Multiple user digital receiving apparatus and method with time division multiplexing |
| CN103533510A (en) * | 2013-10-28 | 2014-01-22 | 深圳市冠标科技发展有限公司 | Single-channel multi-channel audio output wireless conference system |
| CN107660034A (en) * | 2017-08-03 | 2018-02-02 | 南京邮电大学盐城大数据研究院有限公司 | A kind of apparatus and method of microphone array identification music rhythm control light bar |
| CN210807582U (en) * | 2019-12-25 | 2020-06-19 | 声耕智能科技(西安)研究院有限公司 | Multichannel audio acquisition system based on FPGA |
-
2021
- 2021-12-15 CN CN202111538709.3A patent/CN114237545B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9300635B1 (en) * | 2015-06-15 | 2016-03-29 | Tempered Networks, Inc. | Overlay network with position independent insertion and tap points |
| CN109660933A (en) * | 2019-01-30 | 2019-04-19 | 北京视通科技有限公司 | A kind of device of simultaneous transmission multi-channel analog audio |
| EP3902147A1 (en) * | 2020-04-26 | 2021-10-27 | Yealink (Xiamen) Network Technology Co., Ltd. | Wireless communication device, and method and apparatus for processing voice data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114237545A (en) | 2022-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210316745A1 (en) | Vehicle-based voice processing method, voice processor, and vehicle-mounted processor | |
| CN104754536A (en) | Method and system for realizing communication between different languages | |
| CN104778950A (en) | Microphone signal delay compensation control method based on echo cancellation | |
| CN111145751A (en) | Audio signal processing method and device and electronic equipment | |
| JP2022020055A (en) | Speech processing method and device and method and device for generating speech processing model | |
| US9236874B1 (en) | Reducing data transition rates between analog and digital chips | |
| US20160093307A1 (en) | Latency Reduction | |
| CN114237545B (en) | Audio input method and device, electronic equipment and storage medium | |
| US8175088B2 (en) | System for offering mobile telecommunication service using internet network with UTP cable | |
| CN106569780B (en) | Real-time sound effect processing method and system for multi-channel digital audio signal | |
| KR20180113586A (en) | Dual size processing framework for nonlinear echo cancellation in mobile devices | |
| CN115268821B (en) | Audio playing method and device, equipment and medium | |
| JP7133055B2 (en) | Signal processing method, apparatus, electronic equipment and computer program product | |
| CN113553857B (en) | Text processing method and text processing device | |
| CN114237544A (en) | Audio input method and device, electronic equipment and storage medium | |
| CN103701551A (en) | Multichannel digital sound console and signal processing method thereof | |
| CN113709506A (en) | Multimedia playing method, device, medium and program product based on cloud mobile phone | |
| CN105120532A (en) | RIL processing method based on multiplexing and wireless communication module | |
| KR20210039354A (en) | Speech interaction method, speech interaction device and electronic device | |
| US10003456B2 (en) | Soundwire XL turnaround signaling | |
| CN211184172U (en) | Digital array microphone clock circuit | |
| CN114267358B (en) | Audio processing method, device, equipment and storage medium | |
| CN109451251A (en) | A kind of realization system of multi-path video frequency matrix switching | |
| CN220043421U (en) | All-optical pulse parallel-serial conversion equipment | |
| WO2023201885A1 (en) | Earphone connection method and apparatus, earphones, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |