CN114553616B - Audio transmission method, device and system of conference unit and terminal equipment - Google Patents
Audio transmission method, device and system of conference unit and terminal equipment Download PDFInfo
- Publication number
- CN114553616B CN114553616B CN202210034673.3A CN202210034673A CN114553616B CN 114553616 B CN114553616 B CN 114553616B CN 202210034673 A CN202210034673 A CN 202210034673A CN 114553616 B CN114553616 B CN 114553616B
- Authority
- CN
- China
- Prior art keywords
- data
- conference
- audio
- server
- sampling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 69
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000012545 processing Methods 0.000 claims abstract description 31
- 230000005236 sound signal Effects 0.000 claims abstract description 26
- 238000005070 sampling Methods 0.000 claims description 70
- 238000004590 computer program Methods 0.000 claims description 22
- 230000006870 function Effects 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 8
- 238000007781 pre-processing Methods 0.000 claims description 7
- 230000003321 amplification Effects 0.000 claims description 5
- 230000000903 blocking effect Effects 0.000 claims description 5
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 5
- 230000008054 signal transmission Effects 0.000 abstract description 3
- 230000006872 improvement Effects 0.000 description 31
- 238000010586 diagram Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 5
- 238000003825 pressing Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1827—Network arrangements for conference optimisation or adaptation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/485—Task life-cycle, e.g. stopping, restarting, resuming execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Abstract
The invention provides an audio transmission method, a device, a system and a terminal device of a conference unit, which are characterized in that audio data are preprocessed and sampled, the obtained sampled data are sent to a message queue through interrupt signals, and uploading of the sampled data is controlled according to a message queue processing thread, so that each audio signal cannot collide in the transmission process, and the sampled data are uploaded to a conference host through a server IP address in a network signal, thereby realizing low-delay transmission and ensuring the real-time performance of signal transmission.
Description
Technical Field
The present invention relates to the field of wired conferences, and in particular, to an audio transmission method, apparatus, terminal, device, and storage medium for a conference system.
Background
The rapid development of electronic information technology makes the life of people more intelligent and faster, which also promotes the continuous improvement of the requirements of people on the tone quality, delay and the like of conference systems. In a conventional wired conference system, which is generally composed of a conference host and a conference unit, audio signal transmission can be performed in an analog or digital manner. The simulated conference system adopts a multi-core air line to connect a conference host and a conference unit, so as to transmit a simulated audio signal and a serial port control signal, and the simulated conference system is built; the digital conference system adopts a network cable to connect a conference host and a conference unit, and converts an analog audio signal into a digital audio signal in an encoding mode, thereby completing signal transmission and control of audio data and control data.
However, the multi-core air line used in the analog conference unit clock in the market has higher requirements, the manufactured materials and the transmission line length have certain influence on the transmission of the audio signal, and when the multi-core air line transmits the audio signal and the serial port control signal, signal interference is easy to generate, so that the quality of the audio transmission is influenced. The digital conference units on the market generally have the problems of low audio sampling rate, narrow bandwidth and overlong delay of the audio mixing signal, and the existing digital conference units generally have 100ms to 500ms delay in delay, so that the user experience is poor.
Therefore, an audio transmission strategy of a conference system is needed to solve the problems of weak interference resistance and high delay of the existing audio transmission.
Disclosure of Invention
The embodiment of the invention provides an audio transmission method, device and system of a conference unit and terminal equipment, which are used for solving the technical problem that a wired conference unit is excessively long in audio transmission.
In order to solve the above problems, an embodiment of the present invention provides an audio transmission method of a conference system, including:
preprocessing continuously collected audio data to obtain a plurality of sampling data, and respectively obtaining server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampling data are transmitted by digital signals, and the server IP address is sent by a conference host;
when the number of the plurality of sampling data is larger than a number threshold, generating an interrupt signal according to an interrupt server function;
according to the interrupt signal, the plurality of sampling data are sent to a message queue, and the sound intensity of the sampling data in the message queue is extracted through a preset message queue processing thread;
and when the sound intensity is greater than the decibel threshold value, uploading the sampled data with the sound intensity greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
As an improvement of the above solution, the preprocessing is performed on the continuously collected audio data to obtain a plurality of sampled data, and the server IP addresses corresponding to the plurality of sampled data are respectively obtained, which specifically includes:
collecting the sound of a plurality of conference units through a microphone, and converting the electric signals to obtain a plurality of audio data;
encoding the plurality of audio data according to a preset audio encoding and decoding chip, and sampling by an MCU to obtain a plurality of sampled data transmitted by digital signals; the MCU samples in a DMA double-buffer mode;
sending a speaking request to the conference host to acquire a server IP address distributed by the conference host; wherein, the server IP address corresponds to each sampling data one by one.
As an improvement of the above solution, the preset message queue processing thread specifically includes: the sampled data in the message queue is received in a blocking manner by the message queue processing thread.
As an improvement of the above scheme, the method further comprises:
receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal;
and after carrying out operational amplification processing and volume control on the analog audio signals, inputting the analog audio signals into a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises:
controlling according to the communication flow control method, and sending an obstruction signal back to the source address when the sending buffer area or the receiving buffer area starts overflowing;
and controlling according to the error control method, automatically retransmitting for three times when no response data is received, and waiting for data response.
As an improvement of the above scheme, the method further comprises:
transmitting data according to a packet transmission method, transmitting the data to be uploaded or received by taking the packet as a unit, sending the data to be uploaded or received to a memory for temporary storage, and uploading or receiving the data to be uploaded or received when the output is idle;
and carrying out data transmission according to a signal point-to-point transmission method.
Correspondingly, the embodiment of the invention also provides an audio transmission device of the conference unit, which comprises: the device comprises a sampling module, an interruption module, a sound intensity module and an uploading module;
the sampling module is used for preprocessing the continuously collected audio data to obtain a plurality of sampled data, and respectively obtaining server IP addresses corresponding to the plurality of sampled data; wherein the plurality of sampling data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module is used for generating an interrupt signal according to an interrupt server function when the number of the plurality of sampling data is larger than a number threshold;
the sound intensity module is used for sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and the uploading module is used for uploading the sampled data with the sound intensity larger than the decibel threshold value to the conference host through a network signal according to the IP address of the server when the sound intensity is larger than the decibel threshold value.
As an improvement of the above solution, the sampling module includes: a microphone unit, a coding sampling unit and an IP address unit;
the microphone unit is used for collecting the sound of a plurality of conference units through a microphone and converting electric signals to obtain a plurality of audio data;
the coding sampling unit is used for coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling the audio data through the MCU to obtain a plurality of sampled data transmitted in digital signals; the MCU samples in a DMA double-buffer mode;
the IP address unit is used for sending a speaking request to the conference host computer so as to acquire a server IP address distributed by the conference host computer; wherein, the server IP address corresponds to each sampling data one by one.
As an improvement of the above solution, the preset message queue processing thread specifically includes: the sampled data in the message queue is received in a blocking manner by the message queue processing thread.
As an improvement of the above scheme, the method further comprises: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after carrying out operational amplification processing and volume control on the analog audio signals, inputting the analog audio signals into a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises: controlling according to the communication flow control method, and sending an obstruction signal back to the source address when the sending buffer area or the receiving buffer area starts overflowing; and controlling according to the error control method, automatically retransmitting for three times when no response data is received, and waiting for data response.
As an improvement of the above scheme, the method further comprises: transmitting data according to a packet transmission method, transmitting the data to be uploaded or received by taking the packet as a unit, sending the data to be uploaded or received to a memory for temporary storage, and uploading or receiving the data to be uploaded or received when the output is idle; and carrying out data transmission according to a signal point-to-point transmission method.
Correspondingly, the embodiment of the invention also provides an audio transmission system of the conference unit, which comprises: the conference system comprises a conference unit, a conference host, a PoE switch, a computer client and an audio amplifier system; the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplifying system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit.
Correspondingly, the embodiment of the invention also provides computer terminal equipment, which comprises a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, wherein the processor realizes the audio transmission method of the conference unit when executing the computer program.
Correspondingly, the embodiment of the invention also provides a computer readable storage medium, which comprises a stored computer program, wherein the equipment where the computer readable storage medium is located is controlled to execute the audio transmission method of the conference unit according to the invention when the computer program runs.
From the above, the invention has the following beneficial effects:
the invention provides an audio transmission method, a device, a system and a terminal device of a conference unit, which are characterized in that audio data are preprocessed and sampled, the obtained sampled data are sent to a message queue according to an interrupt signal, and uploading of the sampled data is controlled according to a message queue processing thread, so that each audio data cannot collide in the transmission process, the sampled data are uploaded to a conference host through a server IP address in a network signal, the audio data are digitally processed, the conference unit and the conference host are connected through the network signal, low-delay transmission is realized, and the real-time performance of signal transmission is ensured.
Furthermore, the method realizes the low-delay transmission of a plurality of conference units by simultaneously carrying out digital processing on the audio signals and the control signals and combining a communication flow control method, a packet transmission method, an error control method and a signal point-to-point data transmission method.
Drawings
Fig. 1 is a flow chart of an audio transmission method of a conference unit according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an audio transmission device of a conference unit according to an embodiment of the present invention;
fig. 3 is a connection frame diagram of an audio transmission system of a conference unit according to an embodiment of the present invention;
fig. 4 is a schematic block diagram of a conference unit according to an embodiment of the present invention;
fig. 5 is a top view of a conference unit provided in an embodiment of the present invention;
fig. 6 is a side view of a conference unit provided in an embodiment of the invention;
fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Referring to fig. 1, fig. 1 is a flowchart of an audio transmission method of a conference unit according to an embodiment of the present invention, as shown in fig. 1, the embodiment includes steps 101 to 104, where the steps are specifically as follows:
step 101: preprocessing continuously collected audio data to obtain a plurality of sampling data, and respectively obtaining server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data is transmitted via digital signals and the server IP address is sent by the conference host.
As an improvement of the above solution, the obtaining the server IP addresses corresponding to the plurality of sampled data specifically includes: collecting the sound of a plurality of conference units through a microphone, and converting the electric signals to obtain a plurality of audio data; encoding the audio data according to a preset audio encoding and decoding chip, and sampling through an MCU to obtain a plurality of sampled data transmitted by digital signals; the MCU samples in a DMA double-buffer mode; sending a speaking request to the conference host to acquire a server IP address distributed by the conference host; wherein, the server IP address corresponds to each sampling data one by one.
To better illustrate this step, the following examples are provided.
After the microphone collects sound, the sound analog signal is sent to an audio amplifying circuit for processing, then is transmitted to a WM8978 audio codec chip for encoding and is transmitted in the form of a digital signal, and then is transmitted to an MCU for starting a DMA double buffer memory for sampling through an I2S bus, and finally, sampled data transmitted in the form of the digital signal are obtained. After the sampling data are obtained, a speaking request is sent to the conference host, and after the conference host passes the request, the server IP addresses which are distributed by the host and correspond to the sampling data one by one are obtained.
Step 102: and generating an interrupt signal according to an interrupt server function when the number of the plurality of sampling data is greater than a number threshold.
In this step, specifically: when the number of the sampled data reaches the number set by the user, triggering an interrupt server function to generate an interrupt signal, and stopping the microphone from collecting other sounds.
Step 103: according to the interrupt signal, the plurality of sampling data are sent to a message queue, and the sound intensity of the sampling data in the message queue is extracted through a preset message queue processing thread;
as an improvement of the above solution, the preset message queue processing thread specifically includes: the sampled data in the message queue is received in a blocking manner by the message queue processing thread.
Step 104: and when the sound intensity is greater than the decibel threshold value, uploading the sampled data with the sound intensity greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
In this step, specifically: when the sound intensity is larger than the decibel value set by the user, according to the IP address corresponding to the sampling data, the sampling data is converted into a network signal form through the RTL network chip and is transmitted to the conference host.
As an improvement of the above scheme, the method further comprises: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after carrying out operational amplification processing and volume control on the analog audio signals, inputting the analog audio signals into a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units. The method comprises the following steps: when other conference units speak, the conference host transmits the sampled data uploaded by other units through the PoE switch, the MCU receives the sampled data of other units through the RM II interface of the RTL network chip, transmits the sampled data to the WM8978 audio codec chip through the I2S bus for decoding, obtains an audio analog signal, and transmits the audio analog signal to the loudspeaker amplifying circuit and the earphone amplifying circuit after the processing of the operational amplifier and the processing of the volume control chip, thereby completing monitoring when speaking to other conference units.
As an improvement of the above scheme, the method further comprises: controlling according to the communication flow control method, and sending an obstruction signal back to the source address when the sending buffer area or the receiving buffer area starts overflowing; and controlling according to the error control method, automatically retransmitting for three times when no response data is received, and waiting for data response.
As an improvement of the above scheme, the method further comprises: transmitting data according to a packet transmission method, transmitting the data to be uploaded or received by taking the packet as a unit, sending the data to be uploaded or received to a memory for temporary storage, and uploading or receiving the data to be uploaded or received when the output is idle; and carrying out data transmission according to a signal point-to-point transmission method.
As an improvement of the above scheme, the IEEE802.3af/at standard PoE switch is adopted for data interaction and power supply.
As an improvement of the above solution, the present embodiment further provides an audio transmission system of a conference unit, including: the conference system comprises a conference unit, a conference host, a PoE switch, a computer client and an audio amplifier system; the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplifying system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit.
In order to better explain the audio transmission system of the conference unit, please refer to fig. 3, the computer client, the conference host and the conference units are connected with the PoE switch through the network cable, so that the interaction of data is realized, and the computer client correspondingly sets the conference host and the conference units, thereby realizing the control of the system. The conference host is connected with the sound amplifying system through an audio line to amplify and amplify the sound collected by the conference unit.
According to the embodiment of the invention, the audio data is preprocessed and sampled, the obtained sampled data is sent to the message queue according to the interrupt signal, and the uploading of the sampled data is controlled according to the message queue processing thread, so that each audio signal cannot collide in the transmission process, and the sampled data is uploaded to the conference host computer through the IP address of the server in a network signal, so that the digital transmission of the audio data is realized, and the problem of high audio transmission delay of the wired conference unit is solved. The WM8978 with the 16-bit 48KHz sampling coding rate is used for coding and decoding the audio data and sampling, so that the high-fidelity restoration of the audio signal is ensured. The IEEE802.3af/at standard PoE is adopted for power supply, so that the electrical safety is improved, meanwhile, the on-site wiring is simplified, and the wiring cost is reduced.
Example two
Referring to fig. 2, fig. 2 is a schematic structural diagram of an audio transmission device of a conference unit according to an embodiment of the present invention, including: a sampling module 201, an interruption module 202, a sound intensity module 203 and an uploading module 204;
the sampling module 201 is configured to pre-process continuously collected audio data to obtain a plurality of sampled data, and obtain server IP addresses corresponding to the plurality of sampled data respectively; wherein the plurality of sampling data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module 202 is configured to generate an interrupt signal according to an interrupt server function when the number of the plurality of sampled data is greater than a number threshold;
the sound intensity module 203 is configured to send the plurality of sampled data to a message queue according to the interrupt signal, and extract, by using a preset message queue processing thread, sound intensity of the sampled data in the message queue;
the uploading module 204 is configured to upload, when the sound intensity is greater than the db threshold, the sampled data with the sound intensity greater than the db threshold to the conference host through a network signal according to the server IP address.
As an improvement of the above solution, the sampling module 201 includes: a microphone unit, a coding sampling unit and an IP address unit;
the microphone unit is used for collecting the sound of a plurality of conference units through a microphone and converting electric signals to obtain a plurality of audio data;
the coding sampling unit is used for coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling the audio data through the MCU to obtain a plurality of sampled data transmitted in digital signals; the MCU samples in a DMA double-buffer mode;
the IP address unit is used for sending a speaking request to the conference host computer so as to acquire a server IP address distributed by the conference host computer; wherein, the server IP address corresponds to each sampling data one by one.
As an improvement of the above solution, the preset message queue processing thread specifically includes: the sampled data in the message queue is received in a blocking manner by the message queue processing thread.
As an improvement of the above scheme, the method further comprises: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after carrying out operational amplification processing and volume control on the analog audio signals, inputting the analog audio signals into a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises: controlling according to the communication flow control method, and sending an obstruction signal back to the source address when the sending buffer area or the receiving buffer area starts overflowing; and controlling according to the error control method, automatically retransmitting for three times when no response data is received, and waiting for data response.
As an improvement of the above scheme, the method further comprises: transmitting data according to a packet transmission method, transmitting the data to be uploaded or received by taking the packet as a unit, sending the data to be uploaded or received to a memory for temporary storage, and uploading or receiving the data to be uploaded or received when the output is idle; and carrying out data transmission according to a signal point-to-point transmission method.
As an improvement of the above scheme, the method further comprises: the system comprises a speaking circuit module, a priority circuit module and a voting circuit module; the speaking key of the speaking circuit module, the priority key of the priority circuit module and the voting key of the voting circuit module adopt mechanical touch keys.
As an improvement of the above-described scheme, the speech circuit module receives a signal generated by the user pressing the speech key to speak.
As an improvement of the above-described scheme, when a conference check-in is performed, the talk circuit module receives a signal generated by a user pressing a talk key to check in.
As an improvement of the scheme, the priority circuit module receives a signal generated by pressing the priority key by a user to initiate voting.
As an improvement of the above scheme, the priority circuit module receives signals generated by pressing the priority key by the user to control the speech of other units.
As an improvement of the scheme, the voting circuit module receives signals generated by pressing the voting key by a user to vote; wherein, the voting types include: approval, disapproval, and disuse.
As an improvement of the above scheme, the method further comprises: and the double-screen display module is characterized in that a front screen adopts a 3.2 inch RGB color display screen and mainly displays the information and operation information of the conference unit. The rear screen adopts a 4.0 inch color display screen, and mainly completes the display function of the electronic nameplate.
As an improvement of the scheme, the double-screen display module acquires the business card information of the personnel participating in the conference through the PC client software, transmits the information to the conference host through the switch, and then the conference host transmits the business card information to each unit. And finally, the MCU processor of the conference unit completes signal interaction with the driving chip of the screen through the serial port, thereby realizing the function of the electronic nameplate.
For a better illustration of the present embodiment, the following examples are provided for illustration.
Referring to FIG. 4, the STM32-MCU in FIG. 4 is connected with speech, voting and priority keys through an I/O interface; the STM32-MCU is connected with the two RGB screen driving chips through a UART serial port, respectively controls and operates the display LCD screen and the electronic nameplate LCD screen through the two RGB screen driving chips, and is connected with the audio processing module through an I2S bus; the RTL network chip is connected with the STM32-MCU through an RM II interface, and the network chip is connected with the PoE switch through an RJ45 connector; the interaction between other modules is transmitted through digital signals except the interaction between RJ45 and the PoE switch.
Referring to fig. 5 and 6, fig. 5 and 6 are a top view and a side view of the conference unit according to the present embodiment, respectively.
In this embodiment, after sampling data is collected by the sampling module, the interrupt module and the sound intensity module control transmission of audio data, and finally the sampling data is uploaded to the host by the uploading module. The embodiment processes the audio signal and the control signal into the digitized signals, completes the full-digital data transmission among the modules, not only realizes the low-delay transmission of the signals, but also improves the anti-interference and confidentiality of the signals. The PoE switch is used for power supply and data exchange, so that the direct strong-current power supply and the direct strong-current circuit are not only wired, but also avoided, and the safety and convenience of product use are improved. The embodiment also has the functions of speaking, meeting attendance, chairman priority, voting, electronic nameplates and the like, has high integration of functions, is more suitable for various meeting occasions compared with the prior art, can meet the requirements of clients, and is more convenient for controlling the cost of the clients.
Example III
Referring to fig. 3, fig. 3 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
A terminal device of this embodiment includes: a processor 701, a memory 702 and a computer program stored in the memory 702 and executable on the processor 701. The processor 701, when executing the computer program, implements the steps of the audio transmission method of each conference unit described above in the embodiment, for example, all the steps of the audio transmission method of the conference unit shown in fig. 1. Alternatively, the processor may implement functions of each module in the above-described device embodiments when executing the computer program, for example: all modules of the audio transmission device of the conference unit shown in fig. 2.
In addition, an embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium includes a stored computer program, where when the computer program runs, the device where the computer readable storage medium is located is controlled to execute the audio transmission method of the conference unit according to any one of the embodiments.
It will be appreciated by those skilled in the art that the schematic diagram is merely an example of a terminal device and does not constitute a limitation of the terminal device, and may include more or less components than illustrated, or may combine certain components, or different components, e.g., the terminal device may further include an input-output device, a network access device, a bus, etc.
The processor 701 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 701 is a control center of the terminal device, and connects various parts of the entire terminal device using various interfaces and lines.
The memory 702 may be used to store the computer program and/or module, and the processor 701 implements various functions of the terminal device by running or executing the computer program and/or module stored in the memory and invoking data stored in the memory 702. The memory 702 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, memory, plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
Wherein the terminal device integrated modules/units may be stored in a computer readable storage medium if implemented in the form of software functional units and sold or used as stand alone products. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.
It should be noted that the above-described apparatus embodiments are merely illustrative, and the units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the embodiment of the device provided by the invention, the connection relation between the modules represents that the modules have communication connection, and can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
While the foregoing is directed to the preferred embodiments of the present invention, it will be appreciated by those skilled in the art that changes and modifications may be made without departing from the principles of the invention, such changes and modifications are also intended to be within the scope of the invention.
Claims (9)
1. A method of audio transmission for a conference unit, comprising:
preprocessing continuously collected audio data to obtain a plurality of sampling data, and respectively obtaining server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampling data are transmitted by digital signals, and the server IP address is sent by a conference host;
when the number of the plurality of sampling data is larger than a number threshold, generating an interrupt signal according to an interrupt server function;
according to the interrupt signal, the plurality of sampling data are sent to a message queue, and the sound intensity of the sampling data in the message queue is extracted through a preset message queue processing thread; the preset message queue processing thread specifically comprises the following steps: receiving the sampling data in the message queue in a blocking mode through the message queue processing thread;
and when the sound intensity is greater than the decibel threshold value, uploading the sampled data with the sound intensity greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
2. The audio transmission method of a conference unit according to claim 1, wherein preprocessing is performed on continuously collected audio data to obtain a plurality of sampled data, and server IP addresses corresponding to the plurality of sampled data are respectively obtained, specifically:
collecting the sound of a plurality of conference units through a microphone, and converting the electric signals to obtain a plurality of audio data;
encoding the plurality of audio data according to a preset audio encoding and decoding chip, and sampling by an MCU to obtain a plurality of sampled data transmitted by digital signals; the MCU samples in a DMA double-buffer mode;
sending a speaking request to the conference host to acquire a server IP address distributed by the conference host; wherein, the server IP address corresponds to each sampling data one by one.
3. The audio transmission method of a conference unit according to claim 2, further comprising:
receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal;
and after carrying out operational amplification processing and volume control on the analog audio signals, inputting the analog audio signals into a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
4. The audio transmission method of a conference unit according to claim 2, further comprising:
controlling according to the communication flow control method, and sending an obstruction signal back to the source address when the sending buffer area or the receiving buffer area starts overflowing;
and controlling according to the error control method, automatically retransmitting for three times when no response data is received, and waiting for data response.
5. The audio transmission method of a conference unit according to claim 2, further comprising:
transmitting data according to a packet transmission method, transmitting the data to be uploaded or received by taking the packet as a unit, sending the data to be uploaded or received to a memory for temporary storage, and uploading or receiving the data to be uploaded or received when the output is idle;
and carrying out data transmission according to a signal point-to-point transmission method.
6. An audio transmission device for a conference unit, comprising: the device comprises a sampling module, an interruption module, a sound intensity module and an uploading module;
the sampling module is used for preprocessing the continuously collected audio data to obtain a plurality of sampled data, and respectively obtaining server IP addresses corresponding to the plurality of sampled data; wherein the plurality of sampling data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module is used for generating an interrupt signal according to an interrupt server function when the number of the plurality of sampling data is larger than a number threshold;
the sound intensity module is used for sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and the uploading module is used for uploading the sampled data with the sound intensity larger than the decibel threshold value to the conference host through a network signal according to the IP address of the server when the sound intensity is larger than the decibel threshold value.
7. An audio transmission system for a conference unit, comprising: the conference system comprises a conference unit, a conference host, a PoE switch, a computer client and an audio amplifier system; wherein the conference unit is connected with the PoE switch via a network cable, the conference host is connected with the PoE switch via a network cable, the computer client is connected with the PoE switch via a network cable, the sound amplifying system is connected with the conference host via an audio cable, and the conference unit is applied to the audio transmission method of the conference unit according to any one of claims 1 to 5.
8. A computer terminal device, characterized by comprising a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, the processor implementing a method of audio transmission of a conference unit according to any one of claims 1 to 5 when the computer program is executed.
9. A computer readable storage medium, characterized in that the computer readable storage medium comprises a stored computer program, wherein the computer program, when run, controls a device in which the computer readable storage medium is located to perform a method of audio transmission of a conference unit according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210034673.3A CN114553616B (en) | 2022-01-12 | 2022-01-12 | Audio transmission method, device and system of conference unit and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210034673.3A CN114553616B (en) | 2022-01-12 | 2022-01-12 | Audio transmission method, device and system of conference unit and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114553616A CN114553616A (en) | 2022-05-27 |
| CN114553616B true CN114553616B (en) | 2023-11-24 |
Family
ID=81672002
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210034673.3A Active CN114553616B (en) | 2022-01-12 | 2022-01-12 | Audio transmission method, device and system of conference unit and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114553616B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115396069B (en) * | 2022-10-25 | 2023-03-10 | 广州市保伦电子有限公司 | Audio processing method and system for wired and wireless networking conference system |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA1334685C (en) * | 1985-08-23 | 1995-03-07 | Republic Telcom Systems Corporation | Multiplexed digital packet telephone system |
| WO1996015484A2 (en) * | 1994-11-02 | 1996-05-23 | Advanced Micro Devices, Inc. | Monolithic pc audio circuit |
| JPH0969884A (en) * | 1995-09-01 | 1997-03-11 | Toshiba Corp | Conference support system and method for controlling conference support system |
| CA2259000A1 (en) * | 1996-06-26 | 1997-12-31 | Par Government Systems Corporation | Communicating with electronic tags |
| CN1540954A (en) * | 2003-10-30 | 2004-10-27 | 清华大学深圳研究生院 | Method for controlling flux of audio and video flow transferred in IP video meeting system |
| EP1942607A2 (en) * | 2000-09-11 | 2008-07-09 | Broadcom Corporation | Cable modem with voice processing capability |
| CN101335869A (en) * | 2008-03-26 | 2008-12-31 | 北京航空航天大学 | Video conference system based on Soft-MCU |
| CN102215286A (en) * | 2011-04-06 | 2011-10-12 | 扬州大学 | Sound and time recording system of embedded multi-channel phone |
| CN103885744A (en) * | 2013-05-30 | 2014-06-25 | 美声克（成都）科技有限公司 | Sound based gesture recognition method |
| CN104992711A (en) * | 2015-05-27 | 2015-10-21 | 东南大学 | Local area network cluster duplexing speech communication method based on mobile terminal |
| CN106960290A (en) * | 2017-04-11 | 2017-07-18 | 西华大学 | A kind of 4 S auto shop team sales service quality evaluation system and evaluation method |
| CN109302575A (en) * | 2018-08-21 | 2019-02-01 | 广州市保伦电子有限公司 | A kind of wifi conference system based on IOT module |
| CN109982100A (en) * | 2019-03-28 | 2019-07-05 | 北京粉笔蓝天科技有限公司 | A kind of audio/video processing method and system |
| CN109979256A (en) * | 2019-04-24 | 2019-07-05 | 上海乂学教育科技有限公司 | English pronunciation teaching system |
| WO2019148583A1 (en) * | 2018-02-02 | 2019-08-08 | 深圳市鹰硕技术有限公司 | Intelligent conference management method and system |
| CN111755017A (en) * | 2020-07-06 | 2020-10-09 | 全时云商务服务股份有限公司 | Audio recording method and device for cloud conference, server and storage medium |
| CN112564990A (en) * | 2021-02-23 | 2021-03-26 | 全时云商务服务股份有限公司 | Management method for switching audio management server |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW465234B (en) * | 1997-02-18 | 2001-11-21 | Discovision Ass | Single chip VLSI implementation of a digital receiver employing orthogonal frequency division multiplexing |
| US20050096764A1 (en) * | 2003-10-31 | 2005-05-05 | Weiser Anatoly S. | Sound-activated recording, transmission, and playback |
| US20100293286A1 (en) * | 2007-09-13 | 2010-11-18 | Ant - Advanced Network Technologies Oy | Method and system for wireless real-time collection of multichannel digital audio |
-
2022
- 2022-01-12 CN CN202210034673.3A patent/CN114553616B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA1334685C (en) * | 1985-08-23 | 1995-03-07 | Republic Telcom Systems Corporation | Multiplexed digital packet telephone system |
| WO1996015484A2 (en) * | 1994-11-02 | 1996-05-23 | Advanced Micro Devices, Inc. | Monolithic pc audio circuit |
| JPH0969884A (en) * | 1995-09-01 | 1997-03-11 | Toshiba Corp | Conference support system and method for controlling conference support system |
| CA2259000A1 (en) * | 1996-06-26 | 1997-12-31 | Par Government Systems Corporation | Communicating with electronic tags |
| EP1942607A2 (en) * | 2000-09-11 | 2008-07-09 | Broadcom Corporation | Cable modem with voice processing capability |
| CN1540954A (en) * | 2003-10-30 | 2004-10-27 | 清华大学深圳研究生院 | Method for controlling flux of audio and video flow transferred in IP video meeting system |
| CN101335869A (en) * | 2008-03-26 | 2008-12-31 | 北京航空航天大学 | Video conference system based on Soft-MCU |
| CN102215286A (en) * | 2011-04-06 | 2011-10-12 | 扬州大学 | Sound and time recording system of embedded multi-channel phone |
| CN103885744A (en) * | 2013-05-30 | 2014-06-25 | 美声克（成都）科技有限公司 | Sound based gesture recognition method |
| CN104992711A (en) * | 2015-05-27 | 2015-10-21 | 东南大学 | Local area network cluster duplexing speech communication method based on mobile terminal |
| CN106960290A (en) * | 2017-04-11 | 2017-07-18 | 西华大学 | A kind of 4 S auto shop team sales service quality evaluation system and evaluation method |
| WO2019148583A1 (en) * | 2018-02-02 | 2019-08-08 | 深圳市鹰硕技术有限公司 | Intelligent conference management method and system |
| CN109302575A (en) * | 2018-08-21 | 2019-02-01 | 广州市保伦电子有限公司 | A kind of wifi conference system based on IOT module |
| CN109982100A (en) * | 2019-03-28 | 2019-07-05 | 北京粉笔蓝天科技有限公司 | A kind of audio/video processing method and system |
| CN109979256A (en) * | 2019-04-24 | 2019-07-05 | 上海乂学教育科技有限公司 | English pronunciation teaching system |
| CN111755017A (en) * | 2020-07-06 | 2020-10-09 | 全时云商务服务股份有限公司 | Audio recording method and device for cloud conference, server and storage medium |
| CN112564990A (en) * | 2021-02-23 | 2021-03-26 | 全时云商务服务股份有限公司 | Management method for switching audio management server |
Non-Patent Citations (3)
| Title |
|---|
| The Artificial Reverberation Real-time Processing System Based On DSP;Wen Chuanxue;微计算机信息(第20期);全文 * |
| 何伟 ; 游婧 ; 张玲 ; .基于DM642 RAW采集格式的视频驱动开发及应用.计算机应用.2012,0-5节. * |
| 基于麦克风阵列的信号采集处理系统设计;许佳龙;张一闻;刘建平;;电子科技(第09期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114553616A (en) | 2022-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102984496B (en) | The processing method of the audiovisual information in video conference, Apparatus and system | |
| CN107682752B (en) | Method, device and system for displaying video picture, terminal equipment and storage medium | |
| CN105959613A (en) | Digital conference equipment and system | |
| CN210431642U (en) | Interactive wireless audio and video conference integrated terminal system | |
| CN114553616B (en) | Audio transmission method, device and system of conference unit and terminal equipment | |
| CN108108139A (en) | A kind of throwing screen cut-in method of cloud meeting | |
| CN205584362U (en) | Conference system | |
| CN113438442A (en) | Conference data sharing method and device | |
| CN101458616A (en) | Multimedia kvm system | |
| CN108259857A (en) | A kind of two-way intercommunication integral system of video monitoring public broadcasting and its control method | |
| CN110278089A (en) | A kind of wireless session control system and control method and business method based on virtual USB device | |
| CN2850167Y (en) | Portable mobile conference terminal | |
| CN206402344U (en) | One kind is based on 3D scene Video Conference Systems | |
| CN112565668B (en) | Method for sharing sound in network conference | |
| CN114584659A (en) | Audio processing unit of conference system | |
| CN210807396U (en) | Background music playing terminal and system | |
| CN201479301U (en) | External video conference device | |
| CN1525757A (en) | A video telephone system | |
| CN115334349B (en) | Audio processing method, device, electronic equipment and storage medium | |
| CN203912080U (en) | Movable portable video conference system | |
| CN117939051A (en) | Multifunctional digital network conference terminal | |
| CN111083290B (en) | Background music playing system | |
| CN216531604U (en) | Projector and projection kit | |
| CN217607887U (en) | Internet online court | |
| CN211830976U (en) | Video conference platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |