CN114553616A - Audio transmission method, device and system of conference unit and terminal equipment - Google Patents
Audio transmission method, device and system of conference unit and terminal equipment Download PDFInfo
- Publication number
- CN114553616A CN114553616A CN202210034673.3A CN202210034673A CN114553616A CN 114553616 A CN114553616 A CN 114553616A CN 202210034673 A CN202210034673 A CN 202210034673A CN 114553616 A CN114553616 A CN 114553616A
- Authority
- CN
- China
- Prior art keywords
- data
- conference
- audio
- sampling
- sampling data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 87
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000005070 sampling Methods 0.000 claims description 100
- 238000012545 processing Methods 0.000 claims description 29
- 230000005236 sound signal Effects 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 20
- 230000006870 function Effects 0.000 claims description 16
- 230000000903 blocking effect Effects 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 10
- 230000003321 amplification Effects 0.000 claims description 9
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 9
- 238000007781 pre-processing Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 230000006872 improvement Effects 0.000 description 30
- 238000010586 diagram Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 5
- 238000003825 pressing Methods 0.000 description 5
- 238000004088 simulation Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000008054 signal transmission Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1827—Network arrangements for conference optimisation or adaptation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/485—Task life-cycle, e.g. stopping, restarting, resuming execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides an audio transmission method, an audio transmission device, an audio transmission system and terminal equipment of a conference unit.
Description
Technical Field
The present invention relates to the field of wired conferences, and in particular, to an audio transmission method, apparatus, terminal, device, and storage medium for a conference system.
Background
The rapid development of electronic information technology enables people's life to be more intelligent and faster, and the requirements of people on tone quality, delay and the like of a conference system are continuously improved. In a conventional wired conference system, the conference system generally includes a conference host and a conference unit, and audio signal transmission may be performed in an analog or digital manner. The simulation conference system is characterized in that a conference host and a conference unit are connected by adopting a multi-core air line, so that the transmission of a simulation audio signal and a serial port control signal is carried out, and the simulation conference system is established according to the transmission of the simulation audio signal and the serial port control signal; the digital conference system adopts a network cable to connect the conference host and the conference unit, and converts the analog audio signal into a digital audio signal in a coding mode, thereby completing the signal transmission and control of audio data and control data.
However, the multi-core air line used by the analog conference unit clock in the market has high requirements, the manufactured material and the transmission line length can have certain influence on the transmission of the audio signal, and when the multi-core air line transmits the audio signal and the serial port control signal, signal interference is easy to generate, and the quality of audio transmission is influenced. The digital conference units in the market generally have the problems of low audio sampling rate, narrow bandwidth and long delay of mixed signals, and the conventional digital conference units generally have 100ms to 500ms delay in delay, so that the user experience is poor.
Therefore, an audio transmission strategy of a conference system is needed to solve the problems of weak interference resistance and high delay of the existing audio transmission.
Disclosure of Invention
The embodiment of the invention provides an audio transmission method, device and system of a conference unit and terminal equipment, and aims to solve the technical problem of long delay of a wired conference unit in audio transmission.
In order to solve the above problem, an embodiment of the present invention provides an audio transmission method for a conference system, including:
preprocessing continuously acquired audio data to obtain a plurality of sampling data, and respectively acquiring server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
when the number of the plurality of sampling data is larger than the number threshold, generating an interrupt signal according to an interrupt server function;
sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and when the sound intensity is greater than the decibel threshold value, uploading the sampling data of which the sound intensity is greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
As an improvement of the above scheme, the preprocessing is performed on the continuously acquired audio data to obtain a plurality of sampling data, and the server IP addresses corresponding to the plurality of sampling data are respectively obtained, specifically:
collecting the sounds of a plurality of conference units through a microphone, and carrying out electric signal conversion to obtain a plurality of audio data;
coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through an MCU (microprogrammed control unit) to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
sending a speaking request to the conference host to acquire a server IP address allocated by the conference host; and the IP address of the server corresponds to each sampling data one by one.
As an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampling data in the message queue in a blocking mode through the message queue processing thread.
As an improvement of the above scheme, the method further comprises the following steps:
receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal;
and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises the following steps:
controlling according to a communication flow control method, and sending a blocking signal back to a source address when a sending buffer or a receiving buffer begins to overflow;
and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps:
data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received;
and carrying out data transmission according to a signal point-to-point transmission method.
Correspondingly, an embodiment of the present invention further provides an audio transmission apparatus for a conference unit, including: the device comprises a sampling module, an interruption module, a sound intensity module and an uploading module;
the sampling module is used for preprocessing continuously acquired audio data to obtain a plurality of sampling data and respectively obtaining server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module is used for generating an interrupt signal according to an interrupt server function when the number of the plurality of sampling data is greater than a number threshold;
the sound intensity module is used for sending the plurality of sampling data to a message queue according to the interrupt signal and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and the uploading module is used for uploading the sampling data of which the sound intensity is greater than the decibel threshold to the conference host through a network signal according to the IP address of the server when the sound intensity is greater than the decibel threshold.
As an improvement of the above scheme, the sampling module includes: the device comprises a microphone unit, a coding sampling unit and an IP address unit;
the microphone unit is used for collecting the sounds of the conference units through the microphone and carrying out electric signal conversion to obtain a plurality of audio data;
the coding and sampling unit is used for coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through the MCU to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
the IP address unit is used for sending a speaking request to the conference host to acquire a server IP address distributed by the conference host; and the IP address of the server corresponds to each sampling data one by one.
As an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
As an improvement of the above scheme, the method further comprises the following steps: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises the following steps: controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow; and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps: data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received; and carrying out data transmission according to a signal point-to-point transmission method.
Correspondingly, an embodiment of the present invention further provides an audio transmission system for a conference unit, including: the system comprises a conference unit, a conference host, a PoE switch, a computer client and a sound amplification system; the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplification system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit.
Correspondingly, the embodiment of the present invention further provides a computer terminal device, which includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, the processor implements the audio transmission method of a conference unit according to the present invention.
Correspondingly, the embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute the audio transmission method of a conference unit according to the present invention.
From the above, the present invention has the following advantages:
the invention provides an audio transmission method, device, system and terminal equipment of a conference unit, which can ensure that each audio data can not collide in the transmission process by preprocessing and sampling the audio data, sending the obtained sampling data to a message queue according to an interrupt signal and controlling the uploading of the sampling data according to the processing process of the message queue, and then uploading the sampling data to a conference host computer by a network signal through a server IP address, and realize the connection of the conference unit and the conference host computer by the network signal through the digital processing of the audio data, thereby realizing the low-delay transmission and ensuring the real-time property of the signal transmission.
Furthermore, the method realizes the low-delay transmission of a plurality of conference units by simultaneously carrying out digital processing on the audio signal and the control signal and combining a communication flow control method, a packet transmission method, an error control method and a signal point-to-point data transmission method.
Drawings
Fig. 1 is a schematic flow chart of an audio transmission method of a conference unit according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an audio transmission apparatus of a conference unit according to an embodiment of the present invention;
fig. 3 is a connection block diagram of an audio transmission system of a conference unit provided by an embodiment of the present invention;
FIG. 4 is a schematic block diagram of a conference unit provided by an embodiment of the present invention;
FIG. 5 is a top view of a conference unit provided by an embodiment of the present invention;
FIG. 6 is a side view of a conference unit provided by an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of an audio transmission method for a conference unit according to an embodiment of the present invention, as shown in fig. 1, the present embodiment includes steps 101 to 104, and each step specifically includes the following steps:
step 101: preprocessing continuously acquired audio data to obtain a plurality of sampling data, and respectively acquiring server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sample data are transmitted by digital signals, and the server IP address is sent by a conference host.
As an improvement of the above scheme, the obtaining of the IP addresses of the servers corresponding to the multiple sampling data specifically includes: collecting the sounds of a plurality of conference units through a microphone, and carrying out electric signal conversion to obtain a plurality of audio data; coding the audio data according to a preset audio coding and decoding chip, and sampling through an MCU (microprogrammed control unit) to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode; sending a speaking request to the conference host to acquire a server IP address allocated by the conference host; and the IP address of the server corresponds to each sampling data one by one.
To better illustrate this step, the following example is provided for illustration.
After the microphone collects sound, the sound analog signal is sent to an audio amplification circuit for processing, then the sound analog signal is transmitted to a WM S audio coding and decoding chip for coding and is transmitted in the form of digital signals, then the sound analog signal is transmitted to the MCU which starts the DMA double buffer memory through an I2S bus for sampling, and finally sampling data which is transmitted in the form of digital signals is obtained. And after the conference host passes the request, acquiring server IP addresses which are distributed by the host and correspond to the sampled data one by one.
Step 102: and when the number of the plurality of sampling data is greater than the number threshold, generating an interrupt signal according to an interrupt server function.
In this step, specifically: and when the quantity of the sampling data reaches the quantity set by the user, triggering an interrupt server function, generating an interrupt signal, and stopping the microphone from collecting other sounds.
Step 103: sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
as an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
Step 104: and when the sound intensity is greater than the decibel threshold value, uploading the sampling data of which the sound intensity is greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
In this step, specifically: and when the sound intensity is greater than the decibel value set by the user, converting the sampled data into a network signal form through the RTL network chip and transmitting the network signal form to the conference host according to the IP address corresponding to the sampled data.
As an improvement of the above scheme, the method further comprises the following steps: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units. The method specifically comprises the following steps: when other conference units speak, the conference host transmits the sampling data uploaded by other units through the PoE switch, the MCU receives the sampling data of other units through the RM II interface of the RTL network chip and transmits the sampling data to the WM 2S audio coding and decoding chip through the I2S bus to decode to obtain audio analog signals, and the audio analog signals are transmitted to the loudspeaker amplifying circuit and the earphone amplifying circuit after being processed by the operational amplifier and the volume control chip, so that the monitoring of other conference units during speaking is completed.
As an improvement of the above scheme, the method further comprises the following steps: controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow; and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps: data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received; and carrying out data transmission according to a signal point-to-point transmission method.
As an improvement of the scheme, the IEEE802.3af/at standard PoE switch is adopted for data interaction and power supply.
As an improvement of the above solution, the present embodiment further provides an audio transmission system of a conference unit, including: the system comprises a conference unit, a conference host, a PoE switch, a computer client and a sound amplification system; the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplification system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit.
To better explain the audio transmission system of the conference unit, please refer to fig. 3, the computer client, the conference host and the plurality of conference units are connected with the PoE switch through the network cable, so as to implement data interaction, and the computer client accordingly performs corresponding settings on the conference host and the plurality of conference units, so as to implement control on the system. The conference host is connected with the sound amplifying system through the audio cable, and the sound amplification and sound amplification of the sound collected by the conference unit are completed.
The embodiment of the invention carries out preprocessing and sampling on the audio data, sends the obtained sampling data to the message queue according to the interrupt signal, and controls the uploading of the sampling data according to the processing process of the message queue, so that each audio signal is not collided in the transmission process, and then the sampling data is uploaded to the conference host computer through the IP address of the server by the network signal, thereby realizing the digital transmission of the audio data and optimizing the problem of high audio transmission delay of the wired conference unit. The audio data is coded, decoded and sampled by WM8978 with 16 bits and 48KHz sampling coding and decoding rate, thereby ensuring high fidelity restoration of the audio signal. The IEEE802.3af/at standard PoE is adopted for power supply, so that the electrical safety is improved, and meanwhile, the field wiring is simplified, and the wiring cost is reduced.
Example two
Referring to fig. 2, fig. 2 is a schematic structural diagram of an audio transmission apparatus of a conference unit according to an embodiment of the present invention, including: the system comprises a sampling module 201, an interruption module 202, a sound intensity module 203 and an uploading module 204;
the sampling module 201 is configured to pre-process continuously acquired audio data to obtain a plurality of sampling data, and obtain server IP addresses corresponding to the plurality of sampling data respectively; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module 202 is configured to generate an interrupt signal according to an interrupt server function when the number of the plurality of sample data is greater than a number threshold;
the sound intensity module 203 is configured to send the plurality of sample data to a message queue according to the interrupt signal, and extract the sound intensity of the sample data in the message queue through a preset message queue processing thread;
the uploading module 204 is configured to, when the sound intensity is greater than the decibel threshold, upload the sampling data with the sound intensity greater than the decibel threshold to the conference host through a network signal according to the server IP address.
As an improvement of the above solution, the sampling module 201 includes: the device comprises a microphone unit, a coding sampling unit and an IP address unit;
the microphone unit is used for collecting the sounds of the conference units through the microphone and carrying out electric signal conversion to obtain a plurality of audio data;
the coding and sampling unit is used for coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through the MCU to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
the IP address unit is used for sending a speaking request to the conference host to acquire a server IP address distributed by the conference host; and the IP address of the server corresponds to each sampling data one by one.
As an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
As an improvement of the above scheme, the method further comprises the following steps: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises the following steps: controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow; and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps: data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received; and carrying out data transmission according to a signal point-to-point transmission method.
As an improvement of the above scheme, the method further comprises the following steps: the speech circuit module, the priority circuit module and the voting circuit module; the speaking key of the speaking circuit module, the priority key of the priority circuit module and the voting key of the voting circuit module adopt mechanical light touch keys.
As an improvement of the above scheme, the speaking circuit module receives a signal generated by pressing the speaking key by the user to speak.
As an improvement of the above scheme, when the conference is signed, the speaking circuit module receives a signal generated by pressing a speaking key by a user for signing.
As an improvement of the scheme, the priority circuit module receives a signal generated by pressing of a priority key by a user to initiate voting.
As an improvement of the scheme, the priority circuit module receives a signal generated by pressing of a priority key by a user to control speaking of other units.
As an improvement of the scheme, the voting circuit module receives a signal generated by pressing a voting key by a user for voting; wherein the voting types include: approval, disapproval, and abandonment.
As an improvement of the above scheme, the method further comprises the following steps: and the front screen of the double-screen display module adopts a 3.2-inch RGB (red, green and blue) color display screen and mainly displays the information and the operation information of the conference unit. The rear screen adopts a 4.0-inch color display screen, and mainly completes the display function of the electronic name board.
As an improvement of the scheme, the double-screen display module acquires the business card information of the personnel participating in the conference through PC client software, then transmits the information to the conference host through the switch, and then the conference host issues the business card information to each unit. And finally, the MCU processor of the conference unit finishes signal interaction with a driving chip of the screen through a serial port, so that the function of the electronic name card is realized.
To better illustrate the present embodiment, the following example is provided for illustration.
Please refer to fig. 4, the STM32-MCU in fig. 4 is connected to the speaking, voting and priority keys through the I/O interface; the STM32-MCU is connected with the two RGB screen driving chips through a UART serial port, and respectively controls and operates the display LCD screen and the electronic nameplate LCD screen through the two RGB screen driving chips, and the STM32-MCU is connected with the audio processing module through an I2S bus; the RTL network chip is connected with the STM32-MCU through an RM II interface, and the network chip is connected with the PoE switch through an RJ45 connector; besides the signal interaction between the RJ45 and the PoE switch, the interaction between other modules is transmitted by digital signals.
Referring to fig. 5 and 6, fig. 5 and 6 are a top view and a side view of the conference unit provided in this embodiment, respectively.
In this embodiment, after the sampling module collects the sampling data, the interrupt module and the sound intensity module control the transmission of the audio data, and finally the sampling data is uploaded to the host computer through the uploading module. The embodiment carries out digital signal processing on the audio signal and the control signal, completes full-digital data transmission among the modules, realizes low-delay transmission of the signal, and improves the anti-interference performance and the confidentiality of the signal. The PoE switch is used for power supply and data exchange, so that direct strong-current power supply and strong-current circuit are avoided while wiring is performed, and the safety and convenience of product use are improved. The embodiment also has the functions of speaking, conference sign-in, chairman priority, voting, electronic nameplate and the like, is highly integrated in function, is more suitable for application in various conference occasions compared with the prior art, can better meet the requirements of customers and is more convenient for customer cost control.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
A terminal device of this embodiment includes: a processor 701, a memory 702, and a computer program stored in said memory 702 and executable on said processor 701. The processor 701, when executing the computer program, implements the steps of the above-described audio transmission method of each conference unit in an embodiment, for example, all the steps of the audio transmission method of the conference unit shown in fig. 1. Alternatively, the processor, when executing the computer program, implements the functions of the modules in the device embodiments, for example: all the modules of the audio transmission means of the conference unit shown in fig. 2.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, where when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute the audio transmission method of the conference unit according to any one of the above embodiments.
It will be appreciated by those skilled in the art that the schematic diagram is merely an example of a terminal device and does not constitute a limitation of a terminal device, and may include more or less components than those shown, or combine certain components, or different components, for example, the terminal device may also include input output devices, network access devices, buses, etc.
The Processor 701 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, or the like. The general processor may be a microprocessor or the processor may be any conventional processor, etc., and the processor 701 is a control center of the terminal device and connects various parts of the whole terminal device by using various interfaces and lines.
The memory 702 may be used to store the computer programs and/or modules, and the processor 701 may implement various functions of the terminal device by running or executing the computer programs and/or modules stored in the memory and calling data stored in the memory 702. The memory 702 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Wherein, the terminal device integrated module/unit can be stored in a computer readable storage medium if it is implemented in the form of software functional unit and sold or used as a stand-alone product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (10)
1. A method for audio transmission by a conference unit, comprising:
preprocessing continuously acquired audio data to obtain a plurality of sampling data, and respectively acquiring server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
when the number of the plurality of sampling data is larger than the number threshold, generating an interrupt signal according to an interrupt server function;
sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and when the sound intensity is greater than the decibel threshold value, uploading the sampling data of which the sound intensity is greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
2. The audio transmission method of a conference unit according to claim 1, wherein the preprocessing is performed on the continuously acquired audio data to obtain a plurality of sampling data, and server IP addresses corresponding to the plurality of sampling data are respectively obtained, specifically:
collecting the sounds of a plurality of conference units through a microphone, and carrying out electric signal conversion to obtain a plurality of audio data;
coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through an MCU (microprogrammed control unit) to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
sending a speaking request to the conference host to acquire a server IP address allocated by the conference host; and the IP address of the server corresponds to each sampling data one by one.
3. The audio transmission method of a conference unit according to claim 2, wherein the preset message queue processing thread specifically is: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
4. The audio transmission method of a conference unit according to claim 2, further comprising:
receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal;
and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
5. The audio transmission method of a conference unit according to claim 2, further comprising:
controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow;
and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
6. The audio transmission method of a conference unit according to claim 2, further comprising:
data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received;
and carrying out data transmission according to a signal point-to-point transmission method.
7. An audio transmission apparatus of a conference unit, comprising: the device comprises a sampling module, an interruption module, a sound intensity module and an uploading module;
the sampling module is used for preprocessing continuously acquired audio data to obtain a plurality of sampling data and respectively obtaining server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module is used for generating an interrupt signal according to an interrupt server function when the number of the plurality of sampling data is greater than a number threshold;
the sound intensity module is used for sending the plurality of sampling data to a message queue according to the interrupt signal and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and the uploading module is used for uploading the sampling data of which the sound intensity is greater than the decibel threshold to the conference host through a network signal according to the IP address of the server when the sound intensity is greater than the decibel threshold.
8. An audio transmission system for a conference unit, comprising: the system comprises a conference unit, a conference host, a PoE switch, a computer client and a sound amplification system; wherein, the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplification system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit in claims 1 to 6.
9. A computer terminal device, comprising a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, the processor implementing a method of audio transmission of a conference unit as claimed in any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, comprising a stored computer program, wherein the computer program, when executed, controls an apparatus in which the computer-readable storage medium is located to perform a method of audio transmission of a conference unit as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210034673.3A CN114553616B (en) | 2022-01-12 | 2022-01-12 | Audio transmission method, device and system of conference unit and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210034673.3A CN114553616B (en) | 2022-01-12 | 2022-01-12 | Audio transmission method, device and system of conference unit and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114553616A true CN114553616A (en) | 2022-05-27 |
| CN114553616B CN114553616B (en) | 2023-11-24 |
Family
ID=81672002
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210034673.3A Active CN114553616B (en) | 2022-01-12 | 2022-01-12 | Audio transmission method, device and system of conference unit and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114553616B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115396069A (en) * | 2022-10-25 | 2022-11-25 | 广州市保伦电子有限公司 | Audio processing method and system for wired and wireless networking conference system |
| CN115529434A (en) * | 2022-09-29 | 2022-12-27 | 苏州科达科技股份有限公司 | Connection terminal, control terminal, conference terminal and conference control system |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA1334685C (en) * | 1985-08-23 | 1995-03-07 | Republic Telcom Systems Corporation | Multiplexed digital packet telephone system |
| WO1996015484A2 (en) * | 1994-11-02 | 1996-05-23 | Advanced Micro Devices, Inc. | Monolithic pc audio circuit |
| JPH0969884A (en) * | 1995-09-01 | 1997-03-11 | Toshiba Corp | Conference support system and method for controlling conference support system |
| CA2259000A1 (en) * | 1996-06-26 | 1997-12-31 | Par Government Systems Corporation | Communicating with electronic tags |
| US20030142764A1 (en) * | 1997-02-18 | 2003-07-31 | Keevill Peter A | Single chip VLSI implementation of a digital receiver employing orthogonal frequency division multiplexing |
| CN1540954A (en) * | 2003-10-30 | 2004-10-27 | 清华大学深圳研究生院 | Method for controlling flux of audio and video flow transferred in IP video meeting system |
| US20050096764A1 (en) * | 2003-10-31 | 2005-05-05 | Weiser Anatoly S. | Sound-activated recording, transmission, and playback |
| EP1942607A2 (en) * | 2000-09-11 | 2008-07-09 | Broadcom Corporation | Cable modem with voice processing capability |
| CN101335869A (en) * | 2008-03-26 | 2008-12-31 | 北京航空航天大学 | Video conference system based on Soft-MCU |
| US20100293286A1 (en) * | 2007-09-13 | 2010-11-18 | Ant - Advanced Network Technologies Oy | Method and system for wireless real-time collection of multichannel digital audio |
| CN102215286A (en) * | 2011-04-06 | 2011-10-12 | 扬州大学 | Sound and time recording system of embedded multi-channel phone |
| CN103885744A (en) * | 2013-05-30 | 2014-06-25 | 美声克（成都）科技有限公司 | Sound based gesture recognition method |
| CN104992711A (en) * | 2015-05-27 | 2015-10-21 | 东南大学 | Local area network cluster duplexing speech communication method based on mobile terminal |
| CN106960290A (en) * | 2017-04-11 | 2017-07-18 | 西华大学 | A kind of 4 S auto shop team sales service quality evaluation system and evaluation method |
| CN109302575A (en) * | 2018-08-21 | 2019-02-01 | 广州市保伦电子有限公司 | A kind of wifi conference system based on IOT module |
| CN109979256A (en) * | 2019-04-24 | 2019-07-05 | 上海乂学教育科技有限公司 | English pronunciation teaching system |
| CN109982100A (en) * | 2019-03-28 | 2019-07-05 | 北京粉笔蓝天科技有限公司 | A kind of audio/video processing method and system |
| WO2019148583A1 (en) * | 2018-02-02 | 2019-08-08 | 深圳市鹰硕技术有限公司 | Intelligent conference management method and system |
| CN111755017A (en) * | 2020-07-06 | 2020-10-09 | 全时云商务服务股份有限公司 | Audio recording method and device for cloud conference, server and storage medium |
| CN112564990A (en) * | 2021-02-23 | 2021-03-26 | 全时云商务服务股份有限公司 | Management method for switching audio management server |
-
2022
- 2022-01-12 CN CN202210034673.3A patent/CN114553616B/en active Active
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA1334685C (en) * | 1985-08-23 | 1995-03-07 | Republic Telcom Systems Corporation | Multiplexed digital packet telephone system |
| WO1996015484A2 (en) * | 1994-11-02 | 1996-05-23 | Advanced Micro Devices, Inc. | Monolithic pc audio circuit |
| JPH0969884A (en) * | 1995-09-01 | 1997-03-11 | Toshiba Corp | Conference support system and method for controlling conference support system |
| CA2259000A1 (en) * | 1996-06-26 | 1997-12-31 | Par Government Systems Corporation | Communicating with electronic tags |
| US20030142764A1 (en) * | 1997-02-18 | 2003-07-31 | Keevill Peter A | Single chip VLSI implementation of a digital receiver employing orthogonal frequency division multiplexing |
| EP1942607A2 (en) * | 2000-09-11 | 2008-07-09 | Broadcom Corporation | Cable modem with voice processing capability |
| CN1540954A (en) * | 2003-10-30 | 2004-10-27 | 清华大学深圳研究生院 | Method for controlling flux of audio and video flow transferred in IP video meeting system |
| US20050096764A1 (en) * | 2003-10-31 | 2005-05-05 | Weiser Anatoly S. | Sound-activated recording, transmission, and playback |
| US20100293286A1 (en) * | 2007-09-13 | 2010-11-18 | Ant - Advanced Network Technologies Oy | Method and system for wireless real-time collection of multichannel digital audio |
| CN101335869A (en) * | 2008-03-26 | 2008-12-31 | 北京航空航天大学 | Video conference system based on Soft-MCU |
| CN102215286A (en) * | 2011-04-06 | 2011-10-12 | 扬州大学 | Sound and time recording system of embedded multi-channel phone |
| CN103885744A (en) * | 2013-05-30 | 2014-06-25 | 美声克（成都）科技有限公司 | Sound based gesture recognition method |
| CN104992711A (en) * | 2015-05-27 | 2015-10-21 | 东南大学 | Local area network cluster duplexing speech communication method based on mobile terminal |
| CN106960290A (en) * | 2017-04-11 | 2017-07-18 | 西华大学 | A kind of 4 S auto shop team sales service quality evaluation system and evaluation method |
| WO2019148583A1 (en) * | 2018-02-02 | 2019-08-08 | 深圳市鹰硕技术有限公司 | Intelligent conference management method and system |
| CN109302575A (en) * | 2018-08-21 | 2019-02-01 | 广州市保伦电子有限公司 | A kind of wifi conference system based on IOT module |
| CN109982100A (en) * | 2019-03-28 | 2019-07-05 | 北京粉笔蓝天科技有限公司 | A kind of audio/video processing method and system |
| CN109979256A (en) * | 2019-04-24 | 2019-07-05 | 上海乂学教育科技有限公司 | English pronunciation teaching system |
| CN111755017A (en) * | 2020-07-06 | 2020-10-09 | 全时云商务服务股份有限公司 | Audio recording method and device for cloud conference, server and storage medium |
| CN112564990A (en) * | 2021-02-23 | 2021-03-26 | 全时云商务服务股份有限公司 | Management method for switching audio management server |
Non-Patent Citations (3)
| Title |
|---|
| WEN CHUANXUE: "The Artificial Reverberation Real-time Processing System Based On DSP", 微计算机信息, no. 20 * |
| 何伟;游婧;张玲;: "基于DM642 RAW采集格式的视频驱动开发及应用", 计算机应用, pages 0 - 5 * |
| 许佳龙;张一闻;刘建平;: "基于麦克风阵列的信号采集处理系统设计", 电子科技, no. 09 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115529434A (en) * | 2022-09-29 | 2022-12-27 | 苏州科达科技股份有限公司 | Connection terminal, control terminal, conference terminal and conference control system |
| CN115396069A (en) * | 2022-10-25 | 2022-11-25 | 广州市保伦电子有限公司 | Audio processing method and system for wired and wireless networking conference system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114553616B (en) | 2023-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114553616B (en) | Audio transmission method, device and system of conference unit and terminal equipment | |
| CN107682752B (en) | Method, device and system for displaying video picture, terminal equipment and storage medium | |
| CN102984496B (en) | The processing method of the audiovisual information in video conference, Apparatus and system | |
| CN205584362U (en) | Conference system | |
| WO2020062670A1 (en) | Method and apparatus for controlling electrical appliance, electrical appliance, and medium | |
| CN210431642U (en) | Interactive wireless audio and video conference integrated terminal system | |
| WO2018090723A1 (en) | Method and apparatus for realizing wired screen delivery | |
| CN108235052A (en) | Multi-audio-frequency channel hardware audio mixing, acquisition and the method for broadcasting may be selected based on IOS | |
| CN105208406A (en) | Video data providing method and apparatus, video playing method and apparatuses, and video playing system | |
| CN113438442A (en) | Conference data sharing method and device | |
| CN108108139A (en) | A kind of throwing screen cut-in method of cloud meeting | |
| CN113765903B (en) | Screen projection method, related device, electronic equipment and storage medium | |
| WO2017177802A1 (en) | Audio/video playback method and apparatus, and computer storage medium | |
| CN2850167Y (en) | Portable mobile conference terminal | |
| CN112087591A (en) | Interactive system and method for video conference | |
| CN103873711A (en) | VOIP phone-based virtual USB (universal serial bus) sound card creation method | |
| CN114584659A (en) | Audio processing unit of conference system | |
| CN112435690B (en) | Duplex Bluetooth translation processing method, duplex Bluetooth translation processing device, computer equipment and storage medium | |
| CN115113573A (en) | Digital conference host and conference control method | |
| CN210807396U (en) | Background music playing terminal and system | |
| CN211830976U (en) | Video conference platform | |
| CN115022573A (en) | Desktop video conference system | |
| CN112565668A (en) | Method, system and readable storage medium for sharing sound in network conference | |
| CN205123890U (en) | Wireless meeting display device | |
| CN203912080U (en) | Movable portable video conference system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |