CN114553616A - Audio transmission method, device and system of conference unit and terminal equipment - Google Patents

Audio transmission method, device and system of conference unit and terminal equipment Download PDF

Info

Publication number
CN114553616A
CN114553616A CN202210034673.3A CN202210034673A CN114553616A CN 114553616 A CN114553616 A CN 114553616A CN 202210034673 A CN202210034673 A CN 202210034673A CN 114553616 A CN114553616 A CN 114553616A
Authority
CN
China
Prior art keywords
data
conference
audio
sampling
sampling data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210034673.3A
Other languages
Chinese (zh)
Other versions
CN114553616B (en
Inventor
郭远林
谢岸海
王恒
张峰
李春华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou DSPPA Audio Co Ltd
Original Assignee
Guangzhou DSPPA Audio Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou DSPPA Audio Co Ltd filed Critical Guangzhou DSPPA Audio Co Ltd
Priority to CN202210034673.3A priority Critical patent/CN114553616B/en
Publication of CN114553616A publication Critical patent/CN114553616A/en
Application granted granted Critical
Publication of CN114553616B publication Critical patent/CN114553616B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1827Network arrangements for conference optimisation or adaptation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/485Task life-cycle, e.g. stopping, restarting, resuming execution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/548Queue

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention provides an audio transmission method, an audio transmission device, an audio transmission system and terminal equipment of a conference unit.

Description

Audio transmission method, device and system of conference unit and terminal equipment
Technical Field
The present invention relates to the field of wired conferences, and in particular, to an audio transmission method, apparatus, terminal, device, and storage medium for a conference system.
Background
The rapid development of electronic information technology enables people's life to be more intelligent and faster, and the requirements of people on tone quality, delay and the like of a conference system are continuously improved. In a conventional wired conference system, the conference system generally includes a conference host and a conference unit, and audio signal transmission may be performed in an analog or digital manner. The simulation conference system is characterized in that a conference host and a conference unit are connected by adopting a multi-core air line, so that the transmission of a simulation audio signal and a serial port control signal is carried out, and the simulation conference system is established according to the transmission of the simulation audio signal and the serial port control signal; the digital conference system adopts a network cable to connect the conference host and the conference unit, and converts the analog audio signal into a digital audio signal in a coding mode, thereby completing the signal transmission and control of audio data and control data.
However, the multi-core air line used by the analog conference unit clock in the market has high requirements, the manufactured material and the transmission line length can have certain influence on the transmission of the audio signal, and when the multi-core air line transmits the audio signal and the serial port control signal, signal interference is easy to generate, and the quality of audio transmission is influenced. The digital conference units in the market generally have the problems of low audio sampling rate, narrow bandwidth and long delay of mixed signals, and the conventional digital conference units generally have 100ms to 500ms delay in delay, so that the user experience is poor.
Therefore, an audio transmission strategy of a conference system is needed to solve the problems of weak interference resistance and high delay of the existing audio transmission.
Disclosure of Invention
The embodiment of the invention provides an audio transmission method, device and system of a conference unit and terminal equipment, and aims to solve the technical problem of long delay of a wired conference unit in audio transmission.
In order to solve the above problem, an embodiment of the present invention provides an audio transmission method for a conference system, including:
preprocessing continuously acquired audio data to obtain a plurality of sampling data, and respectively acquiring server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
when the number of the plurality of sampling data is larger than the number threshold, generating an interrupt signal according to an interrupt server function;
sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and when the sound intensity is greater than the decibel threshold value, uploading the sampling data of which the sound intensity is greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
As an improvement of the above scheme, the preprocessing is performed on the continuously acquired audio data to obtain a plurality of sampling data, and the server IP addresses corresponding to the plurality of sampling data are respectively obtained, specifically:
collecting the sounds of a plurality of conference units through a microphone, and carrying out electric signal conversion to obtain a plurality of audio data;
coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through an MCU (microprogrammed control unit) to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
sending a speaking request to the conference host to acquire a server IP address allocated by the conference host; and the IP address of the server corresponds to each sampling data one by one.
As an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampling data in the message queue in a blocking mode through the message queue processing thread.
As an improvement of the above scheme, the method further comprises the following steps:
receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal;
and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises the following steps:
controlling according to a communication flow control method, and sending a blocking signal back to a source address when a sending buffer or a receiving buffer begins to overflow;
and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps:
data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received;
and carrying out data transmission according to a signal point-to-point transmission method.
Correspondingly, an embodiment of the present invention further provides an audio transmission apparatus for a conference unit, including: the device comprises a sampling module, an interruption module, a sound intensity module and an uploading module;
the sampling module is used for preprocessing continuously acquired audio data to obtain a plurality of sampling data and respectively obtaining server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module is used for generating an interrupt signal according to an interrupt server function when the number of the plurality of sampling data is greater than a number threshold;
the sound intensity module is used for sending the plurality of sampling data to a message queue according to the interrupt signal and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and the uploading module is used for uploading the sampling data of which the sound intensity is greater than the decibel threshold to the conference host through a network signal according to the IP address of the server when the sound intensity is greater than the decibel threshold.
As an improvement of the above scheme, the sampling module includes: the device comprises a microphone unit, a coding sampling unit and an IP address unit;
the microphone unit is used for collecting the sounds of the conference units through the microphone and carrying out electric signal conversion to obtain a plurality of audio data;
the coding and sampling unit is used for coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through the MCU to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
the IP address unit is used for sending a speaking request to the conference host to acquire a server IP address distributed by the conference host; and the IP address of the server corresponds to each sampling data one by one.
As an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
As an improvement of the above scheme, the method further comprises the following steps: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises the following steps: controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow; and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps: data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received; and carrying out data transmission according to a signal point-to-point transmission method.
Correspondingly, an embodiment of the present invention further provides an audio transmission system for a conference unit, including: the system comprises a conference unit, a conference host, a PoE switch, a computer client and a sound amplification system; the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplification system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit.
Correspondingly, the embodiment of the present invention further provides a computer terminal device, which includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, the processor implements the audio transmission method of a conference unit according to the present invention.
Correspondingly, the embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute the audio transmission method of a conference unit according to the present invention.
From the above, the present invention has the following advantages:
the invention provides an audio transmission method, device, system and terminal equipment of a conference unit, which can ensure that each audio data can not collide in the transmission process by preprocessing and sampling the audio data, sending the obtained sampling data to a message queue according to an interrupt signal and controlling the uploading of the sampling data according to the processing process of the message queue, and then uploading the sampling data to a conference host computer by a network signal through a server IP address, and realize the connection of the conference unit and the conference host computer by the network signal through the digital processing of the audio data, thereby realizing the low-delay transmission and ensuring the real-time property of the signal transmission.
Furthermore, the method realizes the low-delay transmission of a plurality of conference units by simultaneously carrying out digital processing on the audio signal and the control signal and combining a communication flow control method, a packet transmission method, an error control method and a signal point-to-point data transmission method.
Drawings
Fig. 1 is a schematic flow chart of an audio transmission method of a conference unit according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an audio transmission apparatus of a conference unit according to an embodiment of the present invention;
fig. 3 is a connection block diagram of an audio transmission system of a conference unit provided by an embodiment of the present invention;
FIG. 4 is a schematic block diagram of a conference unit provided by an embodiment of the present invention;
FIG. 5 is a top view of a conference unit provided by an embodiment of the present invention;
FIG. 6 is a side view of a conference unit provided by an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of an audio transmission method for a conference unit according to an embodiment of the present invention, as shown in fig. 1, the present embodiment includes steps 101 to 104, and each step specifically includes the following steps:
step 101: preprocessing continuously acquired audio data to obtain a plurality of sampling data, and respectively acquiring server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sample data are transmitted by digital signals, and the server IP address is sent by a conference host.
As an improvement of the above scheme, the obtaining of the IP addresses of the servers corresponding to the multiple sampling data specifically includes: collecting the sounds of a plurality of conference units through a microphone, and carrying out electric signal conversion to obtain a plurality of audio data; coding the audio data according to a preset audio coding and decoding chip, and sampling through an MCU (microprogrammed control unit) to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode; sending a speaking request to the conference host to acquire a server IP address allocated by the conference host; and the IP address of the server corresponds to each sampling data one by one.
To better illustrate this step, the following example is provided for illustration.
After the microphone collects sound, the sound analog signal is sent to an audio amplification circuit for processing, then the sound analog signal is transmitted to a WM S audio coding and decoding chip for coding and is transmitted in the form of digital signals, then the sound analog signal is transmitted to the MCU which starts the DMA double buffer memory through an I2S bus for sampling, and finally sampling data which is transmitted in the form of digital signals is obtained. And after the conference host passes the request, acquiring server IP addresses which are distributed by the host and correspond to the sampled data one by one.
Step 102: and when the number of the plurality of sampling data is greater than the number threshold, generating an interrupt signal according to an interrupt server function.
In this step, specifically: and when the quantity of the sampling data reaches the quantity set by the user, triggering an interrupt server function, generating an interrupt signal, and stopping the microphone from collecting other sounds.
Step 103: sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
as an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
Step 104: and when the sound intensity is greater than the decibel threshold value, uploading the sampling data of which the sound intensity is greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
In this step, specifically: and when the sound intensity is greater than the decibel value set by the user, converting the sampled data into a network signal form through the RTL network chip and transmitting the network signal form to the conference host according to the IP address corresponding to the sampled data.
As an improvement of the above scheme, the method further comprises the following steps: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units. The method specifically comprises the following steps: when other conference units speak, the conference host transmits the sampling data uploaded by other units through the PoE switch, the MCU receives the sampling data of other units through the RM II interface of the RTL network chip and transmits the sampling data to the WM 2S audio coding and decoding chip through the I2S bus to decode to obtain audio analog signals, and the audio analog signals are transmitted to the loudspeaker amplifying circuit and the earphone amplifying circuit after being processed by the operational amplifier and the volume control chip, so that the monitoring of other conference units during speaking is completed.
As an improvement of the above scheme, the method further comprises the following steps: controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow; and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps: data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received; and carrying out data transmission according to a signal point-to-point transmission method.
As an improvement of the scheme, the IEEE802.3af/at standard PoE switch is adopted for data interaction and power supply.
As an improvement of the above solution, the present embodiment further provides an audio transmission system of a conference unit, including: the system comprises a conference unit, a conference host, a PoE switch, a computer client and a sound amplification system; the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplification system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit.
To better explain the audio transmission system of the conference unit, please refer to fig. 3, the computer client, the conference host and the plurality of conference units are connected with the PoE switch through the network cable, so as to implement data interaction, and the computer client accordingly performs corresponding settings on the conference host and the plurality of conference units, so as to implement control on the system. The conference host is connected with the sound amplifying system through the audio cable, and the sound amplification and sound amplification of the sound collected by the conference unit are completed.
The embodiment of the invention carries out preprocessing and sampling on the audio data, sends the obtained sampling data to the message queue according to the interrupt signal, and controls the uploading of the sampling data according to the processing process of the message queue, so that each audio signal is not collided in the transmission process, and then the sampling data is uploaded to the conference host computer through the IP address of the server by the network signal, thereby realizing the digital transmission of the audio data and optimizing the problem of high audio transmission delay of the wired conference unit. The audio data is coded, decoded and sampled by WM8978 with 16 bits and 48KHz sampling coding and decoding rate, thereby ensuring high fidelity restoration of the audio signal. The IEEE802.3af/at standard PoE is adopted for power supply, so that the electrical safety is improved, and meanwhile, the field wiring is simplified, and the wiring cost is reduced.
Example two
Referring to fig. 2, fig. 2 is a schematic structural diagram of an audio transmission apparatus of a conference unit according to an embodiment of the present invention, including: the system comprises a sampling module 201, an interruption module 202, a sound intensity module 203 and an uploading module 204;
the sampling module 201 is configured to pre-process continuously acquired audio data to obtain a plurality of sampling data, and obtain server IP addresses corresponding to the plurality of sampling data respectively; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module 202 is configured to generate an interrupt signal according to an interrupt server function when the number of the plurality of sample data is greater than a number threshold;
the sound intensity module 203 is configured to send the plurality of sample data to a message queue according to the interrupt signal, and extract the sound intensity of the sample data in the message queue through a preset message queue processing thread;
the uploading module 204 is configured to, when the sound intensity is greater than the decibel threshold, upload the sampling data with the sound intensity greater than the decibel threshold to the conference host through a network signal according to the server IP address.
As an improvement of the above solution, the sampling module 201 includes: the device comprises a microphone unit, a coding sampling unit and an IP address unit;
the microphone unit is used for collecting the sounds of the conference units through the microphone and carrying out electric signal conversion to obtain a plurality of audio data;
the coding and sampling unit is used for coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through the MCU to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
the IP address unit is used for sending a speaking request to the conference host to acquire a server IP address distributed by the conference host; and the IP address of the server corresponds to each sampling data one by one.
As an improvement of the above scheme, the preset message queue processing thread specifically includes: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
As an improvement of the above scheme, the method further comprises the following steps: receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal; and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
As an improvement of the above scheme, the method further comprises the following steps: controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow; and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
As an improvement of the above scheme, the method further comprises the following steps: data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received; and carrying out data transmission according to a signal point-to-point transmission method.
As an improvement of the above scheme, the method further comprises the following steps: the speech circuit module, the priority circuit module and the voting circuit module; the speaking key of the speaking circuit module, the priority key of the priority circuit module and the voting key of the voting circuit module adopt mechanical light touch keys.
As an improvement of the above scheme, the speaking circuit module receives a signal generated by pressing the speaking key by the user to speak.
As an improvement of the above scheme, when the conference is signed, the speaking circuit module receives a signal generated by pressing a speaking key by a user for signing.
As an improvement of the scheme, the priority circuit module receives a signal generated by pressing of a priority key by a user to initiate voting.
As an improvement of the scheme, the priority circuit module receives a signal generated by pressing of a priority key by a user to control speaking of other units.
As an improvement of the scheme, the voting circuit module receives a signal generated by pressing a voting key by a user for voting; wherein the voting types include: approval, disapproval, and abandonment.
As an improvement of the above scheme, the method further comprises the following steps: and the front screen of the double-screen display module adopts a 3.2-inch RGB (red, green and blue) color display screen and mainly displays the information and the operation information of the conference unit. The rear screen adopts a 4.0-inch color display screen, and mainly completes the display function of the electronic name board.
As an improvement of the scheme, the double-screen display module acquires the business card information of the personnel participating in the conference through PC client software, then transmits the information to the conference host through the switch, and then the conference host issues the business card information to each unit. And finally, the MCU processor of the conference unit finishes signal interaction with a driving chip of the screen through a serial port, so that the function of the electronic name card is realized.
To better illustrate the present embodiment, the following example is provided for illustration.
Please refer to fig. 4, the STM32-MCU in fig. 4 is connected to the speaking, voting and priority keys through the I/O interface; the STM32-MCU is connected with the two RGB screen driving chips through a UART serial port, and respectively controls and operates the display LCD screen and the electronic nameplate LCD screen through the two RGB screen driving chips, and the STM32-MCU is connected with the audio processing module through an I2S bus; the RTL network chip is connected with the STM32-MCU through an RM II interface, and the network chip is connected with the PoE switch through an RJ45 connector; besides the signal interaction between the RJ45 and the PoE switch, the interaction between other modules is transmitted by digital signals.
Referring to fig. 5 and 6, fig. 5 and 6 are a top view and a side view of the conference unit provided in this embodiment, respectively.
In this embodiment, after the sampling module collects the sampling data, the interrupt module and the sound intensity module control the transmission of the audio data, and finally the sampling data is uploaded to the host computer through the uploading module. The embodiment carries out digital signal processing on the audio signal and the control signal, completes full-digital data transmission among the modules, realizes low-delay transmission of the signal, and improves the anti-interference performance and the confidentiality of the signal. The PoE switch is used for power supply and data exchange, so that direct strong-current power supply and strong-current circuit are avoided while wiring is performed, and the safety and convenience of product use are improved. The embodiment also has the functions of speaking, conference sign-in, chairman priority, voting, electronic nameplate and the like, is highly integrated in function, is more suitable for application in various conference occasions compared with the prior art, can better meet the requirements of customers and is more convenient for customer cost control.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
A terminal device of this embodiment includes: a processor 701, a memory 702, and a computer program stored in said memory 702 and executable on said processor 701. The processor 701, when executing the computer program, implements the steps of the above-described audio transmission method of each conference unit in an embodiment, for example, all the steps of the audio transmission method of the conference unit shown in fig. 1. Alternatively, the processor, when executing the computer program, implements the functions of the modules in the device embodiments, for example: all the modules of the audio transmission means of the conference unit shown in fig. 2.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, where when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute the audio transmission method of the conference unit according to any one of the above embodiments.
It will be appreciated by those skilled in the art that the schematic diagram is merely an example of a terminal device and does not constitute a limitation of a terminal device, and may include more or less components than those shown, or combine certain components, or different components, for example, the terminal device may also include input output devices, network access devices, buses, etc.
The Processor 701 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, or the like. The general processor may be a microprocessor or the processor may be any conventional processor, etc., and the processor 701 is a control center of the terminal device and connects various parts of the whole terminal device by using various interfaces and lines.
The memory 702 may be used to store the computer programs and/or modules, and the processor 701 may implement various functions of the terminal device by running or executing the computer programs and/or modules stored in the memory and calling data stored in the memory 702. The memory 702 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Wherein, the terminal device integrated module/unit can be stored in a computer readable storage medium if it is implemented in the form of software functional unit and sold or used as a stand-alone product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (10)

1. A method for audio transmission by a conference unit, comprising:
preprocessing continuously acquired audio data to obtain a plurality of sampling data, and respectively acquiring server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
when the number of the plurality of sampling data is larger than the number threshold, generating an interrupt signal according to an interrupt server function;
sending the plurality of sampling data to a message queue according to the interrupt signal, and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and when the sound intensity is greater than the decibel threshold value, uploading the sampling data of which the sound intensity is greater than the decibel threshold value to the conference host through a network signal according to the IP address of the server.
2. The audio transmission method of a conference unit according to claim 1, wherein the preprocessing is performed on the continuously acquired audio data to obtain a plurality of sampling data, and server IP addresses corresponding to the plurality of sampling data are respectively obtained, specifically:
collecting the sounds of a plurality of conference units through a microphone, and carrying out electric signal conversion to obtain a plurality of audio data;
coding the plurality of audio data according to a preset audio coding and decoding chip, and sampling through an MCU (microprogrammed control unit) to obtain a plurality of sampling data transmitted by digital signals; the MCU performs sampling through a DMA double-cache mode;
sending a speaking request to the conference host to acquire a server IP address allocated by the conference host; and the IP address of the server corresponds to each sampling data one by one.
3. The audio transmission method of a conference unit according to claim 2, wherein the preset message queue processing thread specifically is: and receiving the sampled data in the message queue in a blocking mode through the message queue processing thread.
4. The audio transmission method of a conference unit according to claim 2, further comprising:
receiving sampling data transmitted by a server, and inputting the sampling data into a decoding chip for decoding to obtain an analog audio signal;
and after the operational amplifier processing and the volume control are carried out on the analog audio signals, the analog audio signals are input to a loudspeaker amplifying circuit and an earphone amplifying circuit to obtain audio data of other conference units.
5. The audio transmission method of a conference unit according to claim 2, further comprising:
controlling according to a communication flow control method, and sending a blocking signal back to the source address when the sending buffer or the receiving buffer begins to overflow;
and controlling according to an error control method, automatically retransmitting for three times when the response data is not received, and waiting for data response.
6. The audio transmission method of a conference unit according to claim 2, further comprising:
data transmission is carried out according to a packet transmission method, transmission is carried out by taking a packet as a unit, data to be uploaded or received are transmitted to a memory for temporary storage, and when the transmission is idle, the data to be uploaded or received are uploaded or received;
and carrying out data transmission according to a signal point-to-point transmission method.
7. An audio transmission apparatus of a conference unit, comprising: the device comprises a sampling module, an interruption module, a sound intensity module and an uploading module;
the sampling module is used for preprocessing continuously acquired audio data to obtain a plurality of sampling data and respectively obtaining server IP addresses corresponding to the plurality of sampling data; wherein the plurality of sampled data are transmitted by digital signals, and the server IP address is sent by a conference host;
the interrupt module is used for generating an interrupt signal according to an interrupt server function when the number of the plurality of sampling data is greater than a number threshold;
the sound intensity module is used for sending the plurality of sampling data to a message queue according to the interrupt signal and extracting the sound intensity of the sampling data in the message queue through a preset message queue processing thread;
and the uploading module is used for uploading the sampling data of which the sound intensity is greater than the decibel threshold to the conference host through a network signal according to the IP address of the server when the sound intensity is greater than the decibel threshold.
8. An audio transmission system for a conference unit, comprising: the system comprises a conference unit, a conference host, a PoE switch, a computer client and a sound amplification system; wherein, the conference unit is connected with the PoE switch through a network cable, the conference host is connected with the PoE switch through a network cable, the computer client is connected with the PoE switch through a network cable, the sound amplification system is connected with the conference host through an audio cable, and the conference unit is applied to the audio transmission method of the conference unit in claims 1 to 6.
9. A computer terminal device, comprising a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, the processor implementing a method of audio transmission of a conference unit as claimed in any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, comprising a stored computer program, wherein the computer program, when executed, controls an apparatus in which the computer-readable storage medium is located to perform a method of audio transmission of a conference unit as claimed in any one of claims 1 to 6.
CN202210034673.3A 2022-01-12 2022-01-12 Audio transmission method, device and system of conference unit and terminal equipment Active CN114553616B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210034673.3A CN114553616B (en) 2022-01-12 2022-01-12 Audio transmission method, device and system of conference unit and terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210034673.3A CN114553616B (en) 2022-01-12 2022-01-12 Audio transmission method, device and system of conference unit and terminal equipment

Publications (2)

Publication Number Publication Date
CN114553616A true CN114553616A (en) 2022-05-27
CN114553616B CN114553616B (en) 2023-11-24

Family

ID=81672002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210034673.3A Active CN114553616B (en) 2022-01-12 2022-01-12 Audio transmission method, device and system of conference unit and terminal equipment

Country Status (1)

Country Link
CN (1) CN114553616B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115396069A (en) * 2022-10-25 2022-11-25 广州市保伦电子有限公司 Audio processing method and system for wired and wireless networking conference system
CN115529434A (en) * 2022-09-29 2022-12-27 苏州科达科技股份有限公司 Connection terminal, control terminal, conference terminal and conference control system

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA1334685C (en) * 1985-08-23 1995-03-07 Republic Telcom Systems Corporation Multiplexed digital packet telephone system
WO1996015484A2 (en) * 1994-11-02 1996-05-23 Advanced Micro Devices, Inc. Monolithic pc audio circuit
JPH0969884A (en) * 1995-09-01 1997-03-11 Toshiba Corp Conference support system and method for controlling conference support system
CA2259000A1 (en) * 1996-06-26 1997-12-31 Par Government Systems Corporation Communicating with electronic tags
US20030142764A1 (en) * 1997-02-18 2003-07-31 Keevill Peter A Single chip VLSI implementation of a digital receiver employing orthogonal frequency division multiplexing
CN1540954A (en) * 2003-10-30 2004-10-27 清华大学深圳研究生院 Method for controlling flux of audio and video flow transferred in IP video meeting system
US20050096764A1 (en) * 2003-10-31 2005-05-05 Weiser Anatoly S. Sound-activated recording, transmission, and playback
EP1942607A2 (en) * 2000-09-11 2008-07-09 Broadcom Corporation Cable modem with voice processing capability
CN101335869A (en) * 2008-03-26 2008-12-31 北京航空航天大学 Video conference system based on Soft-MCU
US20100293286A1 (en) * 2007-09-13 2010-11-18 Ant - Advanced Network Technologies Oy Method and system for wireless real-time collection of multichannel digital audio
CN102215286A (en) * 2011-04-06 2011-10-12 扬州大学 Sound and time recording system of embedded multi-channel phone
CN103885744A (en) * 2013-05-30 2014-06-25 美声克(成都)科技有限公司 Sound based gesture recognition method
CN104992711A (en) * 2015-05-27 2015-10-21 东南大学 Local area network cluster duplexing speech communication method based on mobile terminal
CN106960290A (en) * 2017-04-11 2017-07-18 西华大学 A kind of 4 S auto shop team sales service quality evaluation system and evaluation method
CN109302575A (en) * 2018-08-21 2019-02-01 广州市保伦电子有限公司 A kind of wifi conference system based on IOT module
CN109979256A (en) * 2019-04-24 2019-07-05 上海乂学教育科技有限公司 English pronunciation teaching system
CN109982100A (en) * 2019-03-28 2019-07-05 北京粉笔蓝天科技有限公司 A kind of audio/video processing method and system
WO2019148583A1 (en) * 2018-02-02 2019-08-08 深圳市鹰硕技术有限公司 Intelligent conference management method and system
CN111755017A (en) * 2020-07-06 2020-10-09 全时云商务服务股份有限公司 Audio recording method and device for cloud conference, server and storage medium
CN112564990A (en) * 2021-02-23 2021-03-26 全时云商务服务股份有限公司 Management method for switching audio management server

Patent Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA1334685C (en) * 1985-08-23 1995-03-07 Republic Telcom Systems Corporation Multiplexed digital packet telephone system
WO1996015484A2 (en) * 1994-11-02 1996-05-23 Advanced Micro Devices, Inc. Monolithic pc audio circuit
JPH0969884A (en) * 1995-09-01 1997-03-11 Toshiba Corp Conference support system and method for controlling conference support system
CA2259000A1 (en) * 1996-06-26 1997-12-31 Par Government Systems Corporation Communicating with electronic tags
US20030142764A1 (en) * 1997-02-18 2003-07-31 Keevill Peter A Single chip VLSI implementation of a digital receiver employing orthogonal frequency division multiplexing
EP1942607A2 (en) * 2000-09-11 2008-07-09 Broadcom Corporation Cable modem with voice processing capability
CN1540954A (en) * 2003-10-30 2004-10-27 清华大学深圳研究生院 Method for controlling flux of audio and video flow transferred in IP video meeting system
US20050096764A1 (en) * 2003-10-31 2005-05-05 Weiser Anatoly S. Sound-activated recording, transmission, and playback
US20100293286A1 (en) * 2007-09-13 2010-11-18 Ant - Advanced Network Technologies Oy Method and system for wireless real-time collection of multichannel digital audio
CN101335869A (en) * 2008-03-26 2008-12-31 北京航空航天大学 Video conference system based on Soft-MCU
CN102215286A (en) * 2011-04-06 2011-10-12 扬州大学 Sound and time recording system of embedded multi-channel phone
CN103885744A (en) * 2013-05-30 2014-06-25 美声克(成都)科技有限公司 Sound based gesture recognition method
CN104992711A (en) * 2015-05-27 2015-10-21 东南大学 Local area network cluster duplexing speech communication method based on mobile terminal
CN106960290A (en) * 2017-04-11 2017-07-18 西华大学 A kind of 4 S auto shop team sales service quality evaluation system and evaluation method
WO2019148583A1 (en) * 2018-02-02 2019-08-08 深圳市鹰硕技术有限公司 Intelligent conference management method and system
CN109302575A (en) * 2018-08-21 2019-02-01 广州市保伦电子有限公司 A kind of wifi conference system based on IOT module
CN109982100A (en) * 2019-03-28 2019-07-05 北京粉笔蓝天科技有限公司 A kind of audio/video processing method and system
CN109979256A (en) * 2019-04-24 2019-07-05 上海乂学教育科技有限公司 English pronunciation teaching system
CN111755017A (en) * 2020-07-06 2020-10-09 全时云商务服务股份有限公司 Audio recording method and device for cloud conference, server and storage medium
CN112564990A (en) * 2021-02-23 2021-03-26 全时云商务服务股份有限公司 Management method for switching audio management server

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
WEN CHUANXUE: "The Artificial Reverberation Real-time Processing System Based On DSP", 微计算机信息, no. 20 *
何伟;游婧;张玲;: "基于DM642 RAW采集格式的视频驱动开发及应用", 计算机应用, pages 0 - 5 *
许佳龙;张一闻;刘建平;: "基于麦克风阵列的信号采集处理系统设计", 电子科技, no. 09 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115529434A (en) * 2022-09-29 2022-12-27 苏州科达科技股份有限公司 Connection terminal, control terminal, conference terminal and conference control system
CN115396069A (en) * 2022-10-25 2022-11-25 广州市保伦电子有限公司 Audio processing method and system for wired and wireless networking conference system

Also Published As

Publication number Publication date
CN114553616B (en) 2023-11-24

Similar Documents

Publication Publication Date Title
CN114553616B (en) Audio transmission method, device and system of conference unit and terminal equipment
CN107682752B (en) Method, device and system for displaying video picture, terminal equipment and storage medium
CN102984496B (en) The processing method of the audiovisual information in video conference, Apparatus and system
CN205584362U (en) Conference system
WO2020062670A1 (en) Method and apparatus for controlling electrical appliance, electrical appliance, and medium
CN210431642U (en) Interactive wireless audio and video conference integrated terminal system
WO2018090723A1 (en) Method and apparatus for realizing wired screen delivery
CN108235052A (en) Multi-audio-frequency channel hardware audio mixing, acquisition and the method for broadcasting may be selected based on IOS
CN105208406A (en) Video data providing method and apparatus, video playing method and apparatuses, and video playing system
CN113438442A (en) Conference data sharing method and device
CN108108139A (en) A kind of throwing screen cut-in method of cloud meeting
CN113765903B (en) Screen projection method, related device, electronic equipment and storage medium
WO2017177802A1 (en) Audio/video playback method and apparatus, and computer storage medium
CN2850167Y (en) Portable mobile conference terminal
CN112087591A (en) Interactive system and method for video conference
CN103873711A (en) VOIP phone-based virtual USB (universal serial bus) sound card creation method
CN114584659A (en) Audio processing unit of conference system
CN112435690B (en) Duplex Bluetooth translation processing method, duplex Bluetooth translation processing device, computer equipment and storage medium
CN115113573A (en) Digital conference host and conference control method
CN210807396U (en) Background music playing terminal and system
CN211830976U (en) Video conference platform
CN115022573A (en) Desktop video conference system
CN112565668A (en) Method, system and readable storage medium for sharing sound in network conference
CN205123890U (en) Wireless meeting display device
CN203912080U (en) Movable portable video conference system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant