CN112071132A - Audio and video teaching equipment and intelligent teaching system - Google Patents
Audio and video teaching equipment and intelligent teaching system Download PDFInfo
- Publication number
- CN112071132A CN112071132A CN202010917719.7A CN202010917719A CN112071132A CN 112071132 A CN112071132 A CN 112071132A CN 202010917719 A CN202010917719 A CN 202010917719A CN 112071132 A CN112071132 A CN 112071132A
- Authority
- CN
- China
- Prior art keywords
- audio
- video
- board
- teaching
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides audio and video teaching equipment and an intelligent teaching system, which are used for an intelligent blackboard or a touch all-in-one machine, and comprise: the core board is used for processing the acquired audio and video; the audio processing module comprises an echo cancellation unit, a howling suppression unit and an automatic gain control processing unit, and the audio coding and decoding processing module comprises an A/D conversion unit, a D/A conversion unit, a filtering unit and a sound mixing processing unit; the core board is used for selectively transmitting the audio obtained through audio and video processing to the audio processing module and/or the audio coding and decoding processing module according to the received control instruction or the acquired audio and video content. Can simplify the classroom audio frequency through the present case and connect, reduce the equipment fixing debug time in wisdom classroom, support through the wisdom blackboard just can carry out the teaching activity of local public address on class and remote interactive teaching, improve audio and video processing efficiency.
Description
Technical Field
The invention relates to the technical field of teaching equipment, in particular to audio and video teaching equipment for an intelligent blackboard or a touch all-in-one machine.
Background
At present, an intelligent blackboard or a touch all-in-one machine is widely used in the teaching field and becomes standard equipment for various classrooms of general education, professors and high education. The intelligent blackboard and the touch all-in-one machine are integrated with the audio sound amplification function, but basically have no other audio processing function. However, audio-video teaching is widely used in schools at present, and particularly in classrooms, the use of audio is just needed for teaching activities, and basically, any teaching activity can not leave the audio. The current wisdom blackboard or touch-control all-in-one machine lack in the aspect of audio processing, need add corresponding audio processing equipment, the functional requirement of school to the wisdom classroom now, the required corresponding audio processing equipment that must increase of functions such as strange land with the previous lesson (remote interactive teaching), classroom in the air, lead to the classroom especially the apparatus in the podium (on) more and more, every increase function just needs to increase corresponding equipment, and most equipment is placed in the podium, the podium is full of various audio equipment, and the internal connection is complicated, the installation is complicated, it is also very troublesome to use, greatly reduced the reliability of system, podium desktop equipment too many also brings very big use complexity for the mr, lead to the ease for use lower.
At present, the audio processing of the intelligent blackboard or the touch all-in-one machine is very simple, and only has a single sound amplifying and playing function, and a power amplifier and a loudspeaker (similar to a household television) are integrated in the intelligent blackboard or the touch all-in-one machine, so that a specific audio file can be played, but no other audio function exists. The audio amplifier is not enough for teaching application, teaching activities firstly need a local audio amplifying function, namely local real-time audio amplifying of the sound of a teacher in class, each student in a classroom can hear clearly, but howling cannot occur, in the past, in order to realize the function, a frequency shift power amplifier needs to be configured in the classroom for local audio amplifying of the classroom, the frequency shift power amplifier is generally large in size and more in connecting lines, and the audio amplifier belongs to a product of a first-generation multimedia classroom. The current intelligent blackboard or touch all-in-one machine does not have a local sound amplifying function, certainly, the problem of local sound amplifying and howling cannot be solved, and a teacher still needs to rely on first-generation independent local sound amplifying equipment in class.
Along with the requirements of cooperative learning and teaching resource equalization, schools have more and more requirements for remote interactive teaching (the same class in different places, class in the air and the like), the problem that echo cancellation is needed to be solved in remote interactive teaching is an echo cancellation problem, the echo cancellation is a technology in a remote audio and video conference, the echo cancellation is complex, and if the remote audio and video conference is to be built in each classroom, additional echo cancellation audio processing equipment needs to be configured, so that the cost is high, the connection is complex, and the remote audio and video conference is not practical. There is a need in the educational field for a low cost, convenient and easy to use solution, especially after the emergence of emergencies such as SARS and new coronary pneumonia.
At present, the intelligent blackboard and the touch control all-in-one machine are largely used in an intelligent classroom, but most of the intelligent blackboard and the touch control all-in-one machine are applied to the aspects of playing, displaying, controlling, storing and other videos, relate to audio application, are only used for sound reinforcement of video file playing, the most important audio aspects in the teaching activities, such as local sound amplification, howling elimination and audio processing (AEC, echo elimination) functions related to the current intelligent classroom in the same class in different places, namely remote interactive teaching, can not be realized by all the intelligent blackboards or touch control integrated machines at present and needing additional audio processing equipment, the remote interaction also involves complicated audio processing connection lines, and the connection lines of reference audio, mixed audio, audio after echo cancellation, MIC, a sound box and the like can not be connected in error, in addition, the compatibility and parameter debugging among different devices are involved, and the teaching is too complex for teachers to perform daily teaching; because the audio is very sensitive and is easily interfered, the functions are realized in the intelligent blackboard in a centralized manner, the compatibility problem of each device can occur, or the problem of poor connection caused by too many connecting lines can occur.
The intelligent blackboard or the touch all-in-one machine is provided with a sound box and can be used for amplifying sound, but if the local sound amplification is not processed, a sound loop can be generated, and finally howling is caused, when remote interaction is carried out, remote audio can be played locally, the remote audio and the local audio can be collected by a microphone together, if no processing is carried out, the two audios can be coded and processed together and sent to the remote end for playing, at the moment, the remote end can not only hear the sound of the opposite end, but also hear the sound just spoken by the remote end in one second, so-called echo is required to be eliminated, and normal communication of the two parties is not influenced. In addition, the remote interactive echo cancellation and the local amplified howling suppression are always processed by adopting a pure audio algorithm, and generally, independent audio processing equipment is used in remote interactive or amplified application, and the audio processing is independently carried out and never combined with video, so that the audio processing cannot be applied to video processing.
Disclosure of Invention
The embodiment of the invention provides audio and video teaching equipment and an intelligent teaching system which can reduce the construction cost of a smart classroom, shorten the equipment installation and debugging time of the smart classroom, support the teaching activities of local sound amplification class attendance and remote interactive teaching, save the processing space of a core board and improve the audio and video processing efficiency.
The embodiment of the invention provides audio and video teaching equipment which is used for an intelligent blackboard or a touch all-in-one machine, and the audio and video teaching equipment comprises:
the core board is used for processing the acquired audio and video;
the audio processing module comprises an echo cancellation unit, a howling suppression unit and an automatic gain control processing unit, and the audio coding and decoding processing module comprises an A/D conversion unit, a D/A conversion unit, a filtering unit and a sound mixing processing unit; the audio processing module on the audio board is connected to the core board through a USB interface, and the audio coding and decoding processing module on the audio board is connected to the core board through a first I2S interface and connected to the audio processing module through a second I2S interface; the audio board is hung on the core board as two independent audio devices through a USB interface and a first I2S interface, and the audio board performs audio data internal interaction through a second I2S interface.
The core board is used for selectively transmitting audio data obtained through audio and video processing to the audio processing module and/or the audio coding and decoding processing module through the USB interface and the first I2S interface simultaneously according to the received control instruction or the acquired content of the audio and video.
The audio and video teaching device according to an embodiment of the present invention further includes an audio and video device, where the audio and video device includes a local audio and video device and a remote audio and video device, the core board is connected to the local audio and video device through a third I2S interface and connected to the remote audio and video device through a network, respectively, the remote audio and video device sends real-time data to the core board through an RTP protocol, and the remote audio and video device receives the real-time data from the core board through the RTP protocol.
According to the audio and video teaching device of an embodiment of the present invention, the processing of the acquired audio and video includes: audio and video management, audio and video coding and decoding, audio and video storage and video display output and audio and video timestamp processing.
The audio and video teaching device further comprises an analog microphone connected with the audio board through an external audio cable.
The audio and video teaching device according to an embodiment of the present invention further includes a speaker or an external sound amplifying device connected to the audio panel through a fourth I2S interface, wherein the audio panel includes an audio integration module, and the audio integration module is configured to copy and output audio played by the speaker in left and right channels of the fourth I2S interface, respectively.
According to the audio and video teaching device provided by the embodiment of the invention, the audio board is used for receiving a mixed audio which is processed by the core board and is input by the local audio and video device and the far-end audio and video device, the mixed audio comprises the local audio and the far-end audio, the echo cancellation unit is used for storing the far-end audio in the mixed audio as a reference tone, comparing the mixed audio with the reference tone, and sending an audio data packet obtained after deleting the audio which is the same as the reference tone in the mixed audio to the far-end audio and video device after processing by the core board.
According to an embodiment of the present invention, the audio and video teaching device includes a main speaker device and an interactive device, the core board has an ALSA unit for digitally mixing multiple channels of audio in the main speaker device and the interactive device, the ALSA unit is further configured to simultaneously send the multiple channels of audio to the audio board through a first I2S interface or a USB interface, and acquire audio data processed by the audio board from the audio board through a first I2S interface or a USB interface.
According to the audio and video teaching device provided by the embodiment of the invention, the howling suppression unit adopts a DSP howling suppression algorithm to process audio data acquired by the audio and video device after sound amplification, so that howling suppression is realized.
According to the audio and video teaching device provided by the embodiment of the invention, the audio and video device comprises at least one of an intelligent terminal, a camera and a PC, and the remote audio and video device comprises at least one of an intelligent terminal, a network camera, a PC and a projection device.
The embodiment of the invention provides an intelligent teaching system which comprises the audio and video teaching equipment.
The embodiment of the invention provides audio and video teaching equipment and an intelligent teaching system, which adopt an integrated and miniaturized design, on one hand, the equipment quantity in a platform of a smart classroom is greatly reduced, the equipment is extremely simple under the condition that the functions are not reduced, the platform desktop space is reserved for teachers to use, the problems of too many pieces of equipment, too complex connecting lines, poor stability, inconvenience in use and the like of the platform of the smart classroom are solved, a plurality of products such as a frequency shift power amplifier, an audio processor, a sound box and the like are saved, and meanwhile, the connecting lines among the equipment can be reduced; the problems of local sound amplification and howling generated by local sound amplification in teacher teaching of the intelligent blackboard or touch all-in-one machine are solved, the teacher can be separated from a old-fashioned frequency shift power amplifier, and the intelligent blackboard or touch all-in-one machine can locally amplify the sound for class; the stability and the quality of sound are greatly improved; the cooperation among all devices is not needed, the operation and the control of the whole system are simple, and the use complexity of the system is greatly reduced; the functions which can be realized only by a plurality of devices in the prior art of the intelligent classroom can be realized on one intelligent blackboard or touch control integrated machine, so that the construction cost of the intelligent classroom is greatly reduced, and the device installation and debugging time of the intelligent classroom is greatly shortened; convenient control also can promote user experience greatly.
The embodiment of the scheme solves the problem that a remote audio and video conference can be built only by a plurality of devices in a smart classroom during remote interactive teaching, and only one smart blackboard or touch all-in-one machine is needed, and no additional audio processing device is needed; the teaching activities are convenient to be recycled, and the function of recording courses in a normalized mode can be realized; the AEC remote interactive echo cancellation function is realized in the intelligent blackboard or the touch all-in-one machine, and the teaching activities of local sound amplification class giving and remote interactive teaching can be supported.
The embodiment of the scheme provides two independent audio interfaces I2S and a USB on a single audio board, and the two independent audio interfaces I2S and the USB can be hung in a core board as two independent audio devices respectively, the core board can extract audio data from audio and video according to needs and select audio channels according to received control instructions or acquired audio and video contents, and simultaneously carry out different audio processing on the audio board according to the two independent audio devices, such as sending or acquiring completely different audio data and the like, the two independent audio interfaces can operate independently and exchange data mutually, are not related and do not influence each other, one or two of the two independent audio devices can be selected according to needs and exchange data, and do not influence each other, so that the processing space of the core board is saved, and the audio and video processing efficiency is greatly improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of an audio-video teaching device provided by an embodiment of the present invention;
fig. 2 is a schematic diagram of an audio-video teaching device provided in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 shows an audio and video teaching device according to an embodiment of the present invention, which is used for an intelligent blackboard or a touch all-in-one machine, and the audio and video teaching device includes:
the core board 10 is used for processing the acquired audio and video;
an audio board 20, on which an audio processing module 21 and an audio coding processing module 22 are integrated, wherein the audio processing module 21 is connected to the core board 10 through a USB interface, and the audio coding processing module 22 is connected to the core board 10 through a first I2S interface and connected to the audio processing module 21 through a second I2S interface; the audio processing module 21 includes an echo cancellation unit, a howling suppression unit, and an automatic gain control processing unit, and the audio coding and decoding processing module 22 includes an a/D conversion unit, a D/a conversion unit, a filtering unit, and a sound mixing processing unit; the audio board 20 may be simultaneously hung on the core board operating system as two independent audio devices through the USB interface and the first I2S interface, respectively, and the audio board 20 may perform internal interaction of audio data through the second I2S interface.
The core board 10 is configured to selectively transmit audio data obtained through audio/video processing to the audio processing module 21 and/or the audio encoding/decoding processing module 22 through the USB interface and the first I2S interface simultaneously according to a received control instruction or acquired content of the audio/video.
The method provided by the invention is characterized in that the original echo cancellation and howling suppression hardware is miniaturized in the intelligent blackboard or touch all-in-one machine, the algorithm is optimized, and the video auxiliary audio processing is utilized to realize the audio and video processing in the intelligent blackboard or touch all-in-one machine so as to complete the corresponding functions. The method realizes the analog audio and video acquisition, the audio channel selection, the analog audio A/D conversion into digital signals, converts the digital audio signals D/A into analog audio, audio mixing, audio channel selection and the like, and connects external audio sources such as a microphone, a computer, an IPC and the like with a core processing system.
The echo cancellation unit and the howling suppression unit are used for realizing remote echo cancellation (AEC) and local amplified howling suppression (AFC), and are uniformly centralized in the audio processing module 21, so that the remote interactive echo cancellation and local howling suppression functions are realized. When remote interaction is carried out, the local audio and video equipment 30 plays the audio input by the far-end audio and video equipment 40, the audio of the far-end audio and video equipment 40 and the local audio are collected by the microphone, if no processing is carried out, the two audios are coded and processed together and are sent to the far-end audio and video equipment 40 for playing, at the moment, the far-end audio and video equipment 40 can not only hear the sound of the opposite end, but also hear the sound just spoken by the far-end audio and video equipment before several seconds, so-called echo, and the echo needs to be eliminated so as not to influence the normal communication of the two parties. It is normal that only the voice of the other party is heard, but the voice transmitted to the other party by the user is not heard.
Audio data channel management, in a teaching scene, especially in a remote interactive (e.g. remote in the same class), the audio data is of various types, such as audio (more than one) from a remote IPC camera, audio to be sent to the remote, local courseware audio, remote courseware audio, local speaking audio, full audio (for recording lessons), etc., and the system is required to transmit and process audio data through different audio paths, and simultaneously, the system is also required to cooperate with video to process audio. The embodiment of the present disclosure is implemented by using a core board 10 and an audio board 20, where the core board 10 is based on a rake micro RK3399 chip and is mainly used for video processing such as video management, video encoding and decoding, video storage, and video display output, and the RK3399 itself does not perform AEC (echo cancellation), AFC (howling suppression), AGC (automatic gain control), and the like on audio, but the RK3399 also performs processing such as channel management, audio encoding and decoding, and management of audio devices on audio, and the RK3399 also processes timestamps of audio and video, and it is just to optimize audio processing on an auxiliary audio board by using processing of the RK3399 on video timestamps. The audio board 20 performs arithmetic processing such as AEC (echo cancellation), AFC (howling suppression), AGC (automatic gain control) and the like by using the TI C55X DSP, which is different from a common pure software audio algorithm, in this embodiment, processing of an audio algorithm by using a special independent DSP does not occupy system processing resources and does not affect other functions of the system, and processing of analog audio, such as a/D, D/a conversion, filtering, audio mixing and the like, can be performed simultaneously by using the audio codec processing module 22 while using the DSP. Unlike using external dedicated audio processing devices, the audio board 20 may be hooked to the core board 10 operating system as an audio device of the core board 10, so that the core board 10 may perform high-level audio processing on the audio board 20 under the standard ALSA architecture of the operating system.
Because the C55X is a DSP, and needs to be used with the Audio Codec processing module 22(Audio Codec), the Audio Codec processing module 22 is an AIC3106 chip of TI, the C5XX is connected to the CPU of the core board 10 through USB, and the AIC3106 is connected to the I2S of the C5XX through the second I2S interface, and the AIC3106 also has the capability of expanding the first I2S and can be directly connected to the CPU, so that when non-remote interaction is performed, the same functions and applications as before can be retained, in addition, there are more Audio channels in the AIC3106, and the Audio input and output interfaces can be connected to the AIC3106 and then transmitted to different I2S, and the common Audio input and output interface can be conveniently mixed with the third Audio board 20 for use, so that when non-remote interaction is performed, the same as when analog Audio is used, and the processing of the analog Audio is convenient and flexible, can fine isolation remote interaction and the audio frequency of non-remote interaction, whole audio panel 20's hardware size is very little (about 8cm 10cm), can be very convenient put into wisdom blackboard or touch-control all-in-one, and first I2S interface and USB all are the next standard audio equipment of ALSA frame in addition, and it is nimble convenient to use, two independent standard audio equipment under the ALSA frame have been made to an audio panel 20, can be under the ALSA frame convenient do the audio processing of complete difference to same audio frequency. In order to realize AFC local sound amplification and howling inhibition and AEC remote interactive echo elimination functions in a smart blackboard or a touch integrated machine, 1 DSP and 1 audio Codec of TI are mainly used for realizing all audio processing functions on the small size of 8cm x 10cm through a special mixed audio processing algorithm, and the intelligent blackboard core board 10 can be matched for data transmission and management while the intelligent blackboard core board operates independently, so that the cost can be controlled, and the occupation of system resources by a pure software algorithm can be avoided.
The core board 10 is configured to selectively transmit the audio obtained through the audio/video processing to the audio processing module 21 and/or the audio coding/decoding processing module 22 according to the received control instruction or the obtained content of the audio/video, and specifically includes that the audio obtained through the audio/video processing is transmitted to the audio processing module 21 according to the control instruction received by the core board 10, for example, when the local class mode is selected according to the touch pad, and when the remote class mode or the local and remote simultaneous class modes are selected, the audio obtained through the audio/video processing is transmitted to the audio processing module 21 and/or the audio coding/decoding processing module 22, the two modules work simultaneously, and the processed data can be correlated and exchanged with each other, thereby greatly improving the efficiency.
The core board 10 may also select a transmission channel of the audio according to the content of the acquired audio and video, the core board 10 needs to restore each audio and video data, wherein the video is displayed in real time, the audio is placed in the cache, the cached audio data needs to be processed in channels, when the number of audio input paths exceeds 2, that is, when multiple people participate in the video interaction at the same time, the audio and video data of the multiple people are packed together, the audio obtained through the audio and video processing is transmitted to the audio processing module 21 and/or the audio coding and decoding processing module 22, the two modules work at the same time, the processed data may also be associated and exchanged, when only local audio and video goes to school, only the audio may be automatically selected to be transmitted to the audio coding and decoding processing module 22.
As shown in fig. 2, the audio/video device further includes an audio/video device, where the audio/video device includes a local audio/video device 30 and a remote audio/video device 40, the core board 10 is connected to the local audio/video device 30 through a third I2S interface and connected to the remote audio/video device 40 through a network, the remote audio/video device 40 sends real-time data to the core board 10 through an RTP protocol, and the remote audio/video device 40 receives the real-time data from the core board 10 through the RTP protocol. The remote interactive application comprises a local audio-video device 30 and a remote audio-video device 40 (there may be a plurality of local audio-video devices 30 and a plurality of remote audio-video devices 40, audio needs to be encoded in the transmission process, the audio encoding format may be AAC/g.711, and the remote audio-video device 40 may be a webcam IPC.
Preferably, the processing of the acquired audio and video includes: audio and video management, audio and video coding and decoding, audio and video storage and video display output and audio and video timestamp processing. It is the processing of video timestamps by the RK3399 that is used to optimize the audio processing for the secondary audio board.
Also included is an analog microphone that is connected to the audio board 20 by an external audio cable.
Furthermore, the audio board 20 further includes a speaker or an external loudspeaker connected to the audio board 20 through a fourth I2S interface, and the audio board 20 includes an audio integration module, where the audio integration module is configured to copy and output audio played by the speaker in left and right channels of the fourth I2S interface, respectively. With respect to stereo and mono problems, since remote interaction is typically mono (including MIC picked-up sound where the teacher speaks), but courseware may have both mono and stereo. In addition, the teaching scene is different from the general scene, and basically requires that students in each corner can clearly hear all contents, and can not cause some contents to be unclear because of sitting beside different sound boxes, so that the stereo and the mono processing are carried out by copying the blocks of the left and right channels of the I2S interface no matter whether the system plays the mono or the stereo, so that the sounds of the two channels of the I2S are consistent, the same sounds are respectively sent to a plurality of sound boxes, and the sounds coming out from each sound box are ensured to be the same. The loudspeaker can be an external device such as a power amplifier and the like which is selected according to actual needs.
The audio panel 20 is configured to receive a mixed audio and video input by the local audio and video device 30 and the far-end audio and video device 40 via a mixed audio processed by the core panel 10, where the mixed audio includes the local audio and the far-end audio, the echo cancellation unit is configured to store the far-end audio in the mixed audio as a reference tone, compare the mixed audio with the reference tone, and delete an audio data packet obtained after deleting an audio in the mixed audio that is the same as the reference tone via the core panel 10 and send the audio data packet to the far-end audio and video device 40 after processing. The far-end audio refers to the audio of the remote interactive opposite end, and comprises far-end speaking sound and far-end courseware sound; the local audio refers to local courseware audio and local speaking sound; the reference audio is set as a far-end audio and is used as a reference sound of an echo suppression algorithm, namely, a sound to be filtered out in a sound collected by an MIC; the audio sent to the far-end, that is, other sounds with reference sounds filtered out from the sounds collected by the MIC are used for encoding and then provided to the far-end audio and video equipment 40 for use; the audio mix includes all audio locally and remotely for encoded recorded storage. The echo cancellation unit realizes an echo cancellation algorithm in the DSP, performs corresponding audio processing after the far-end audio is collected, firstly stores the far-end audio as a reference sound in real time, after a microphone collects mixed audio (including local audio and far-end audio), compares the mixed audio with the reference sound which is just stored according to the reference sound which is just stored, finds that the audio which is the same as the reference sound needs to be removed from the mixed audio, and sends the rest audio to the coding processing to be sent to the far end, so that the far end can not hear the sound which is just speaking by itself, but all the sounds of the opposite end.
The audio and video device includes a main speaker device and an interactive device, the core board 10 has an ALSA unit for digitally mixing multiple audio frequencies in the main speaker device and the interactive device, and the ALSA unit is further configured to simultaneously transmit the multiple audio frequencies to the audio board 20 through a first I2S interface or a USB interface. Regarding the problem of playing multiple audios simultaneously in an interactive manner, when a teacher interacts with a certain class-listening classroom (new requirements require that the teacher can interact with two classes-listening classrooms simultaneously and one interactive classroom is added), how to hear the audio processing problems of the participating interactive classrooms (the maximum possibility is increased to 4) in other class-listening classrooms requires that the audio codes of the lecture classroom and each participating interactive classroom are respectively pulled to play, and a plurality of different audios need to be played simultaneously. The ALSA is provided in the Linux/Android, so that digital audio mixing can be conveniently performed by using the dMIX function in the ALSA, and thus, multiple channels of audio can be simultaneously played through one digital audio interface USB/I2S, and different audio data processed by the audio board 20 can be acquired from the audio board 20 through the first I2S interface or the USB interface as required.
And the howling suppression unit processes the audio data acquired by the audio and video equipment after sound amplification by adopting a DSP howling suppression algorithm to realize howling suppression.
The audio and video equipment comprises at least one of an intelligent terminal, a camera and a PC, and the far-end audio and video equipment 40 comprises at least one of an intelligent terminal, a network camera, a PC and projection equipment.
The embodiment of the invention also provides an intelligent teaching system which comprises the audio and video teaching equipment. The intelligent teaching system can also comprise other equipment related to intelligent teaching, and the equipment is combined with the audio-video teaching equipment or used separately.
The embodiment of the scheme adopts an integrated and miniaturized design, on one hand, the number of devices in the intelligent classroom platform is greatly reduced, the devices are extremely simple under the condition that the functions are not reduced, the desktop space of the platform is reserved for teachers to use, the problems that the intelligent classroom platform has too many devices, the connection is too complex, the stability is poor, the use is inconvenient and the like are solved, a plurality of products such as a frequency shift power amplifier, an audio processor, a sound box and the like are saved, and meanwhile, the connection among the devices can be reduced; the problems of local sound amplification and howling generated by local sound amplification in teacher teaching of the intelligent blackboard or touch all-in-one machine are solved, the teacher can be separated from a old-fashioned frequency shift power amplifier, and the intelligent blackboard or touch all-in-one machine can locally amplify the sound for class; the stability and the quality of sound are greatly improved; the cooperation among all devices is not needed, the operation and the control of the whole system are simple, and the use complexity of the system is greatly reduced; the functions which can be realized only by a plurality of devices in the prior art of the intelligent classroom can be realized on one intelligent blackboard or touch control integrated machine, so that the construction cost of the intelligent classroom is greatly reduced, and the device installation and debugging time of the intelligent classroom is greatly shortened; convenient control also can promote user experience greatly.
The embodiment of the scheme solves the problem that a remote audio and video conference can be built only by a plurality of devices in a smart classroom during remote interactive teaching, and only one smart blackboard or touch all-in-one machine is needed, and no additional audio processing device is needed; the teaching activities are convenient to be recycled, and the function of recording courses in a normalized mode can be realized; the AEC remote interactive echo cancellation function is realized in the intelligent blackboard or the touch all-in-one machine, and the teaching activities of local sound amplification class giving and remote interactive teaching can be supported.
The embodiment of the present disclosure provides two independent audio interfaces I2S and a USB on a single audio board 20, and the two independent audio interfaces I2S and the USB may be respectively hung in the core board 10 as two independent audio devices, the core board 10 may extract audio data from audio and video as needed and select an audio channel according to a received control instruction or acquired content of the audio and video, and simultaneously perform different audio processing on the audio board 20 according to the two independent audio devices, such as sending or acquiring completely different audio data, and the two independent audio interfaces may operate independently of each other and exchange data with each other, and are both related to each other and do not affect each other, and one or two of the two independent audio devices may be selected as needed and also exchange data without affecting each other, thereby saving a processing space of the core board 10 and greatly improving audio and video processing efficiency.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. The utility model provides an audio and video teaching equipment, its is used for wisdom blackboard or touch-control all-in-one, its characterized in that, audio and video teaching equipment includes:
the core board is used for processing the acquired audio and video;
the audio processing module comprises an echo cancellation unit, a howling suppression unit and an automatic gain control processing unit, and the audio coding and decoding processing module comprises an A/D conversion unit, a D/A conversion unit, a filtering unit and a sound mixing processing unit; the audio processing module on the audio board is connected to the core board through a USB interface, and the audio coding and decoding processing module on the audio board is connected to the core board through a first I2S interface and connected to the audio processing module through a second I2S interface; the audio board is hung on the core board as two independent audio devices through a USB interface and a first I2S interface, and the audio board performs audio data internal interaction through a second I2S interface.
The core board is used for selectively transmitting audio data obtained through audio and video processing to the audio processing module and/or the audio coding and decoding processing module through the USB interface and the first I2S interface simultaneously according to the received control instruction or the acquired content of the audio and video.
2. The audio and video teaching device according to claim 1, further comprising an audio and video device, wherein the audio and video device comprises a local audio and video device and a remote audio and video device, the core board is connected to the local audio and video device through a third I2S interface and the remote audio and video device through a network, the remote audio and video device sends real-time data to the core board through an RTP protocol, and the remote audio and video device receives the real-time data from the core board through the RTP protocol.
3. The audio-visual teaching device of claim 1 or 2 wherein the processing of the captured audio-visual comprises: audio and video management, audio and video coding and decoding, audio and video storage and video display output and audio and video timestamp processing.
4. The audio-visual teaching device of claim 1 further comprising an analog microphone connected to the audio pad by an external audio cable.
5. The audio-video teaching device according to claim 4, further comprising a speaker or an external loudspeaker connected to the audio board through a fourth I2S interface, wherein the audio board includes an audio integration module, and the audio integration module is configured to copy and output audio played by the speaker in the left and right channels of the fourth I2S interface, respectively.
6. The audio and video teaching device according to claim 1, wherein the audio board is configured to receive a mixed audio of a mixed audio and video input by the local audio and video device and the remote audio and video device after being processed by the core board, the mixed audio includes a local audio and a remote audio, the echo cancellation unit is configured to store the remote audio in the mixed audio as a reference tone, compare the mixed audio with the reference tone, and send an audio data packet obtained by deleting an audio in the mixed audio that is the same as the reference tone to the remote audio and video device after being processed by the core board.
7. The audio-video teaching device according to claim 2, wherein the audio-video device includes a main speaker device and an interactive device, the core board has an ALSA unit for digitally mixing multiple channels of audio in the main speaker device and the interactive device, and the ALSA unit is further configured to simultaneously transmit the multiple channels of audio to the audio board through a first I2S interface or a USB interface, and to obtain audio data processed by the audio board from the audio board through a first I2S interface or a USB interface.
8. The audio and video teaching device according to claim 2, wherein the howling suppression unit processes audio data collected by the audio and video device after sound amplification by using a DSP howling suppression algorithm to realize howling suppression.
9. The audio-video teaching device according to claim 2, wherein the audio-video device comprises at least one of an intelligent terminal, a camera and a PC, and the remote audio-video device comprises at least one of an intelligent terminal, a network camera, a PC and a projection device.
10. An intelligent tutoring system comprising an audiovisual tutorial device as claimed in any of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010917719.7A CN112071132B (en) | 2020-09-03 | 2020-09-03 | Audio and video teaching equipment and intelligent teaching system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010917719.7A CN112071132B (en) | 2020-09-03 | 2020-09-03 | Audio and video teaching equipment and intelligent teaching system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112071132A true CN112071132A (en) | 2020-12-11 |
| CN112071132B CN112071132B (en) | 2021-08-17 |
Family
ID=73666584
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010917719.7A Active CN112071132B (en) | 2020-09-03 | 2020-09-03 | Audio and video teaching equipment and intelligent teaching system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112071132B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112929731A (en) * | 2021-05-11 | 2021-06-08 | 浙江蓝鸽科技有限公司 | Multimedia switch system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5271057A (en) * | 1991-10-09 | 1993-12-14 | Bell Communications Research, Inc. | Audio processing system for teleconferencing system |
| CN108965996A (en) * | 2018-07-25 | 2018-12-07 | 北京竞业达数码科技股份有限公司 | Real time remote interactive education system |
| CN109979479A (en) * | 2019-04-15 | 2019-07-05 | 苏州麦迪斯顿医疗科技股份有限公司 | A kind of echo removing method, device, equipment and storage medium |
| CN110491221A (en) * | 2019-09-11 | 2019-11-22 | 深圳市浪涛科技有限公司 | A kind of Multifunctional smart education all-in-one machine and its application method |
| CN209845279U (en) * | 2019-03-19 | 2019-12-24 | 北京新锐创通电子科技有限公司 | Audio feedback and noise suppression module based on DSP |
| CN211403645U (en) * | 2019-09-10 | 2020-09-01 | 中电科西北集团有限公司 | Audio and video interaction device |
-
2020
- 2020-09-03 CN CN202010917719.7A patent/CN112071132B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5271057A (en) * | 1991-10-09 | 1993-12-14 | Bell Communications Research, Inc. | Audio processing system for teleconferencing system |
| CN108965996A (en) * | 2018-07-25 | 2018-12-07 | 北京竞业达数码科技股份有限公司 | Real time remote interactive education system |
| CN209845279U (en) * | 2019-03-19 | 2019-12-24 | 北京新锐创通电子科技有限公司 | Audio feedback and noise suppression module based on DSP |
| CN109979479A (en) * | 2019-04-15 | 2019-07-05 | 苏州麦迪斯顿医疗科技股份有限公司 | A kind of echo removing method, device, equipment and storage medium |
| CN211403645U (en) * | 2019-09-10 | 2020-09-01 | 中电科西北集团有限公司 | Audio and video interaction device |
| CN110491221A (en) * | 2019-09-11 | 2019-11-22 | 深圳市浪涛科技有限公司 | A kind of Multifunctional smart education all-in-one machine and its application method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112929731A (en) * | 2021-05-11 | 2021-06-08 | 浙江蓝鸽科技有限公司 | Multimedia switch system |
| CN112929731B (en) * | 2021-05-11 | 2021-07-30 | 浙江蓝鸽科技有限公司 | Multimedia switch system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112071132B (en) | 2021-08-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202838331U (en) | Long-distance synchrony translation system | |
| CN102984496B (en) | The processing method of the audiovisual information in video conference, Apparatus and system | |
| CN102209080A (en) | Terminal system for synchronous teaching or conferences and control method thereof | |
| CN102209230A (en) | Video conference system with main venue control module | |
| EP2574050A1 (en) | Method, apparatus and remote video conference system for playing audio of remote participator | |
| CN110349456A (en) | Intelligence control system, remote control terminal and the classroom terminal of interaction classroom | |
| CN212696104U (en) | Audio and video conference recording and broadcasting system | |
| CN109951673A (en) | A kind of the content interactive system and method for video conference | |
| CN112071132B (en) | Audio and video teaching equipment and intelligent teaching system | |
| CN110570701A (en) | two-way voice interactive teaching system and method for synchronous video | |
| CN201063761Y (en) | Multifunctional video conference system | |
| CN111355918A (en) | Intelligent remote video conference system | |
| CN206402344U (en) | One kind is based on 3D scene Video Conference Systems | |
| CN211509180U (en) | Multifunctional audio and video processing equipment | |
| CN210466804U (en) | Remote interactive education system | |
| CN214851543U (en) | Recording and broadcasting equipment | |
| CN112788489B (en) | Control method and device and electronic equipment | |
| CN210804824U (en) | Remote interactive teaching system with synchronous blackboard writing and live broadcasting functions | |
| CN1215961A (en) | Electronic meeting multimedia control system | |
| CN211015980U (en) | Multimedia classroom teaching auxiliary system | |
| CN216122672U (en) | Conference system and remote conference platform | |
| JPH02288540A (en) | Remote lecture communication system | |
| KR101594431B1 (en) | Total broadcast combination system for constructing smart schoolrooms | |
| CN214851827U (en) | Public address system who uses on equipment is led to class | |
| CN215219956U (en) | Interactive classroom screen projection device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |