CN112687133A - Audio adjusting method and system for online classroom - Google Patents
Audio adjusting method and system for online classroom Download PDFInfo
- Publication number
- CN112687133A CN112687133A CN202011623275.2A CN202011623275A CN112687133A CN 112687133 A CN112687133 A CN 112687133A CN 202011623275 A CN202011623275 A CN 202011623275A CN 112687133 A CN112687133 A CN 112687133A
- Authority
- CN
- China
- Prior art keywords
- classroom
- sound data
- answering
- microphone sound
- listening
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000001914 filtration Methods 0.000 claims abstract description 21
- 230000002159 abnormal effect Effects 0.000 claims abstract description 13
- 238000012544 monitoring process Methods 0.000 claims abstract description 7
- 230000000007 visual effect Effects 0.000 claims description 8
- 230000006399 behavior Effects 0.000 claims description 6
- 230000003247 decreasing effect Effects 0.000 claims description 6
- 230000003750 conditioning effect Effects 0.000 claims description 5
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
An audio adjusting method and system for an online classroom comprises a lecturing classroom and a plurality of answering classrooms, wherein the lecturing classroom comprises a teacher terminal, and the answering classroom comprises a plurality of student terminals; the method comprises the following steps: collecting microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms, and collecting video streams of monitoring pictures of a main lecture and each answering classroom in real time through an IPC camera; calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time, and automatically gaining according to the decibels specified by the server; and analyzing the video stream to judge the classroom condition of each listening classroom, and filtering out the microphone sound data of the corresponding listening classroom for the listening classroom with abnormal classroom condition. According to the invention, on one hand, the sound decibels are automatically gained, so that the sound heard by a teacher and a receiving classroom is consistent, and on the other hand, the sound irrelevant to classroom teaching is filtered by collecting videos for analysis, so that the teaching quality is improved.
Description
Technical Field
The invention relates to the field of online teaching, in particular to an online classroom audio adjusting method and system.
Background
With the popularization of the internet, the mode of network remote education is more and more accepted by the public, and the mode becomes one of the important supplementary forms of the conventional daily education, and a large number of remote teaching platforms are appeared. After the remote teaching platform has been developed for more than ten years, the functions of all aspects are relatively perfect at present, and the remote teaching platform plays a core role in schools, education institutions and training institutions. The online classroom includes the classroom of talkbacking and a plurality of classroom of answering, and the classroom of talkbacking includes teacher's terminal, answers the classroom and includes a plurality of student terminals, and teacher's terminal passes through the server interconnection with a plurality of microphone sound data who answers the student terminal in classroom, and every student main part and the words that teacher's main part said promptly, other terminals can both hear, have sound big difference to and unnecessary sound influences the quality of teaching.
Disclosure of Invention
In view of the technical defects and technical drawbacks in the prior art, embodiments of the present invention provide an online classroom audio adjusting method and system that overcome the above problems or at least partially solve the above problems, and the specific scheme is as follows:
as a first aspect of the present invention, there is provided an audio adjusting method for an online classroom, comprising a lecture room including a teacher terminal and a plurality of answer classroom including a plurality of student terminals, the teacher terminal being interconnected with microphone sound data of the plurality of student terminals in the answer classroom through a server; the method comprises the following steps:
collecting microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms, and collecting video streams of monitoring pictures of a main lecture and each answering classroom in real time through an IPC camera;
calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time, and automatically gaining according to the decibels specified by the server;
and analyzing the video stream to judge the classroom condition of each listening classroom, and filtering out the microphone sound data of the corresponding listening classroom for the listening classroom with abnormal classroom condition.
Further, the step of analyzing the video stream to determine the class of each listening classroom, and for the listening classroom with abnormal class conditions, the step of filtering out the microphone sound data corresponding to the listening classroom specifically includes: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and filtering out the microphone sound data of the corresponding answering classroom if the situations exist.
Further, the automatic gain in decibels specified by the server specifically includes: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Further, the method further comprises: and acquiring visual focus areas of the student main body and the teacher main body in the current frame image in real time through the video stream, and determining whether the sound data of the microphones of the terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas.
As a second aspect of the present invention, there is provided an audio conditioning system for an online classroom, the system comprising a lecture classroom including a teacher terminal and a plurality of answer classrooms including a plurality of student terminals, the teacher terminal being interconnected with microphone sound data of the student terminals of the plurality of answer classrooms through a server; the server comprises a data acquisition unit, a gain adjustment unit and a video analysis unit;
the data acquisition unit is used for acquiring microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms and acquiring video streams of monitoring pictures of a lecture hall and each answering classroom in real time through an IPC camera;
the gain adjusting unit is used for calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time and automatically gaining the collected microphone sound data according to the decibels specified by the server;
the video analysis unit is used for analyzing the video stream, judging the classroom conditions of each receiving classroom, and filtering the microphone sound data of the corresponding receiving classroom for the receiving classroom with abnormal classroom conditions.
Further, the step of analyzing the video stream to determine the class of each listening classroom, and for the listening classroom with abnormal class conditions, the step of filtering out the microphone sound data corresponding to the listening classroom specifically includes: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and filtering out the microphone sound data of the corresponding answering classroom if the situations exist.
Further, the automatic gain in decibels specified by the server specifically includes: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Further, the video analysis unit is further configured to: and acquiring visual focus areas of the student main body and the teacher main body in the current frame image in real time through the video stream, and determining whether the sound data of the microphones of the terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas.
The invention has the following beneficial effects:
according to the audio adjusting method and system for the online classroom, the decibel of the collected sound is calculated in real time, and the decibel specified by the server is used for automatic gain, so that the sound heard by a teacher and a listening classroom are the same, and the condition that some sound is particularly big and some sound is particularly small and cannot be heard is avoided; in addition, still carry out the analysis through gathering the video, judge whether need to filter the microphone sound data of listening the classroom or the terminal that student's subject and teacher's subject correspond, filter out the sound irrelevant with classroom teaching to promote the teaching quality.
Drawings
Fig. 1 is a flowchart illustrating an audio adjusting method for an online classroom according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, as a first embodiment of the present invention, there is provided an audio adjusting method for an online classroom, including a lecture classroom including a teacher terminal and a plurality of answer classroom including a plurality of student terminals, the teacher terminal being interconnected with microphone audio data of the student terminals of the plurality of answer classroom through a server; the method comprises the following steps:
collecting microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms, and collecting video streams of monitoring pictures of a main lecture and each answering classroom in real time through an IPC camera;
calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time, and automatically gaining according to the decibels specified by the server;
and analyzing the video stream to judge the classroom condition of each listening classroom, and filtering out the microphone sound data of the corresponding listening classroom for the listening classroom with abnormal classroom condition.
According to the audio adjusting method and system for the online classroom, the decibel of the collected sound is calculated in real time, and the decibel specified by the server is used for automatic gain, so that the sound heard by a teacher and a listening classroom are the same, and the condition that some sound is particularly big and some sound is particularly small and cannot be heard is avoided; in addition, still carry out the analysis through gathering the video, judge whether need to filter the microphone sound data of listening the classroom or the terminal that student's subject and teacher's subject correspond, filter out the sound irrelevant with classroom teaching to promote the teaching quality.
The method comprises the following steps of analyzing video streams, judging the classroom of each listening classroom, and filtering microphone sound data corresponding to the listening classroom for the listening classroom with abnormal classroom conditions: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and if so, filtering out the microphone sound data of the corresponding answering classroom, thereby avoiding the interference of the microphone sound data on teaching of the main lecture classroom or learning of other answering classrooms.
The specific automatic gain in decibels specified by the server is as follows: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Wherein the method further comprises: the method comprises the steps of obtaining visual focus areas of a student main body and a teacher main body in a current frame image in real time through the video stream, determining whether microphone sound data of terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas, and filtering the sound to avoid the interference of the sound with normal teaching if the visual focus areas of the student main body and the teacher main body are in non-student terminal or teacher terminal areas, wherein the sound may be a sound chatting with others but not teaching sound.
As a second embodiment of the present invention, there is provided an audio conditioning system for an online classroom, the system including a lecture room including a teacher terminal and a plurality of answer classroom including a plurality of student terminals, the teacher terminal being interconnected with microphone sound data of the student terminals of the plurality of answer classroom through a server; the server comprises a data acquisition unit, a gain adjustment unit and a video analysis unit;
the data acquisition unit is used for acquiring microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms and acquiring video streams of monitoring pictures of a lecture hall and each answering classroom in real time through an IPC camera;
the gain adjusting unit is used for calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time and automatically gaining the collected microphone sound data according to the decibels specified by the server;
the video analysis unit is used for analyzing the video stream, judging the classroom conditions of each receiving classroom, and filtering the microphone sound data of the corresponding receiving classroom for the receiving classroom with abnormal classroom conditions.
Preferably, the step of analyzing the video stream to determine the class of each listening classroom, and the step of filtering out the microphone sound data corresponding to the listening classroom for the listening classroom with abnormal class conditions specifically includes: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and if so, filtering out the microphone sound data of the corresponding answering classroom, thereby avoiding the interference of the microphone sound data on teaching of the main lecture classroom or learning of other answering classrooms.
Preferably, the automatic gain in decibels specified by the server specifically includes: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Preferably, the video analysis unit is further configured to: the method comprises the steps of obtaining visual focus areas of a student main body and a teacher main body in a current frame image in real time through the video stream, determining whether microphone sound data of terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas, and filtering the sound to avoid the interference of the sound with normal teaching if the visual focus areas of the student main body and the teacher main body are in non-student terminal or teacher terminal areas, wherein the sound may be a sound chatting with others but not teaching sound.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (8)
1. The audio adjusting method for the online classroom is characterized by comprising a lecturing classroom and a plurality of answering classrooms, wherein the lecturing classroom comprises a teacher terminal, the answering classroom comprises a plurality of student terminals, and the teacher terminal is interconnected with microphone audio data of the student terminals of the plurality of answering classrooms through a server; the method comprises the following steps:
collecting microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms, and collecting video streams of monitoring pictures of a main lecture and each answering classroom in real time through an IPC camera;
calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time, and automatically gaining according to the decibels specified by the server;
and analyzing the video stream to judge the classroom condition of each listening classroom, and filtering out the microphone sound data of the corresponding listening classroom for the listening classroom with abnormal classroom condition.
2. The method for adjusting audio in an online classroom as recited in claim 1, wherein the classroom of each listening classroom is determined by analyzing the video stream, and for a listening classroom with abnormal classroom conditions, the filtering of the microphone audio data corresponding to the listening classroom specifically comprises: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and filtering out the microphone sound data of the corresponding answering classroom if the situations exist.
3. The method of claim 1, wherein the automatic gain in decibels specified by the server is specifically: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
4. The method for audio conditioning in an online classroom according to claim 1 wherein said method further comprises: and acquiring visual focus areas of the student main body and the teacher main body in the current frame image in real time through the video stream, and determining whether the sound data of the microphones of the terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas.
5. The audio adjusting system for the online classroom is characterized by comprising a lecturing classroom and a plurality of answering classrooms, wherein the lecturing classroom comprises a teacher terminal, the answering classroom comprises a plurality of student terminals, and the teacher terminal is interconnected with microphone sound data of the student terminals of the answering classrooms through a server; the server comprises a data acquisition unit, a gain adjustment unit and a video analysis unit;
the data acquisition unit is used for acquiring microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms and acquiring video streams of monitoring pictures of a lecture hall and each answering classroom in real time through an IPC camera;
the gain adjusting unit is used for calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time and automatically gaining the collected microphone sound data according to the decibels specified by the server;
the video analysis unit is used for analyzing the video stream, judging the classroom conditions of each receiving classroom, and filtering the microphone sound data of the corresponding receiving classroom for the receiving classroom with abnormal classroom conditions.
6. The system for adjusting audio in online classroom according to claim 5, wherein said analyzing the video stream to determine the classroom of each listening classroom, and for listening classrooms with abnormal classroom conditions, the filtering of the microphone audio data corresponding to the listening classroom is specifically: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and filtering out the microphone sound data of the corresponding answering classroom if the situations exist.
7. The on-line classroom audio conditioning system of claim 5, wherein the server-specified decibel gain for automatic gain is specifically: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
8. The audio conditioning system for online classrooms of claim 5, wherein the video analysis unit is further configured to: and acquiring visual focus areas of the student main body and the teacher main body in the current frame image in real time through the video stream, and determining whether the sound data of the microphones of the terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011623275.2A CN112687133A (en) | 2020-12-30 | 2020-12-30 | Audio adjusting method and system for online classroom |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011623275.2A CN112687133A (en) | 2020-12-30 | 2020-12-30 | Audio adjusting method and system for online classroom |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112687133A true CN112687133A (en) | 2021-04-20 |
Family
ID=75453973
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011623275.2A Pending CN112687133A (en) | 2020-12-30 | 2020-12-30 | Audio adjusting method and system for online classroom |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112687133A (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883164A (en) * | 2010-06-29 | 2010-11-10 | 瑞声声学科技(深圳)有限公司 | Adaptive volume gain device and method |
| KR20110095533A (en) * | 2010-02-19 | 2011-08-25 | 모빌토크(주) | Method for education using robot and display device |
| US20140162238A1 (en) * | 2012-12-11 | 2014-06-12 | Fluidity Software, Inc. | Computerized system and method for teaching, learning, and assessing the knowledge of stem principles |
| CN106161781A (en) * | 2016-06-22 | 2016-11-23 | 北京小米移动软件有限公司 | Method for regulation of sound volume and device |
| CN108766074A (en) * | 2018-05-28 | 2018-11-06 | 阔地教育科技有限公司 | Remote audio-video interaction is given lessons implementation method, equipment and terminal |
| CN109035089A (en) * | 2018-07-25 | 2018-12-18 | 重庆科技学院 | A kind of Online class atmosphere assessment system and method |
| CN109117731A (en) * | 2018-07-13 | 2019-01-01 | 华中师范大学 | A kind of classroom instruction cognitive load measuring system |
| CN109922315A (en) * | 2019-03-01 | 2019-06-21 | 西安电子科技大学 | A kind of real-time video behavior analysis method based on Spark and OpenCV |
| CN110349456A (en) * | 2019-07-12 | 2019-10-18 | 阔地教育科技有限公司 | Intelligence control system, remote control terminal and the classroom terminal of interaction classroom |
| CN110392301A (en) * | 2019-07-05 | 2019-10-29 | 湖北盟道信息科技有限公司 | A kind of method and system of more student side audio automatic mutes |
| CN211578106U (en) * | 2020-03-31 | 2020-09-25 | 北京文香信息技术有限公司 | Remote teaching system and platform based on mobile internet |
| CN112073668A (en) * | 2020-08-25 | 2020-12-11 | 恒峰信息技术有限公司 | Remote classroom interaction method, system, device and storage medium |
-
2020
- 2020-12-30 CN CN202011623275.2A patent/CN112687133A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20110095533A (en) * | 2010-02-19 | 2011-08-25 | 모빌토크(주) | Method for education using robot and display device |
| CN101883164A (en) * | 2010-06-29 | 2010-11-10 | 瑞声声学科技(深圳)有限公司 | Adaptive volume gain device and method |
| US20140162238A1 (en) * | 2012-12-11 | 2014-06-12 | Fluidity Software, Inc. | Computerized system and method for teaching, learning, and assessing the knowledge of stem principles |
| CN106161781A (en) * | 2016-06-22 | 2016-11-23 | 北京小米移动软件有限公司 | Method for regulation of sound volume and device |
| CN108766074A (en) * | 2018-05-28 | 2018-11-06 | 阔地教育科技有限公司 | Remote audio-video interaction is given lessons implementation method, equipment and terminal |
| CN109117731A (en) * | 2018-07-13 | 2019-01-01 | 华中师范大学 | A kind of classroom instruction cognitive load measuring system |
| CN109035089A (en) * | 2018-07-25 | 2018-12-18 | 重庆科技学院 | A kind of Online class atmosphere assessment system and method |
| CN109922315A (en) * | 2019-03-01 | 2019-06-21 | 西安电子科技大学 | A kind of real-time video behavior analysis method based on Spark and OpenCV |
| CN110392301A (en) * | 2019-07-05 | 2019-10-29 | 湖北盟道信息科技有限公司 | A kind of method and system of more student side audio automatic mutes |
| CN110349456A (en) * | 2019-07-12 | 2019-10-18 | 阔地教育科技有限公司 | Intelligence control system, remote control terminal and the classroom terminal of interaction classroom |
| CN211578106U (en) * | 2020-03-31 | 2020-09-25 | 北京文香信息技术有限公司 | Remote teaching system and platform based on mobile internet |
| CN112073668A (en) * | 2020-08-25 | 2020-12-11 | 恒峰信息技术有限公司 | Remote classroom interaction method, system, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108777087B (en) | Remote education system based on cloud server | |
| EP2814244A1 (en) | A method and a system for improving communication quality of a video conference | |
| CN114422820A (en) | Education interactive live broadcast system and live broadcast method | |
| CN115170369A (en) | Live course online watching intelligent management system based on mobile internet | |
| CN104992478A (en) | Method for providing student attendance status | |
| Mendel et al. | Speech perception benefits from sound field FM amplification | |
| CN113781853A (en) | Teacher-student remote interactive education platform based on terminal | |
| CN111970471B (en) | Conference participant scoring method, device, equipment and medium based on video conference | |
| Massie et al. | The impact of sound-field amplification in mainstream cross-cultural classrooms: Part 1 Educational outcomes | |
| CN112687133A (en) | Audio adjusting method and system for online classroom | |
| Simonsen et al. | Great expectations: Perspectives on cochlear implantation of deaf children in Norway | |
| CN114512041B (en) | Teaching behavior big data analysis device based on panoramic shooting | |
| Massie et al. | The impact of sound-field amplification in mainstream cross-cultural classrooms: Part 2 Teacher and child opinions | |
| Lewis et al. | Assessment of advanced hearing instrument and FM technology | |
| CN111507873A (en) | Classroom participation degree evaluation method based on sound and image joint sampling | |
| CN110602450A (en) | Monitoring method, system thereof and computer readable storage medium | |
| CN110968138B (en) | Information interaction method based on control system | |
| Easterbrooks | Educating Children Who Are Deaf or Hard of Hearing: Overview. ERIC Digest# E549. | |
| CN117591058B (en) | Display method, device and storage medium for multi-person speech | |
| CN113037958A (en) | Method and system for analyzing class-taking behaviors of students based on openCv | |
| Cameron et al. | Spatial hearing deficits as a major cause of auditory processing disorders: Diagnosis with the LISN-S and management options | |
| Jeong et al. | Room acoustic conditions of schools, a church, and a residential premise for hearing impaired people | |
| CN116483309A (en) | Integrated broadcaster control management system of teaching | |
| Bielski et al. | Trained Listeners Assessing the xHE-AAC Codec Performance for Streaming Audio-for-Video Broadcast | |
| CN113808447A (en) | Network teaching method and system based on AI analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210420 |
|
| RJ01 | Rejection of invention patent application after publication |