CN112261331A - Recording and broadcasting system supporting intelligent AI teaching analysis - Google Patents
Recording and broadcasting system supporting intelligent AI teaching analysis Download PDFInfo
- Publication number
- CN112261331A CN112261331A CN202010950298.8A CN202010950298A CN112261331A CN 112261331 A CN112261331 A CN 112261331A CN 202010950298 A CN202010950298 A CN 202010950298A CN 112261331 A CN112261331 A CN 112261331A
- Authority
- CN
- China
- Prior art keywords
- video
- special
- processor
- audio
- recording
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 40
- 230000005236 sound signal Effects 0.000 claims abstract description 10
- 230000001629 suppression Effects 0.000 claims abstract description 10
- 241001672694 Citrus reticulata Species 0.000 claims description 2
- 230000003993 interaction Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 claims description 2
- 238000003032 molecular docking Methods 0.000 claims description 2
- 238000005034 decoration Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000003707 image sharpening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
Abstract
The invention discloses a recording and broadcasting system supporting intelligent AI teaching analysis, which comprises a special media processor, a plurality of video acquisition modules, a voice acquisition module and a special AI processor, wherein the plurality of video acquisition modules transmit multi-path SDI or HDMI/VGA signals to the special media processor after acquiring and decoding the signals; the voice acquisition module amplifies, de-noizes and filters the acquired MIC signal and transmits the audio signal to the special media processor; the special media processor comprises a video acquisition module, an audio noise reduction echo suppression module and a video processing module; the special AI processor is connected with the special media processor through a network and is used for carrying out intelligent AI identification on the audio and video signals processed by the special media processor, including face identification, behavior analysis and voice identification. The recording and broadcasting system can rapidly enable the common camera and the recording and broadcasting machine to seamlessly support AI teaching analysis under the condition of not damaging the existing decoration environment and equipment.
Description
Technical Field
The invention relates to the technical field of audio and video intelligent analysis, in particular to a recording and broadcasting system supporting intelligent AI teaching analysis.
Background
In a traditional recording and broadcasting system, the system generally comprises a recording and broadcasting machine, a plurality of cameras and audio and video acquisition equipment, and the audio and video acquisition and recording are completed through the equipment. The recorded audio and video is used for review and self-checking, but a large amount of audio and video files may be generated due to long recording period and many recording times, the files not only increase high storage cost, but also bring troubles to users, so that the users need to spend a large amount of time to find the video files wanted by themselves, whether the contents in the video files are valuable can be confirmed only by the users playing and watching, and the wanted contents cannot be accurately positioned.
Disclosure of Invention
The invention aims to provide a recording and broadcasting system supporting intelligent AI teaching analysis, which can quickly and conveniently enable a common camera and a recording and broadcasting machine to seamlessly support AI teaching analysis under the condition of not damaging the existing decoration environment and equipment.
The purpose of the invention is realized by the following technical scheme:
the utility model provides a support recorded broadcast system of intelligent AI teaching analysis, the system includes special media treater, a plurality of video acquisition module, pronunciation collection module, special AI treater, wherein:
the plurality of video acquisition modules transmit the multi-path SDI or HDMI/VGA signals to the special media processor after acquiring and decoding the signals; the multi-path SDI or HDMI/VGA signal comprises a teacher image and a student image;
the voice acquisition module amplifies, de-noizes and filters the acquired MIC signal and transmits an audio signal to the special media processor;
the special media processor comprises a video acquisition module, an audio noise reduction echo suppression module and a video processing module, wherein:
the video acquisition module is used for being butted with a plurality of external video acquisition modules and receiving video signals transmitted by the plurality of external video acquisition modules;
the audio noise reduction echo suppression module is used for being butted with an external voice acquisition module, receiving an audio signal transmitted by the external voice acquisition module, and performing noise reduction and echo cancellation processing on the received audio signal;
the video processing module is connected with the video acquisition module and the audio noise reduction echo suppression module and is used for integrating and processing transmitted audio and video signals;
the special AI processor is connected with the special media processor through a network and is used for carrying out intelligent AI identification on the audio and video signals processed by the special media processor, including face identification, behavior analysis and voice identification.
According to the technical scheme provided by the invention, the recording and broadcasting system can quickly and conveniently enable a common camera and a recording and broadcasting machine to seamlessly support AI teaching analysis under the condition of not damaging the existing decoration environment and equipment, and the flexibility and the efficiency of the system are improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is a schematic overall structural diagram of a recording and broadcasting system supporting intelligent AI teaching analysis according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a recording and broadcasting system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
The following will further describe the embodiment of the present invention in detail with reference to the accompanying drawings, and as shown in fig. 1, is a schematic overall structure diagram of a recording and broadcasting system supporting intelligent AI teaching analysis provided in the embodiment of the present invention, where the system includes a dedicated media processor, a plurality of video acquisition modules, a voice acquisition module, and a dedicated AI processor, where:
the plurality of video acquisition modules transmit the multi-path SDI or HDMI/VGA signals to the special media processor after acquiring and decoding the signals; the multi-path SDI or HDMI/VGA signal comprises a teacher image and a student image;
the voice acquisition module amplifies, de-noizes and filters the acquired MIC signal and transmits an audio signal to the special media processor;
the special media processor comprises a video acquisition module, an audio noise reduction echo suppression module and a video processing module, wherein:
the video acquisition module is used for being butted with a plurality of external video acquisition modules and receiving video signals transmitted by the plurality of external video acquisition modules;
the audio noise reduction echo suppression module is used for being butted with an external voice acquisition module, receiving an audio signal transmitted by the external voice acquisition module, and performing noise reduction and echo cancellation processing on the received audio signal;
the video processing module is connected with the video acquisition module and the audio noise reduction echo suppression module and is used for integrating and processing transmitted audio and video signals;
the special AI processor is connected with the special media processor through a network and is used for carrying out intelligent AI identification on the audio and video signals processed by the special media processor, including face identification, behavior analysis and voice identification.
In specific implementation, the plurality of video acquisition modules are implemented by a teacher manually operating a camera, or a terminal device automatically tracks the teacher and students to acquire videos.
The special AI processor and the special media processor simultaneously support PCIEx2 and 1G network connection, perform original data interaction through PCIE, and access the internal service of the special AI processor and the encoded audio/video data through the network.
In addition, the behavior analysis performed by the dedicated AI processor includes, but is not limited to: target positioning, standing, back sitting, lying desk and skeleton identification;
speech recognition performed includes, but is not limited to: mandarin, english, dialect, ethnic minority languages.
In the specific implementation, the process of performing intelligent AI identification on the audio/video signal processed by the special media processor by the special AI processor is specifically as follows:
the special AI processor acquires the audio and video signals processed by the special media processor and an AI analysis database; the AI analysis database comprises trained data samples; and comparing the acquired audio and video signals with the data samples in the AI analysis database to form effective analysis data, including face recognition, behavior analysis, voice recognition, OCR recognition and the like.
The result of the special AI processor after intelligent AI identification can be checked in real time in a remote mode, and an interface is provided to support recorded and broadcasted live video and platform docking.
For example, as shown in fig. 2, the recording and playing system according to the example of the present invention is structurally schematic, and the system is optimized based on the normalized recording and playing, and replaces a CPU with a dedicated media processor, so as to fully support the service of the normalized recording and playing in terms of service function, that is, by implementing necessary video processing such as front-end video acquisition, conversion, image sharpening, denoising, enhancement, scaling, etc., the image is clearer, more transparent, and smoother than the image in the ordinary recording and playing.
After the collected video data of teachers and students are completely processed, compression coding of H264/H265 is carried out, video recording is carried out on a main code stream, review is realized, and live network broadcasting is carried out on an auxiliary code stream for the students to watch in real time;
the recording and broadcasting system is internally provided with a special AI processor, the inside of the recording and broadcasting system is connected with a special media processor through a gigabit network and PCIE, and the special media processor transmits original data YUV to the special AI processor through the PCIE; then the special AI processor acquires a video and AI analysis database, compares the acquired real-time video with data samples in the trained AI analysis database to form effective analysis data, including face recognition, behavior recognition, voice recognition, OCR recognition and the like;
then the processing result is returned to the special media processor through the network, or the operator accesses the local machine through the outside to watch the analysis result in real time.
It is noted that those skilled in the art will recognize that embodiments of the present invention are not described in detail herein.
In summary, the system according to the embodiment of the present invention can quickly and conveniently update the conventional recording and broadcasting system without damaging the existing decoration environment and equipment, so that the conventional recording and broadcasting system has an AI teaching analysis function, and the AI analysis function of the conventional recording and broadcasting system is enabled to solve the problems of mass resource storage and mass resource accurate positioning, thereby implementing AI service education.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (6)
1. The utility model provides a support recorded broadcast system of intelligent AI teaching analysis which characterized in that, the system includes special media treater, a plurality of video acquisition module, pronunciation collection module, special AI treater, wherein:
the plurality of video acquisition modules transmit the multi-path SDI or HDMI/VGA signals to the special media processor after acquiring and decoding the signals; the multi-path SDI or HDMI/VGA signal comprises a teacher image and a student image;
the voice acquisition module amplifies, de-noizes and filters the acquired MIC signal and transmits an audio signal to the special media processor;
the special media processor comprises a video acquisition module, an audio noise reduction echo suppression module and a video processing module, wherein:
the video acquisition module is used for being butted with a plurality of external video acquisition modules and receiving video signals transmitted by the plurality of external video acquisition modules;
the audio noise reduction echo suppression module is used for being butted with an external voice acquisition module, receiving an audio signal transmitted by the external voice acquisition module, and performing noise reduction and echo cancellation processing on the received audio signal;
the video processing module is connected with the video acquisition module and the audio noise reduction echo suppression module and is used for integrating and processing transmitted audio and video signals;
the special AI processor is connected with the special media processor through a network and is used for carrying out intelligent AI identification on the audio and video signals processed by the special media processor, including face identification, behavior analysis and voice identification.
2. The recording and broadcasting system supporting intelligent AI teaching analysis according to claim 1, wherein the plurality of video capture modules are implemented by teachers manually operating cameras or by terminal devices automatically tracking teachers and students for video capture.
3. The recording and broadcasting system supporting intelligent AI instructional analysis of claim 1,
the special AI processor and the special media processor simultaneously support PCIEx2 and 1G network connection, perform original data interaction through PCIE, and access the internal service of the special AI processor and the encoded audio/video data through the network.
4. The recording and broadcasting system supporting intelligent AI instructional analysis of claim 1,
the behavior analysis performed by the dedicated AI processor includes: target positioning, standing, back sitting, lying desk and skeleton identification;
the speech recognition performed includes: mandarin, english, dialect, ethnic minority languages.
5. The recording and broadcasting system supporting intelligent AI instructional analysis according to claim 1, wherein the results of the dedicated AI processor after performing intelligent AI identification can be viewed remotely in real time and an interface is provided to support recorded and broadcasted live video and platform docking.
6. The recording and broadcasting system supporting intelligent AI teaching analysis according to claim 1 or 5, wherein the process of the dedicated AI processor performing intelligent AI recognition on the audio/video signals processed by the dedicated media processor is specifically:
the special AI processor acquires the audio and video signals processed by the special media processor and an AI analysis database; the AI analysis database comprises trained data samples;
and comparing the acquired audio and video signals with the data samples in the AI analysis database to form effective analysis data, including face recognition, behavior analysis, voice recognition and OCR recognition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010950298.8A CN112261331A (en) | 2020-09-10 | 2020-09-10 | Recording and broadcasting system supporting intelligent AI teaching analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010950298.8A CN112261331A (en) | 2020-09-10 | 2020-09-10 | Recording and broadcasting system supporting intelligent AI teaching analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112261331A true CN112261331A (en) | 2021-01-22 |
Family
ID=74232054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010950298.8A Pending CN112261331A (en) | 2020-09-10 | 2020-09-10 | Recording and broadcasting system supporting intelligent AI teaching analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112261331A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113905208A (en) * | 2021-09-06 | 2022-01-07 | 北京天玛智控科技股份有限公司 | External-hanging multifunctional terminal of camera and terminal application system |
| CN116188950A (en) * | 2023-04-28 | 2023-05-30 | 广东智迈汇数字科技股份有限公司 | Video interactive teaching system based on artificial intelligence |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201255932Y (en) * | 2008-08-27 | 2009-06-10 | 南京高盛信息产业有限公司 | Full automatic intelligent teaching writing/playing system |
| CN105139702A (en) * | 2015-10-14 | 2015-12-09 | 广州天莱软件科技有限公司 | Recording and broadcasting system used for teaching and use method thereof |
| CN205016086U (en) * | 2015-09-22 | 2016-02-03 | 杭州海康威视系统技术有限公司 | Intelligent tutoring recorded broadcast system |
| CN205693771U (en) * | 2016-06-15 | 2016-11-16 | 惠州紫旭科技有限公司 | A kind of integrated full-automatic teaching recorded broadcast device |
| CN107146177A (en) * | 2017-04-21 | 2017-09-08 | 阔地教育科技有限公司 | A kind of tutoring system and method based on artificial intelligence technology |
| CN107958351A (en) * | 2017-12-26 | 2018-04-24 | 重庆大争科技有限公司 | Teaching quality assessment cloud service platform |
| CN208257968U (en) * | 2018-05-10 | 2018-12-18 | 潍坊核变文化传播有限公司 | A kind of Classic Course intelligence recording and broadcasting system |
| CN109359613A (en) * | 2018-10-29 | 2019-02-19 | 四川文轩教育科技有限公司 | A kind of teaching process analysis method based on artificial intelligence |
| CN109523848A (en) * | 2018-12-12 | 2019-03-26 | 珠海城市职业技术学院 | Artificial intelligence technology instructional device |
| CN110853436A (en) * | 2019-12-11 | 2020-02-28 | 北京中庆现代技术股份有限公司 | Same-frequency interactive classroom control device |
| CN111311981A (en) * | 2018-12-12 | 2020-06-19 | 范例 | Intelligent classroom that multidata supported |
| CN111627271A (en) * | 2020-04-10 | 2020-09-04 | 北京文香信息技术有限公司 | Synchronous classroom system and management platform thereof |
-
2020
- 2020-09-10 CN CN202010950298.8A patent/CN112261331A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201255932Y (en) * | 2008-08-27 | 2009-06-10 | 南京高盛信息产业有限公司 | Full automatic intelligent teaching writing/playing system |
| CN205016086U (en) * | 2015-09-22 | 2016-02-03 | 杭州海康威视系统技术有限公司 | Intelligent tutoring recorded broadcast system |
| CN105139702A (en) * | 2015-10-14 | 2015-12-09 | 广州天莱软件科技有限公司 | Recording and broadcasting system used for teaching and use method thereof |
| CN205693771U (en) * | 2016-06-15 | 2016-11-16 | 惠州紫旭科技有限公司 | A kind of integrated full-automatic teaching recorded broadcast device |
| CN107146177A (en) * | 2017-04-21 | 2017-09-08 | 阔地教育科技有限公司 | A kind of tutoring system and method based on artificial intelligence technology |
| CN107958351A (en) * | 2017-12-26 | 2018-04-24 | 重庆大争科技有限公司 | Teaching quality assessment cloud service platform |
| CN208257968U (en) * | 2018-05-10 | 2018-12-18 | 潍坊核变文化传播有限公司 | A kind of Classic Course intelligence recording and broadcasting system |
| CN109359613A (en) * | 2018-10-29 | 2019-02-19 | 四川文轩教育科技有限公司 | A kind of teaching process analysis method based on artificial intelligence |
| CN109523848A (en) * | 2018-12-12 | 2019-03-26 | 珠海城市职业技术学院 | Artificial intelligence technology instructional device |
| CN111311981A (en) * | 2018-12-12 | 2020-06-19 | 范例 | Intelligent classroom that multidata supported |
| CN110853436A (en) * | 2019-12-11 | 2020-02-28 | 北京中庆现代技术股份有限公司 | Same-frequency interactive classroom control device |
| CN111627271A (en) * | 2020-04-10 | 2020-09-04 | 北京文香信息技术有限公司 | Synchronous classroom system and management platform thereof |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113905208A (en) * | 2021-09-06 | 2022-01-07 | 北京天玛智控科技股份有限公司 | External-hanging multifunctional terminal of camera and terminal application system |
| CN116188950A (en) * | 2023-04-28 | 2023-05-30 | 广东智迈汇数字科技股份有限公司 | Video interactive teaching system based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108012173B (en) | Content identification method, device, equipment and computer storage medium | |
| CN112261331A (en) | Recording and broadcasting system supporting intelligent AI teaching analysis | |
| CN109147444B (en) | Learning condition feedback method and intelligent desk lamp | |
| Sangwan et al. | 'houston, we have a solution': using NASA apollo program to advance speech and language processing technology. | |
| CN109729429B (en) | Video playing method, device, equipment and medium | |
| CN109842795A (en) | Audio-visual synchronization performance test methods, device, electronic equipment, storage medium | |
| US20170330472A1 (en) | Wireless on-site teaching system | |
| CN110427977B (en) | Detection method for classroom interaction behavior | |
| CN108965746A (en) | Image synthesizing method and system | |
| CN104580837A (en) | Video director engine based on GPU+CPU+IO architecture and using method thereof | |
| CN114071059A (en) | Intelligent wireless video conference system for building construction management | |
| CN109858005B (en) | Method, device, equipment and storage medium for updating document based on voice recognition | |
| CN112581965A (en) | Transcription method, device, recording pen and storage medium | |
| CN204697201U (en) | One is long-range brings before the court system | |
| CN113012500A (en) | Remote teaching system | |
| CN109905756B (en) | Television caption dynamic generation method based on artificial intelligence and related equipment | |
| CN111400463B (en) | Dialogue response method, device, equipment and medium | |
| CN113761986A (en) | Text acquisition method, text live broadcast equipment and storage medium | |
| CN116825123A (en) | Tone quality optimization method and system based on audio push | |
| CN113014854A (en) | Method, device, equipment and medium for generating interactive record | |
| CN107547813A (en) | A kind of system and method for acquisition process multipath audio signal | |
| KR101081768B1 (en) | Apparatus and method for servicing broadcasting | |
| CN211788155U (en) | Intelligent conference recording system | |
| CN113689855A (en) | Conference record generation system, method, device and storage medium | |
| CN200969633Y (en) | Television implying subtitling data decoding, translation, dual-language display apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210122 |