CN112464028A - Network classroom information processing method and system and computer readable storage medium - Google Patents
Network classroom information processing method and system and computer readable storage medium Download PDFInfo
- Publication number
- CN112464028A CN112464028A CN202011327132.7A CN202011327132A CN112464028A CN 112464028 A CN112464028 A CN 112464028A CN 202011327132 A CN202011327132 A CN 202011327132A CN 112464028 A CN112464028 A CN 112464028A
- Authority
- CN
- China
- Prior art keywords
- teacher
- timestamp
- classroom
- text content
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a method and a system for processing online classroom information and a computer readable storage medium, wherein the method for processing the online classroom information comprises the following steps: performing voice recognition on the teacher client; when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded; and after receiving the alarm information, generating classroom notes according to the information of the timestamp and audio and video data of the teacher. The online classroom information processing method and system and the computer readable storage medium process the teaching information of the online classroom, generate the important content into classroom notes for students to review at any time, and improve the online teaching effect to a certain extent.
Description
Technical Field
The present invention relates to the field of video communication technologies, and in particular, to a method and a system for processing network classroom information and a computer-readable storage medium.
Background
With the development of internet technology, network teaching is more and more popular because of the advantages of convenience, time saving, remote education realization and the like. However, compared with the traditional face-to-face teaching, the network teaching still has a certain gap in teaching effect.
The information disclosed in this background section is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.
Disclosure of Invention
The invention aims to provide an online classroom information processing method and system, which are used for processing teaching information of an online classroom, generating classroom notes of key contents for students to review at any time and improving the online teaching effect to a certain extent.
In order to achieve the above object, the present invention provides a method for processing network classroom information, which comprises: performing voice recognition on the teacher client; when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded; and after receiving the alarm information, generating classroom notes according to the information of the timestamp and audio and video data of the teacher.
In an embodiment of the present invention, after receiving the alarm information, generating a classroom note according to the information of the timestamp and audio/video data of a teacher includes: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; and generating a class note in a video form according to the intercepted teaching video of the teacher and the corresponding timestamp information.
In an embodiment of the present invention, after receiving the alarm information, generating a classroom note according to the information of the timestamp and audio/video data of a teacher includes: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video; and generating a classroom note in a video form according to the deleted teacher teaching video and the corresponding timestamp information.
In an embodiment of the present invention, after receiving the alarm information, generating a classroom note according to the information of the timestamp and audio/video data of a teacher includes: intercepting teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp; converting the intercepted teacher voice data into text contents; and generating a classroom note in a text form according to the text content.
In an embodiment of the present invention, after receiving the alarm information, generating a classroom note according to the information of the timestamp and audio/video data of a teacher includes: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video; converting the voice data of the teacher in the deleted teaching video of the teacher into text content; deleting the third type of keywords in the text content; and generating a classroom note in a text form according to the deleted text content.
Based on the same inventive concept, the invention also provides a network classroom information processing method, which comprises the following steps: when a teacher client side is detected to give a lesson in combination with a document, performing voice recognition on the teacher client side; when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded; after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted; converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content; comparing the first text content with the second text content to determine the same content in the first text content and the second text content; and intercepting the image comprising the same content from the intercepted image, thereby generating the classroom note in the form of an image.
Based on the same inventive concept, the invention also provides a method for processing the information of the online classroom, which comprises the following steps: when a teacher client side is detected to give a lesson in combination with a document, performing voice recognition on the teacher client side; when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded; after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted; converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content; intercepting a third text content from the first text content according to the second text content; and generating a classroom note in a text form according to the third text content.
In one embodiment of the present invention, capturing a third text content from the first text content according to the second text content includes: judging whether the first text content contains a title or not; and if the second text content contains the title, intercepting a third text content from the first text content according to the second text content, so that the intercepted text content is the content under one or more titles.
Based on the same invention concept, the invention also provides a network classroom information processing system, wherein the voice recognition module is used for carrying out voice recognition on the teacher client; the alarm information sending module is coupled with the voice recognition module and used for sending alarm information when detecting that one or more preset first-class keywords appear in the voice of the teacher; the time stamp recording module is coupled with the alarm information sending module and is used for recording a time stamp for sending the alarm information; the classroom note generating module is coupled with the voice recognition module, the alarm information sending module and the time stamp recording module and used for generating classroom notes according to the information of the time stamps and audio and video data of teachers after the alarm information is received.
Based on the same inventive concept, the invention further provides a computer-readable storage medium, which is used for executing the network classroom information processing method in any one of the above embodiments.
Compared with the prior art, according to the network classroom information processing method and system and the computer readable storage medium, the voice of the teacher is detected by using the voice recognition technology, key contents of teaching of the teacher are grasped through keyword information in the preset word bank, the key contents are intercepted in time, classroom notes in the form of characters, videos or images are generated for the students to review at any time, the students are helped to arrange the key points of the teaching of the teacher, learning is more convenient and faster, time can be saved, omission of key knowledge points caused by the fact that the students are not clearly informed or timely recorded in the course is avoided, and therefore the teaching effect is improved.
Drawings
Fig. 1 is a block diagram of steps of a method for processing webclass information according to an embodiment of the present invention;
fig. 2 is a block diagram of a network classroom information processing system according to an embodiment of the present invention.
Detailed Description
The following detailed description of the present invention is provided in conjunction with the accompanying drawings, but it should be understood that the scope of the present invention is not limited to the specific embodiments.
Throughout the specification and claims, unless explicitly stated otherwise, the word "comprise", or variations such as "comprises" or "comprising", will be understood to imply the inclusion of a stated element or component but not the exclusion of any other element or component.
In order to improve the teaching effect of the online classroom and better exert the advantages of the online classroom, the invention provides an online classroom information processing method and system and a computer readable storage medium, which utilize the voice recognition technology, keyword detection technology and other technologies to intercept the key content spoken by a teacher in time to generate classroom notes, so that classmates can better understand knowledge points after class and are more favorable for mastering the key content of the classroom.
Fig. 1 is a block diagram of steps of a method for processing webclass information according to an embodiment of the present invention. The method includes steps S1 to S3.
The teacher client is subjected to voice recognition in step S1.
Keyword detection and alarm information transmission are performed in step S2: when one or more preset first-class keywords appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending the alarm information is recorded.
Wherein, all the keywords are preset in the keyword word stock. The first type of keywords can be 'key points', 'losing scores', 'frequently giving questions', 'writing down this point', 'frequently giving judgment questions', 'frequently checking' and the like, and the keywords are used for indicating that the current content spoken by the teacher is the key knowledge point and needs to be processed next step.
And after receiving the alarm information in the step S3, generating a classroom note according to the information of the timestamp and the audio/video data of the teacher.
Specifically, in order to generate a classroom note in a video form, in an embodiment, after receiving the alarm information in step S3, the generating a classroom note according to the information of the timestamp and the audio/video data of the teacher includes: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; and generating a class note in a video form according to the intercepted teaching video of the teacher and the corresponding timestamp information. For example, a video of a teacher giving lessons within two minutes before and after a time stamp of the alarm information is sent may be captured as a class note.
For example, when a teacher teaches that there are several different types of project management offices, their control and degree of influence on a project are classified into a support type, a control type, and an instruction type. For these types, students may give multiple questions with emphasis on them. When the system detects that the teacher speaks key points and/or possibly gives more choices according to the keyword lexicon, the system gives an alarm, captures the video content of the teacher teaching taking two minutes before and after the timestamp as the important knowledge points, and generates classroom notes in a video form.
Preferably, in order to enable the generated video-format classroom note to include only knowledge points as much as possible, in an embodiment, after receiving the alarm information in step S3, the generating the classroom note according to the information of the timestamp and the audio-video data of the teacher includes: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video; and generating a classroom note in a video form according to the deleted teacher teaching video and the corresponding timestamp information.
The second type of keywords are "next knowledge point", "how to understand", "how to speak here", and the like, and indicate that the key content of the current alarm is already spoken. And after the second type of keywords appear, detecting the pause time after the second type of keywords appear, and when the pause time reaches a third preset time period (for example, 3s), namely, voice is not detected in the time period, the teacher teaching video behind the second type of keywords can not be reserved, so that the video intercepting range of the teacher teaching video is narrowed, useless information is eliminated, and the key content of the current alarm forms a class note of the teacher teaching video and is attached with a remark timestamp.
In order to generate a classroom note in a text form, in an embodiment, after receiving the alarm information in step S3, generating a classroom note according to the information of the timestamp and audio/video data of the teacher includes: intercepting teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp; converting the intercepted teacher voice data into text contents; and generating a classroom note in a text form according to the text content.
In order to make the generated text-form classroom note contain as little useless information as possible, in one embodiment, after receiving the alarm information in step S3, generating the classroom note according to the information of the timestamp and the audio/video data of the teacher includes: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video; converting the voice data of the teacher in the deleted teaching video of the teacher into text content; deleting the third type of keywords in the text content; and generating a classroom note in a text form according to the deleted text content.
The third category of keywords are exclamation words, auxiliary words, repeated pronouns and the like, and after the words are removed, the text content is simplified. Preferably, the intercepted text content can be further simplified according to a fourth category of keywords, such as conjunctions of "below", "lower", "above", and the like.
It should be noted that the above embodiments can be applied to a situation where a subtitle such as a document does not appear during a course of a teacher giving a lecture, or a situation where the teacher gives a lecture on a network in conjunction with PPT, WORD, or other documents.
Based on the same inventive concept, the invention also provides a network classroom information processing method. In one embodiment, a teacher gives online lessons in combination with PPT, WORD, or other documents, and in order to generate class notes in the form of images, the online class information processing method of the embodiment includes: when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded; after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted; converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content; comparing the first text content with the second text content to determine the same content in the first text content and the second text content; and intercepting the image comprising the same content from the intercepted image, thereby generating the classroom note in the form of an image.
In order to form a classroom note in a text form in a scene that a teacher gives lessons online with PPT, WORD, or other documents, the online classroom information processing method of an embodiment further includes: when the teacher client side is detected to be combined with the document for teaching, performing voice recognition on the teacher client side; when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded; after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted; converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content; intercepting a third text content from the first text content according to the second text content; and generating a classroom note in a text form according to the third text content.
Preferably, intercepting a third text content from the first text content according to the second text content comprises: judging whether the first text content contains a title or not; and if the second text content contains the title, intercepting a third text content from the first text content according to the second text content, so that the intercepted third text content is the content under one or more titles.
For example, when the second text content of the teacher's voice conversion is "the first choice question is the key point", the first text content intercepted by the embodiment includes: "one, choose question 1, honored as that of the modern mathematics ancestor of China (): A. ginger colt; B. suzhou green tea; C. ginger lifu. 2. The first math publication of China, the "math book of mathematics", was created by (): a ', distinguishing the titles according to the detected titles, intercepting a third literal content ' 1 ', which is known as () by the modern mathematics ancestor in China: A. ginger colt; B. suzhou green tea; C. ginger, namely, only the current topic is intercepted and then recorded in the classroom note.
Based on the same inventive concept, the invention also provides a network classroom information processing system. As shown in fig. 2, the network classroom information processing system of an embodiment includes: the system comprises a voice recognition module 10, an alarm information sending module 11, a time stamp recording module 12 and a classroom note generating module 13.
The voice recognition module 10 is used for performing voice recognition on the teacher client.
The alarm information sending module 11 is coupled to the voice recognition module 10, and configured to send alarm information when detecting that one or more preset keywords of a first type appear in the voice of the teacher.
The timestamp recording module 12 is coupled to the alarm information sending module 11, and is configured to record a timestamp for sending the alarm information.
The classroom note generating module 13 is coupled with the voice recognition module 10, the alarm information sending module 11, and the timestamp recording module 12, and is configured to generate classroom notes according to the timestamp information and audio/video data of the teacher after receiving the alarm information.
Specifically, to generate a classroom note in the form of a video, in one embodiment, the classroom note generation module 13 is configured to: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; and generating a class note in a video form according to the intercepted teaching video of the teacher and the corresponding timestamp information.
Preferably, in order to enable the generated video-format classroom note to include knowledge points as far as possible, in one embodiment, the classroom note generation module 13 is configured to: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video; and generating a classroom note in a video form according to the deleted teacher teaching video and the corresponding timestamp information.
To generate a text-form classroom note, in one embodiment, the classroom note generation module 13 is configured to: intercepting teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp; converting the intercepted teacher voice data into text contents; and generating a classroom note in a text form according to the text content.
In order to generate a text-form classroom note containing as little useless information as possible, in one embodiment, the classroom note generating module 13 is configured to: intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp; when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video; converting the voice data of the teacher in the deleted teaching video of the teacher into text content; deleting the third type of keywords in the text content; and generating a classroom note in a text form according to the deleted text content.
In one embodiment, the teacher gives online lessons in conjunction with PPT, WORD, or other documents, and preferably, to form a class note in the form of an image, the class note generating module 13 of this embodiment is configured to: after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted; converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content; comparing the first text content with the second text content to determine the same content in the first text content and the second text content; and intercepting the image comprising the same content from the intercepted image, thereby generating the classroom note in the form of an image.
In one embodiment, the teacher gives online lessons in conjunction with PPT, WORD, or other documents, and in order to form text-form class notes, the class note generating module 13 of one embodiment is configured to: after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted; converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content; intercepting a third text content from the first text content according to the second text content; and generating a classroom note in a text form according to the third text content. Preferably, intercepting a third text content from the first text content according to the second text content comprises: judging whether the first text content contains a title or not; and if the third text content contains the title, intercepting the third text content from the first text content according to the intercepted teacher voice data and the title, so that the intercepted text content is the content under one or more titles.
Based on the same inventive concept, the present embodiment further provides a computer-readable storage medium, where the computer-readable storage medium is configured to execute the method for processing the webclassroom information according to any one of the above embodiments.
In summary, according to the online classroom information processing method and system and the computer-readable storage medium of the embodiments, when a teacher speaks, voice recognition is started, and after keyword alarm is performed each time, various forms of note contents for students to select are generated, such as videos, characters and images for the teacher to teach, and the students can select key contents suitable for learning according to their own preferences and needs. The invention discloses a classroom note taking method, which comprises the steps of taking notes in various forms, making students capable of better understanding knowledge points, more convenient and more diversified than taking notes on books, and making students not listening to key points and remembering notes more convenient and more comprehensive to learn, understand and master key points.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing descriptions of specific exemplary embodiments of the present invention have been presented for purposes of illustration and description. It is not intended to limit the invention to the precise form disclosed, and obviously many modifications and variations are possible in light of the above teaching. The exemplary embodiments were chosen and described in order to explain certain principles of the invention and its practical application to enable one skilled in the art to make and use various exemplary embodiments of the invention and various alternatives and modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims and their equivalents.
Claims (10)
1. A network classroom information processing method is characterized by comprising the following steps:
performing voice recognition on the teacher client;
when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded;
and after receiving the alarm information, generating classroom notes according to the information of the timestamp and audio and video data of the teacher.
2. The network classroom information processing method of claim 1, wherein after receiving the alarm information, generating classroom notes according to the timestamp information and audio/video data of a teacher comprises:
intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp;
and generating a class note in a video form according to the intercepted teaching video of the teacher and the corresponding timestamp information.
3. The network classroom information processing method of claim 1, wherein after receiving the alarm information, generating classroom notes according to the timestamp information and audio/video data of a teacher comprises:
intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp;
when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video;
and generating a classroom note in a video form according to the deleted teacher teaching video and the corresponding timestamp information.
4. The network classroom information processing method of claim 1, wherein after receiving the alarm information, generating classroom notes according to the timestamp information and audio/video data of a teacher comprises:
intercepting teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp;
converting the intercepted teacher voice data into text contents;
and generating a classroom note in a text form according to the text content.
5. The network classroom information processing method of claim 1, wherein after receiving the alarm information, generating classroom notes according to the timestamp information and audio/video data of a teacher comprises:
intercepting a teacher teaching video in a first preset time period before the timestamp and a teacher teaching video in a second preset time period after the timestamp;
when a second class of keywords are detected to appear in the intercepted teacher teaching video and no voice is detected in a third preset time period after the second class of keywords appear, deleting the teacher teaching video after a timestamp corresponding to the second class of keywords appears in the intercepted teacher teaching video;
converting the voice data of the teacher in the deleted teaching video of the teacher into text content;
deleting the third type of keywords in the text content;
and generating a classroom note in a text form according to the deleted text content.
6. A network classroom information processing method is characterized by comprising the following steps:
when a teacher client side is detected to give a lesson in combination with a document, performing voice recognition on the teacher client side;
when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded;
after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted;
converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content;
comparing the first text content with the second text content to determine the same content in the first text content and the second text content;
and intercepting the image comprising the same content from the intercepted image, thereby generating the classroom note in the form of an image.
7. A network classroom information processing method is characterized by comprising the following steps:
when a teacher client side is detected to give a lesson in combination with a document, performing voice recognition on the teacher client side;
when one or more preset first-class keywords are detected to appear in the voice of a teacher, alarm information is sent out, and a timestamp for sending out the alarm information is recorded;
after the alarm information is received, screenshot is conducted on a current screen of the teacher client side, and teacher voice data in a first preset time period before the timestamp and teacher voice data in a second preset time period after the timestamp are intercepted;
converting the intercepted image into first text content based on an image recognition function, and converting the intercepted teacher voice data into second text content;
intercepting a third text content from the first text content according to the second text content;
and generating a classroom note in a text form according to the third text content.
8. The online classroom information processing method of claim 7, wherein truncating a third textual content from the first textual content based on the second textual content comprises:
judging whether the first text content contains a title or not;
and if the second text content contains the title, intercepting a third text content from the first text content according to the second text content, so that the intercepted text content is the content under one or more titles.
9. An online classroom information processing system, comprising:
the voice recognition module is used for carrying out voice recognition on the teacher client;
the alarm information sending module is coupled with the voice recognition module and used for sending alarm information when detecting that one or more preset first-class keywords appear in the voice of the teacher;
the time stamp recording module is coupled with the alarm information sending module and is used for recording a time stamp for sending the alarm information;
and the classroom note generation module is coupled with the voice recognition module, the alarm information sending module and the time stamp recording module and is used for generating classroom notes according to the information of the time stamp and audio and video data of a teacher after receiving the alarm information.
10. A computer-readable storage medium storing a computer program for executing the network classroom information processing method according to any one of claims 1 through 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011327132.7A CN112464028A (en) | 2020-11-24 | 2020-11-24 | Network classroom information processing method and system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011327132.7A CN112464028A (en) | 2020-11-24 | 2020-11-24 | Network classroom information processing method and system and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112464028A true CN112464028A (en) | 2021-03-09 |
Family
ID=74798609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011327132.7A Pending CN112464028A (en) | 2020-11-24 | 2020-11-24 | Network classroom information processing method and system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112464028A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114283635A (en) * | 2021-12-31 | 2022-04-05 | Oook(北京)教育科技有限责任公司 | Interactive system of live classroom |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20030001190A (en) * | 2001-06-22 | 2003-01-06 | 주식회사 에듀메카 | On-line study system capable of emphasizing specific key words on voice pattern of a teacher and method using the same and computer readable medium stored computer program for performing the method |
| CN107291343A (en) * | 2017-05-18 | 2017-10-24 | 网易（杭州）网络有限公司 | Recording method, device and the computer-readable recording medium of notes |
| CN108763366A (en) * | 2018-05-17 | 2018-11-06 | 惠州学院 | The grasping means of video image emphasis picture, device, storage medium and electronic equipment |
| CN110223365A (en) * | 2019-06-14 | 2019-09-10 | 广东工业大学 | A kind of notes generation method, system, device and computer readable storage medium |
| CN110569393A (en) * | 2019-09-05 | 2019-12-13 | 杭州米络星科技(集团)有限公司 | Short video cutting method for air classroom |
-
2020
- 2020-11-24 CN CN202011327132.7A patent/CN112464028A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20030001190A (en) * | 2001-06-22 | 2003-01-06 | 주식회사 에듀메카 | On-line study system capable of emphasizing specific key words on voice pattern of a teacher and method using the same and computer readable medium stored computer program for performing the method |
| CN107291343A (en) * | 2017-05-18 | 2017-10-24 | 网易（杭州）网络有限公司 | Recording method, device and the computer-readable recording medium of notes |
| CN108763366A (en) * | 2018-05-17 | 2018-11-06 | 惠州学院 | The grasping means of video image emphasis picture, device, storage medium and electronic equipment |
| CN110223365A (en) * | 2019-06-14 | 2019-09-10 | 广东工业大学 | A kind of notes generation method, system, device and computer readable storage medium |
| CN110569393A (en) * | 2019-09-05 | 2019-12-13 | 杭州米络星科技(集团)有限公司 | Short video cutting method for air classroom |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114283635A (en) * | 2021-12-31 | 2022-04-05 | Oook(北京)教育科技有限责任公司 | Interactive system of live classroom |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111526382B (en) | Live video text generation method, device, equipment and storage medium | |
| US20200294487A1 (en) | Hands-free annotations of audio text | |
| CN103607457B (en) | Take down notes processing method, device, terminal, server and system | |
| CN107920280A (en) | The accurate matched method and system of video, teaching materials PPT and voice content | |
| CN109147444B (en) | Learning condition feedback method and intelligent desk lamp | |
| Jenks | Recording and transcribing social interaction | |
| US20070185857A1 (en) | System and method for extracting salient keywords for videos | |
| CN111522970A (en) | Exercise recommendation method, exercise recommendation device, exercise recommendation equipment and storage medium | |
| US10289677B2 (en) | Systems and methods for using a program schedule to facilitate modifying closed-captioning text | |
| US10810897B2 (en) | Question generation for learning session | |
| US20160217704A1 (en) | Information processing device, control method therefor, and computer program | |
| CN111415282A (en) | Examination paper scanning and printing all-in-one machine and examination paper marking method thereof | |
| Camiciottoli | The OpenCourseWare lecture: A new twist on an old genre? | |
| CN113779345B (en) | Teaching material generation method and device, computer equipment and storage medium | |
| CN112464028A (en) | Network classroom information processing method and system and computer readable storage medium | |
| KR102124828B1 (en) | System for Instructional visual content using Automatically convert images from electronic documents | |
| Shaojie et al. | Systematic literature review on audio-visual multimodal input in listening comprehension | |
| CN114173191B (en) | Multi-language answering method and system based on artificial intelligence | |
| CN112464020B (en) | Network classroom information processing method and system and computer readable storage medium | |
| CN116055825A (en) | Method and device for generating video title | |
| US20160372154A1 (en) | Substitution method and device for replacing a part of a video sequence | |
| CN109889916B (en) | Application system of recorded broadcast data | |
| KR20220162356A (en) | Method and apparatus for providing lecturing contents for administrative law | |
| Fernández | Four L2 learning objectives to guide podcast design | |
| KR102633515B1 (en) | System for mobile contents generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210309 |
|
| RJ01 | Rejection of invention patent application after publication |