CN114125537A - Discussion method, device, medium and electronic equipment for live broadcast teaching - Google Patents
Discussion method, device, medium and electronic equipment for live broadcast teaching Download PDFInfo
- Publication number
- CN114125537A CN114125537A CN202111440260.7A CN202111440260A CN114125537A CN 114125537 A CN114125537 A CN 114125537A CN 202111440260 A CN202111440260 A CN 202111440260A CN 114125537 A CN114125537 A CN 114125537A
- Authority
- CN
- China
- Prior art keywords
- current
- video
- teaching
- keyword
- keywords
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/3331—Query processing
- G06F16/334—Query execution
- G06F16/3344—Query execution using natural language analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/338—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The disclosure provides a discussion method, a discussion device, a discussion medium and electronic equipment for live broadcast teaching. The method comprises the steps of performing semantic analysis on a current speech audio discussed between a teaching teacher and a speech student to obtain at least two current keywords; then, priority arrangement is carried out on the basis of at least two current keywords to obtain a current keyword queue; and acquiring knowledge text content corresponding to the current keyword queue through the current keyword queue. And then simultaneously displaying the first video of the teaching teacher, the second video of the speaking students and the knowledge text content on the multimedia blackboard. The teaching students in the live classroom can timely and accurately obtain the discussed knowledge text content, so that the teaching students are assisted to accurately obtain the knowledge points of the discussed content, and the comprehension of the teaching students to the knowledge is improved.
Description
Technical Field
The disclosure relates to the field of artificial intelligence, in particular to a live broadcast teaching discussion method, a live broadcast teaching discussion device, a live broadcast teaching discussion medium and electronic equipment.
Background
With the development of computer technology, internet-based network teaching is beginning to rise.
The network teaching is a teaching mode mainly for teaching by using a network as a communication tool of teachers and students. The network teaching comprises live broadcasting teaching and recorded broadcasting teaching. Live teaching is the same as the traditional teaching mode, students can listen to teachers and lectures at the same time, and teachers and students have simple communication. The recorded broadcast teaching utilizes the service of the internet, the courses recorded in advance by the teacher are stored on the service end, and the students can order and watch the courses at any time to achieve the purpose of learning. The recorded broadcast teaching is characterized in that the teaching activities can be carried out 24 hours all day, each student can determine the learning time, content and progress according to the actual condition of the student, and the learning content can be downloaded on the network at any time. In network teaching, each course may have a large number of students attending the course.
Currently, there is a live teaching mode, in which students attending class are concentrated in a live classroom and participate in the teaching activities of remote teaching teachers through a display screen in a multimedia blackboard. When a teacher giving lessons discusses problems with students in a live classroom, students who attend lessons can only see the images of the teacher giving lessons through the multimedia blackboard. The discussion mode can be only discussed in a video mode, the knowledge content involved in the discussion needs to be turned over on site, and the knowledge points in the books are found to support the discussion points. Not only is time wasted, but also the discussion process becomes cumbersome.
Therefore, the present disclosure provides a discussion method of live broadcast teaching to solve one of the above technical problems.
Disclosure of Invention
The present disclosure is directed to a method, an apparatus, a medium, and an electronic device for live broadcast teaching discussion, which can solve at least one of the above-mentioned technical problems. The specific scheme is as follows:
according to a specific embodiment of the present disclosure, in a first aspect, the present disclosure provides a discussion method for live broadcast teaching, including:
receiving a first video and a second video of live teaching, wherein the first video is used for collecting a teaching video of a teaching teacher by a teaching terminal, and the second video is used for collecting a video of a speaker who discusses problems with the teaching teacher in a remote teaching classroom by a multimedia blackboard;
acquiring a current speech audio based on the first video or the second video;
performing semantic analysis on the current speech audio to obtain at least two current keywords;
performing priority ordering on the at least two current keywords to obtain a current keyword queue;
respectively carrying out similarity matching according to the current keyword queue and a plurality of first keyword groups in a knowledge information set, and obtaining at least one second keyword group meeting a preset similarity condition and knowledge text contents corresponding to the second keyword groups, wherein the first keyword groups are subjected to priority sequencing based on the same mode of generating the current keyword queue;
and transmitting the first video, the second video and the at least one knowledge text content to the multimedia blackboard, and triggering the multimedia blackboard to execute the operation of displaying the first video, the second video and the at least one knowledge text content.
According to a second aspect of the present disclosure, there is provided a discussion apparatus for live broadcast teaching, including:
the receiving unit is used for receiving a first video and a second video of live broadcasting teaching, wherein the first video is used for collecting a teaching video of a teaching teacher by a teaching terminal, and the second video is used for collecting a video of a speaker who discusses problems with the teaching teacher in a remote teaching classroom by a multimedia blackboard;
a first obtaining unit, configured to obtain a current speech audio based on the first video or the second video;
a second obtaining unit, configured to perform semantic analysis on the current speech audio to obtain at least two current keywords;
the sorting unit is used for carrying out priority sorting on the at least two current keywords to obtain a current keyword queue;
the matching unit is used for respectively carrying out similarity matching according to the current keyword queue and a plurality of first keyword groups in a knowledge information set to obtain at least one second keyword group meeting a preset similarity condition and knowledge text contents corresponding to the second keyword groups, wherein the first keyword groups are subjected to priority sequencing based on the same mode of generating the current keyword queue;
and the transmitting unit is used for transmitting the first video, the second video and the at least one knowledge text content to the multimedia blackboard and triggering the multimedia blackboard to execute the operation of displaying the first video, the second video and the at least one knowledge text content.
According to a third aspect, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a discussion method of live teaching as described in any of the above.
According to a fourth aspect thereof, the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement a discussion method of live teaching as in any above.
Compared with the prior art, the scheme of the embodiment of the disclosure at least has the following beneficial effects:
the disclosure provides a discussion method, a discussion device, a discussion medium and electronic equipment for live broadcast teaching. The method comprises the steps of performing semantic analysis on a current speech audio discussed between a teaching teacher and a speech student to obtain at least two current keywords; then, priority arrangement is carried out on the basis of at least two current keywords to obtain a current keyword queue; and acquiring knowledge text content corresponding to the current keyword queue through the current keyword queue. And then simultaneously displaying the first video of the teaching teacher, the second video of the speaking students and the knowledge text content on the multimedia blackboard. The teaching students in the live classroom can timely and accurately obtain the discussed knowledge text content, so that the teaching students are assisted to accurately obtain the knowledge points of the discussed content, and the comprehension of the teaching students to the knowledge is improved.
Drawings
FIG. 1 shows a schematic diagram of the components of a live tutoring device;
FIG. 2 shows a flow diagram of a discussion method of live tutoring according to an embodiment of the present disclosure;
FIG. 3 shows a block diagram of elements of a discussion apparatus of live tutoring according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram illustrating an electronic device connection structure provided in accordance with an embodiment of the present disclosure;
11-a media blackboard, 12-a teaching terminal and 13-a server;
111-first display module, 112-second display module, 113-third display module, 114-first display area, 115-second display area, 116-third display area.
Detailed Description
To make the objects, technical solutions and advantages of the present disclosure clearer, the present disclosure will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present disclosure, rather than all embodiments. All other embodiments, which can be derived by one of ordinary skill in the art from the embodiments disclosed herein without making any creative effort, shall fall within the scope of protection of the present disclosure.
The terminology used in the embodiments of the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in the disclosed embodiments and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and "a plurality" typically includes at least two.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
It should be understood that although the terms first, second, third, etc. may be used in the embodiments of the present disclosure, these descriptions should not be limited to these terms. These terms are only used to distinguish one description from another. For example, a first could also be termed a second, and, similarly, a second could also be termed a first, without departing from the scope of embodiments of the present disclosure.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in the article or device in which the element is included.
It is to be noted that the symbols and/or numerals present in the description are not reference numerals if they are not labeled in the description of the figures.
Alternative embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
Example 1
The embodiment provided by the disclosure, namely the embodiment of the discussion method of the live broadcast teaching.
The embodiments of the present disclosure will be described in detail below with reference to fig. 1 and 2.
As shown in fig. 1, the device for live teaching includes: a teaching terminal 12, a media blackboard 11 and a server 13. The teaching terminal 12 is used for collecting teaching videos of a teaching teacher; the media blackboard 11 is used for collecting videos of speakers who discuss problems with the teaching teacher in a remote teaching classroom. The discussion method of live broadcast teaching is applied to the server 13.
As shown in fig. 2, step S101 receives a live teaching first video and a second video.
The first video is acquired by a teaching terminal 12, and the second video is acquired by a multimedia blackboard 11, wherein the first video is acquired by a teaching teacher from a teaching teacher, and the second video is acquired by a speaker participating in problem discussion of the teaching teacher from a remote teaching classroom.
Step S102, obtaining a current speaking audio based on the first video or the second video.
Because the teaching teacher and the students in class discuss the problem, no matter how many students in class participate in the discussion on one side of the multimedia blackboard 11, the audio in the first video and the audio in the second video always present a question and answer form, that is, the audio of only one speaker exists at one time point, and the audio of simultaneous speaking of multiple parties does not appear. The embodiment of the disclosure takes the speech audio in the video of one party as the current speech audio. It is to be understood that either the audio of the first video is speaking or the audio of the second video is speaking.
Step S103, performing semantic analysis on the current speech audio to acquire at least two current keywords.
The current keyword is a word capable of characterizing the semantic features of the current speech audio.
The semantic analysis is performed on the current speech audio to obtain at least two current keywords, which can be understood as extracting current keywords capable of representing semantic features from the current speech audio, and since one current keyword is difficult to represent semantic features, the embodiment of the present disclosure needs to extract at least two current keywords from the current speech audio.
In some specific embodiments, the performing semantic analysis on the current speech audio to obtain at least two current keywords includes the following steps:
and step S103-1, performing sentence break analysis on the current speaking audio to acquire at least one first audio.
Wherein the first audio comprises a complete semantic meaning. It is understood that the first audio is an audio capable of expressing a complete meaning. If the first audio is recorded by words, the words of the first audio are a segment of words ending with a period, question mark or exclamation mark.
The sentence break analysis is performed on the current speech audio, that is, the current speech audio is divided into several segments, and each segment is a first audio. If the current speech audio is not one that can convey a complete meaning, the first audio will not be generated. Thus, at least one first audio is acquired.
In some specific embodiments, the performing sentence break analysis on the current speech audio to obtain at least one first audio includes the following steps:
and step S103-1a, inputting the current speech audio into the trained sentence break analysis model to obtain at least one first audio.
The sentence break analysis model may be obtained based on previous historical speech audio, for example, a sentence break analysis model is trained using the historical speech audio as a training sample. The present embodiment does not describe in detail a process of performing a sentence break analysis on a current speech audio according to a sentence break analysis model, and can refer to various implementation manners in the prior art.
Of course, sentence break analysis is performed on the current speech audio, and other sentence break analysis methods may also be adopted, which is not limited in the embodiment of the present disclosure.
Step S103-2, performing semantic analysis on the first audio to obtain a current key phrase of the first audio.
Wherein the current keyword group comprises at least two current keywords. The current keyword group stores the combination mode of the current keyword, namely the logical relation of the current keyword in the first audio. And the mutual relationship between the current keyword groups of each first audio stores the logical relationship of the current keyword group in the current speech audio.
In some specific embodiments, the semantic analyzing the first audio to obtain the current keyword group of the first audio includes the following steps:
and S103-2a, inputting the first audio into the trained semantic analysis model to obtain at least two current keywords.
The semantic analysis model may be obtained based on previous historical first audio, for example, training the semantic analysis model with the historical first audio as a training sample. The present embodiment does not describe in detail the process of performing semantic analysis on the first audio according to the semantic analysis model, and may refer to various implementation manners in the prior art.
Of course, the semantic analysis of the first audio may also adopt other semantic analysis methods, and the embodiment of the present disclosure is not limited.
And step S104, carrying out priority sequencing on the at least two current keywords to obtain a current keyword queue.
The aim of generating the current keyword queue is to acquire knowledge text contents with high matching degree, so that students in class in a live classroom can timely and accurately acquire the knowledge text contents for discussion, and therefore the students in class are assisted to accurately acquire knowledge points of the discussion contents, and the comprehension of the students in class on knowledge is improved.
In some embodiments, the prioritizing the at least two current keywords to obtain the current keyword queue includes:
step S104-1, performing weight value analysis on the at least two current keywords to obtain the current weight value of each current keyword.
The current weight value is used for representing the importance degree of the current keyword in the current speech audio.
Further, taking the above specific embodiment as an example, if at least one first audio is obtained and the current keyword group of the first audio is obtained, performing weight value analysis on the at least two current keywords to obtain a current weight value of each current keyword, including the following steps:
and step S104-1-1, performing combined weight value analysis on all current keywords in the current keyword group to obtain the combined weight value of the current keyword group.
The combined weight value analysis is to take the first audio with a complete meaning as a unit, and take all current keywords in the first audio as a whole to perform weight value analysis. And determining the importance degree of the current key phrase in the current speech audio through the combination mode of the current key phrase.
And S104-1-2, acquiring a middle weight value of the current keyword based on the combined weight value of the current keyword group and a preset weight value of the current keyword in the current keyword group.
The preset weight value is the preset importance degree of the current keyword in the current course.
Since the combination weight value merely represents the importance degree of the current keyword group in the current speech audio, the importance degree of the current keyword group in the current speech audio cannot be represented yet. Therefore, the embodiment of the disclosure provides a method for determining an intermediate weight value of a current keyword by combining the weight value and a preset weight value of the current keyword.
Optionally, the obtaining of the intermediate weight value of the current keyword based on the combined weight value of the current keyword group and the preset weight value of the current keyword in the current keyword group includes:
step S104-1-2a, calculating the product of the combined weight value of the current keyword group and the preset weight value of the current keyword in the current keyword group to obtain the intermediate weight value of the current keyword.
For example, the combination weight value of the current keyword group is 3.2, and the current keyword group includes: the method comprises the steps that a first current keyword, a second current keyword and a third current keyword are selected, and if the preset weight value of the first current keyword is 1.3, the intermediate weight value of the first current keyword is 3.2X 1.3-4.16; if the preset weight value of the second current keyword is 1.5, the intermediate weight value of the second current keyword is equal to 3.2X 1.5-4.8; if the preset weight value of the third current keyword is equal to 1.25, the intermediate weight value of the third current keyword is equal to 3.2X1.25 — 4.
And S104-1-3, classifying all current keywords in the current speech audio, and calculating to obtain the current weight values of the classified current keywords.
And the current weight value is the sum of the intermediate weight values of the classified current keywords.
If a plurality of first audios are included in the current speech audio and the same keyword is included in all of the first audios, for example, the keyword "acceleration" is included in each speech in a classroom. The embodiment of the present disclosure classifies keywords appearing multiple times in the current speech audio, for example, 3 first audios in the current speech audio have a keyword "acceleration", the keyword "acceleration" is classified as the same type, and if the intermediate weight values of the "acceleration" in the 3 first audios are: 3.26, 4.25, and 3.6, the current weight value is equal to 11.11, 3.26+4.25+ 3.6.
And S104-2, performing priority sequencing on all current keywords according to the current weight value of each current keyword to generate the current keyword queue.
All current keywords are subjected to priority sequencing based on the current weight values, and sequencing can be performed according to the ascending sequence of the current weight values of the current keywords; or sorting according to the descending order of the current weight value of the current keyword.
And step S105, respectively carrying out similarity matching according to the current keyword queue and a plurality of first keyword groups in the knowledge information set, and obtaining at least one second keyword group meeting a preset similarity condition and knowledge text content corresponding to the second keyword group.
And the first keyword group is subjected to priority sequencing based on the same mode of generating the current keyword queue.
Due to the diversification of languages, in order to prevent the current keyword queue from being unable to find a matched first keyword group in the knowledge information set, the embodiment of the present disclosure provides a matching method of similarity. And when the matching degree value of the first key phrase meets the preset similarity condition, determining that the first key phrase is the second key phrase meeting the requirement. Based on this, the knowledge text content corresponding to the second keyword group in the knowledge information set is also the required content. For example, if the matching values of the current keyword queue and the three first keyword groups in the knowledge information set are: 82%, 76% and 48%, the preset similarity conditions are: the match value is greater than or equal to 80%; then the matching value is 82% of the first keyword group whose corresponding knowledge text content in the knowledge information set is needed.
Step S106, transmitting the first video, the second video and the at least one knowledge text content to the multimedia blackboard 11, and triggering the multimedia blackboard 11 to execute the operation of displaying the first video, the second video and the at least one knowledge text content.
And displaying the first video, the second video and the at least one knowledge text content on the multimedia blackboard 11 so as to provide a teacher-student interactive discussion scene for students in the live class. Meanwhile, according to the interaction process of teachers and students, knowledge text content matched with discussion content is provided for students attending classes, and the students attending classes are assisted to find the knowledge points for discussion as soon as possible. The students who attend the class are guided to rapidly enter the discussion situation, and the experience of attending the class of the students is improved.
In one embodiment, the multimedia blackboard 11 includes: a first display module 111, a second display module 112, and a third display module 113.
Accordingly, the triggering the multimedia blackboard 11 to perform the operations of displaying the first video, the second video and the at least one knowledge text content includes:
triggering the multimedia blackboard 11 to execute the operation of displaying the first video and the second video in a first display module 111 and a second display module 112 respectively;
and triggering the multimedia blackboard 11 to execute the operation of displaying the at least one knowledge text content in the third display module 113.
In the multimedia blackboard 11 of the embodiment of the present disclosure, the first display module 111 and the second display module 112 may be two parallel vertical screens (for example, the aspect ratio of the screens is greater than 1), and the first video and the second video are respectively full-body images of a teaching teacher and a speaking student, so as to provide a live sense of reality of teacher-student discussion interaction for students listening to a lesson; the third display module 113 is a horizontal screen (for example, the aspect ratio of the screen is less than 1) and is used to improve the display efficiency of the content and better conform to the reading habit of people.
In another embodiment, the multimedia blackboard 11 includes a display module.
Accordingly, the triggering the multimedia blackboard 11 to perform the operations of displaying the first video, the second video and the at least one knowledge text content includes:
triggering the multimedia blackboard 11 to execute the operation of respectively displaying the first video and the second video in the first display area 114 and the second display area 115 of the display module;
and triggering the multimedia blackboard 11 to execute the operation of displaying the at least one knowledge text content in the third display area 116 in the display module.
The multimedia blackboard 11 of the embodiment of the present disclosure adopts a display module, in which a first display area 114 and a second display area 115 with aspect ratios greater than 1 can be respectively displayed, for respectively displaying the whole body images of a teaching teacher and a speaking student, so as to provide the students listening to the teaching with the live sense of teacher-student discussion interaction; the third display area 116 is an area with an aspect ratio smaller than 1, and is used to improve the display efficiency of the content and better conform to the reading habit of people.
Of course, the size and/or shape of the display area may also be changed according to the teaching progress, and the specific embodiment of the disclosure is not limited.
The method comprises the steps that semantic analysis is carried out on current speech audio discussed between a teaching teacher and a speech student, and at least two current keywords are obtained; then, priority arrangement is carried out on the basis of at least two current keywords to obtain a current keyword queue; and acquiring knowledge text content corresponding to the current keyword queue through the current keyword queue. Then, the first video of the teaching teacher, the second video of the speaking student and the knowledge text content are simultaneously displayed on the multimedia blackboard 11. The teaching students in the live classroom can timely and accurately obtain the discussed knowledge text content, so that the teaching students are assisted to accurately obtain the knowledge points of the discussed content, and the comprehension of the teaching students to the knowledge is improved.
Example 2
The present disclosure also provides an apparatus embodiment adapted to the above embodiment, for implementing the method steps described in the above embodiment, and the explanation based on the same name and meaning is the same as that of the above embodiment, and has the same technical effect as that of the above embodiment, and is not described again here.
As shown in fig. 3, the present disclosure provides a discussion apparatus 300 of live teaching, including:
the receiving unit 301 is configured to receive a first video and a second video for live teaching, where the first video is obtained by a teaching terminal from a teaching teacher, and the second video is obtained by a multimedia blackboard from a speaker who discusses a problem with the teaching teacher in a remote teaching classroom;
a first obtaining unit 302, configured to obtain a current speech audio based on the first video or the second video;
a second obtaining unit 303, configured to perform semantic analysis on the current speech audio to obtain at least two current keywords;
a sorting unit 304, configured to perform priority sorting on the at least two current keywords to obtain a current keyword queue;
a matching unit 305, configured to perform similarity matching respectively according to the current keyword queue and multiple first keyword groups in a knowledge information set, and obtain at least one second keyword group that meets a preset similarity condition and knowledge text content corresponding to the second keyword group, where the first keyword groups are prioritized based on a same manner as that in which the current keyword queue is generated;
a transmitting unit 306, configured to transmit the first video, the second video, and the at least one knowledge text content to the multimedia blackboard, and trigger the multimedia blackboard to perform an operation of displaying the first video, the second video, and the at least one knowledge text content.
Optionally, the sorting unit 304 includes:
the weight analysis subunit is used for performing weight analysis on the at least two current keywords to obtain a current weight value of each current keyword;
and the first obtaining subunit is used for performing priority ordering on all current keywords according to the current weight value of each current keyword to generate the current keyword queue.
Optionally, the second obtaining unit 303 includes:
a sentence break analysis subunit, configured to perform sentence break analysis on the current speech audio to obtain at least one first audio, where the first audio includes a complete semantic meaning;
and the second obtaining subunit is configured to perform semantic analysis on the first audio to obtain a current keyword group of the first audio, where the current keyword group includes at least two current keywords.
Optionally, the weight analyzing subunit includes:
a combination analysis subunit, configured to perform combination weight value analysis on all current keywords in the current keyword group to obtain a combination weight value of the current keyword group;
a third obtaining subunit, configured to obtain an intermediate weight value of the current keyword based on the combined weight value of the current keyword group and a preset weight value of the current keyword in the current keyword group;
and the classification subunit is used for classifying all current keywords in the current speaking audio, and calculating and acquiring a current weight value of the classified current keywords, wherein the current weight value is the sum of intermediate weight values of the classified current keywords.
Optionally, the sentence break analysis subunit includes:
and the fourth obtaining subunit is configured to input the current speech audio into the trained sentence break analysis model, and obtain at least one first audio.
Optionally, the multimedia blackboard includes: the display device comprises a first display module, a second display module and a third display module;
the transmitting unit 306 includes:
the first triggering subunit is used for triggering the multimedia blackboard to execute the operation of respectively displaying the first video and the second video in a first display module and a second display module;
and the second trigger subunit is used for triggering the multimedia blackboard to execute the operation of displaying the at least one knowledge text content in the third display module.
Optionally, the multimedia blackboard includes a display module;
the transmitting unit 306 includes:
the third triggering subunit is used for triggering the multimedia blackboard to execute the operation of respectively displaying the first video and the second video in the first display area and the second display area of the display module;
and the fourth trigger subunit is used for triggering the multimedia blackboard to execute the operation of displaying the at least one knowledge text content in the third display area in the display module.
The method comprises the steps that semantic analysis is carried out on current speech audio discussed between a teaching teacher and a speech student, and at least two current keywords are obtained; then, priority arrangement is carried out on the basis of at least two current keywords to obtain a current keyword queue; and acquiring knowledge text content corresponding to the current keyword queue through the current keyword queue. And then simultaneously displaying the first video of the teaching teacher, the second video of the speaking students and the knowledge text content on the multimedia blackboard. The teaching students in the live classroom can timely and accurately obtain the discussed knowledge text content, so that the teaching students are assisted to accurately obtain the knowledge points of the discussed content, and the comprehension of the teaching students to the knowledge is improved.
Example 3
As shown in fig. 4, the present embodiment provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the one processor to cause the at least one processor to perform the method steps of the above embodiments.
Example 4
The disclosed embodiments provide a non-volatile computer storage medium having stored thereon computer-executable instructions that may perform the method steps as described in the embodiments above.
Example 5
Referring now to FIG. 4, shown is a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 4, the electronic device may include a processing apparatus (e.g., a central processing unit, a graphic processor, etc.) 301 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)302 or a program loaded from a storage apparatus 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data necessary for the operation of the electronic apparatus are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
Generally, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 305 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage devices 308 including, for example, magnetic tape, hard disk, etc.; and a communication device 309. The communication means 309 may allow the electronic device to communicate wirelessly or by wire with other devices to exchange data. While fig. 4 illustrates an electronic device having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication means 309, or installed from the storage means 308, or installed from the ROM 302. The computer program, when executed by the processing device 301, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
Claims (10)
1. A discussion method of live teaching is characterized by comprising the following steps:
receiving a first video and a second video of live teaching, wherein the first video is used for collecting a teaching video of a teaching teacher by a teaching terminal, and the second video is used for collecting a video of a speaker who discusses problems with the teaching teacher in a remote teaching classroom by a multimedia blackboard;
acquiring a current speech audio based on the first video or the second video;
performing semantic analysis on the current speech audio to obtain at least two current keywords;
performing priority ordering on the at least two current keywords to obtain a current keyword queue;
respectively carrying out similarity matching according to the current keyword queue and a plurality of first keyword groups in a knowledge information set, and obtaining at least one second keyword group meeting a preset similarity condition and knowledge text contents corresponding to the second keyword groups, wherein the first keyword groups are subjected to priority sequencing based on the same mode of generating the current keyword queue;
and transmitting the first video, the second video and the at least one knowledge text content to the multimedia blackboard, and triggering the multimedia blackboard to execute the operation of displaying the first video, the second video and the at least one knowledge text content.
2. The method of claim 1, wherein prioritizing the at least two current keywords to obtain a current keyword queue comprises:
performing weight value analysis on the at least two current keywords to obtain a current weight value of each current keyword;
and performing priority sequencing on all current keywords according to the current weight value of each current keyword to generate the current keyword queue.
3. The method of claim 2, wherein the semantically analyzing the current speech audio to obtain at least two current keywords comprises:
performing sentence break analysis on the current speech audio to obtain at least one first audio, wherein the first audio comprises a complete semantic meaning;
and performing semantic analysis on the first audio to obtain a current keyword group of the first audio, wherein the current keyword group comprises at least two current keywords.
4. The method of claim 3, wherein the performing weight value analysis on the at least two current keywords to obtain a current weight value of each current keyword comprises:
performing combination weight value analysis on all current keywords in the current keyword group to obtain a combination weight value of the current keyword group;
obtaining a middle weight value of the current keyword based on the combination weight value of the current keyword group and a preset weight value of the current keyword in the current keyword group;
classifying all current keywords in the current speaking audio, and calculating to obtain a current weight value of the classified current keywords, wherein the current weight value is the sum of intermediate weight values of the classified current keywords.
5. The method of claim 3, wherein the parsing the current speech audio to obtain at least one first audio comprises:
and inputting the current speech audio into the trained sentence break analysis model to obtain at least one first audio.
6. The method of claim 1, wherein the multimedia blackboard comprises: the display device comprises a first display module, a second display module and a third display module;
the triggering the multimedia blackboard to execute the operation of displaying the first video, the second video and the at least one knowledge text content comprises:
triggering the multimedia blackboard to execute the operation of respectively displaying the first video and the second video in a first display module and a second display module;
and triggering the multimedia blackboard to execute the operation of displaying the at least one knowledge text content in a third display module.
7. The method of claim 1, wherein said multimedia blackboard comprises a display module;
the triggering the multimedia blackboard to execute the operation of displaying the first video, the second video and the at least one knowledge text content comprises:
triggering the multimedia blackboard to execute the operation of respectively displaying the first video and the second video in a first display area and a second display area in the display module;
and triggering the multimedia blackboard to execute the operation of displaying the at least one knowledge text content in a third display area in the display module.
8. A discussion apparatus of live teaching, comprising:
the receiving unit is used for receiving a first video and a second video of live broadcasting teaching, wherein the first video is used for collecting a teaching video of a teaching teacher by a teaching terminal, and the second video is used for collecting a video of a speaker who discusses problems with the teaching teacher in a remote teaching classroom by a multimedia blackboard;
a first obtaining unit, configured to obtain a current speech audio based on the first video or the second video;
a second obtaining unit, configured to perform semantic analysis on the current speech audio to obtain at least two current keywords;
the sorting unit is used for carrying out priority sorting on the at least two current keywords to obtain a current keyword queue;
the matching unit is used for respectively carrying out similarity matching according to the current keyword queue and a plurality of first keyword groups in a knowledge information set to obtain at least one second keyword group meeting a preset similarity condition and knowledge text contents corresponding to the second keyword groups, wherein the first keyword groups are subjected to priority sequencing based on the same mode of generating the current keyword queue;
and the transmitting unit is used for transmitting the first video, the second video and the at least one knowledge text content to the multimedia blackboard and triggering the multimedia blackboard to execute the operation of displaying the first video, the second video and the at least one knowledge text content.
9. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method according to any one of claims 1 to 7.
10. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to carry out the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111440260.7A CN114125537B (en) | 2021-11-29 | 2021-11-29 | Discussion method, device, medium and electronic equipment for live broadcast teaching |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111440260.7A CN114125537B (en) | 2021-11-29 | 2021-11-29 | Discussion method, device, medium and electronic equipment for live broadcast teaching |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114125537A true CN114125537A (en) | 2022-03-01 |
| CN114125537B CN114125537B (en) | 2023-07-25 |
Family
ID=80368362
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111440260.7A Active CN114125537B (en) | 2021-11-29 | 2021-11-29 | Discussion method, device, medium and electronic equipment for live broadcast teaching |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114125537B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109118855A (en) * | 2017-06-22 | 2019-01-01 | 格局商学教育科技（深圳）有限公司 | A kind of net work teaching system of huge screen holography reduction real scene |
| CN109118854A (en) * | 2017-06-22 | 2019-01-01 | 格局商学教育科技（深圳）有限公司 | A kind of panorama immersion living broadcast interactive teaching system |
| CN109862375A (en) * | 2019-01-07 | 2019-06-07 | 北京汉博信息技术有限公司 | Cloud recording and broadcasting system |
| CN110647613A (en) * | 2018-06-26 | 2020-01-03 | 上海谦问万答吧云计算科技有限公司 | Courseware construction method, courseware construction device, courseware construction server and storage medium |
| CN111611434A (en) * | 2020-05-19 | 2020-09-01 | 深圳康佳电子科技有限公司 | Online course interaction method and interaction platform |
| CN111783687A (en) * | 2020-07-03 | 2020-10-16 | 佛山市海协科技有限公司 | Teaching live broadcast method based on artificial intelligence |
| CN111813889A (en) * | 2020-06-24 | 2020-10-23 | 北京安博盛赢教育科技有限责任公司 | Method, device, medium and electronic equipment for sorting question information |
| US20210012222A1 (en) * | 2019-07-12 | 2021-01-14 | Adobe Inc. | Answering Questions During Video Playback |
| CN112367526A (en) * | 2020-10-26 | 2021-02-12 | 联想(北京)有限公司 | Video generation method and device, electronic equipment and storage medium |
| CN113610682A (en) * | 2021-08-20 | 2021-11-05 | 汇正(广州)企业管理咨询有限公司 | Online remote education method and system based on big data |
-
2021
- 2021-11-29 CN CN202111440260.7A patent/CN114125537B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109118855A (en) * | 2017-06-22 | 2019-01-01 | 格局商学教育科技（深圳）有限公司 | A kind of net work teaching system of huge screen holography reduction real scene |
| CN109118854A (en) * | 2017-06-22 | 2019-01-01 | 格局商学教育科技（深圳）有限公司 | A kind of panorama immersion living broadcast interactive teaching system |
| CN110647613A (en) * | 2018-06-26 | 2020-01-03 | 上海谦问万答吧云计算科技有限公司 | Courseware construction method, courseware construction device, courseware construction server and storage medium |
| CN109862375A (en) * | 2019-01-07 | 2019-06-07 | 北京汉博信息技术有限公司 | Cloud recording and broadcasting system |
| US20210012222A1 (en) * | 2019-07-12 | 2021-01-14 | Adobe Inc. | Answering Questions During Video Playback |
| CN111611434A (en) * | 2020-05-19 | 2020-09-01 | 深圳康佳电子科技有限公司 | Online course interaction method and interaction platform |
| CN111813889A (en) * | 2020-06-24 | 2020-10-23 | 北京安博盛赢教育科技有限责任公司 | Method, device, medium and electronic equipment for sorting question information |
| CN111783687A (en) * | 2020-07-03 | 2020-10-16 | 佛山市海协科技有限公司 | Teaching live broadcast method based on artificial intelligence |
| CN112367526A (en) * | 2020-10-26 | 2021-02-12 | 联想(北京)有限公司 | Video generation method and device, electronic equipment and storage medium |
| CN113610682A (en) * | 2021-08-20 | 2021-11-05 | 汇正(广州)企业管理咨询有限公司 | Online remote education method and system based on big data |
Non-Patent Citations (1)
| Title |
|---|
| 赵圣洁;: "基于语音识别的实时字幕应用于网络教学的可行性探讨", 校园英语, no. 14 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114125537B (en) | 2023-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106952519A (en) | A kind of ideological and political education intelligent tutoring system | |
| Ibrahim et al. | Integrating mobile phones in teaching auditory and visual learners in an English classroom. | |
| KR20170140742A (en) | A video providing device and a method for studying ways of english expression | |
| CN111260975B (en) | Method, device, medium and electronic equipment for multimedia blackboard teaching interaction | |
| CN111897976A (en) | Virtual image synthesis method and device, electronic equipment and storage medium | |
| Hoffman | Untangling the talk: A new multimodal discourse analysis method to investigate synchronous online learning | |
| CN111862705A (en) | Method, device, medium and electronic equipment for prompting live broadcast teaching target | |
| CN111813889A (en) | Method, device, medium and electronic equipment for sorting question information | |
| Alzubi | The role of multimedia tools in Hashemite Kingdom of Jordan education classroom teaching in the digital era | |
| Gromik | Investigation of the cell phone video recording feature by Japanese undergraduate EFL learners | |
| CN109191958B (en) | Information interaction method, device, terminal and storage medium | |
| CN112863277B (en) | Interaction method, device, medium and electronic equipment for live broadcast teaching | |
| CN114125537B (en) | Discussion method, device, medium and electronic equipment for live broadcast teaching | |
| CN114328999A (en) | Interaction method, device, medium and electronic equipment for presentation | |
| CN114120729B (en) | Live teaching system and method | |
| CN114095747B (en) | Live broadcast interaction system and method | |
| CN114038255B (en) | Answering system and method | |
| CN108615416A (en) | Interactive touch-control all-in-one machine | |
| CN114297420A (en) | Note generation method, device, medium and electronic equipment for network teaching | |
| CN111785104B (en) | Information processing method and device and electronic equipment | |
| Hersh et al. | Representing contextual features of subtitles in an educational context | |
| CN114003764A (en) | Lecture effect marking method, device, medium and electronic equipment | |
| CN112948650B (en) | Learning effect display method and device and computer storage medium | |
| US20220319152A1 (en) | Methods for generating cognitive building blocks | |
| CN107609018B (en) | Search result presenting method and device and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |