CN110275860B - System and method for recording teaching process - Google Patents
System and method for recording teaching process Download PDFInfo
- Publication number
- CN110275860B CN110275860B CN201910550283.XA CN201910550283A CN110275860B CN 110275860 B CN110275860 B CN 110275860B CN 201910550283 A CN201910550283 A CN 201910550283A CN 110275860 B CN110275860 B CN 110275860B
- Authority
- CN
- China
- Prior art keywords
- document
- sentence
- audio
- server
- document page
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 102
- 230000008569 process Effects 0.000 title claims abstract description 69
- 238000013519 translation Methods 0.000 claims description 50
- 238000012545 processing Methods 0.000 claims description 42
- 238000004140 cleaning Methods 0.000 claims description 12
- 230000009471 action Effects 0.000 claims description 9
- 238000012546 transfer Methods 0.000 claims description 9
- 230000014759 maintenance of location Effects 0.000 claims description 7
- 230000011218 segmentation Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 4
- 241001672694 Citrus reticulata Species 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/116—Details of conversion of file system types or formats
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/44—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
- G06F40/106—Display of layout of documents; Previewing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/205—Parsing
- G06F40/211—Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a system for recording the teaching process, which integrates various resources such as voice, text, pictures, videos and the like for teaching, is convenient for learners to look up, and is more convenient and faster to transmit as the resources for recording the teaching process are highly integrated and are not scattered; the invention also provides a method for recording the teaching process, which collects the audio frequency in the teaching process of the speaker, translates the audio frequency into text information, integrates the text information with other uploaded documents, pictures or videos related to teaching to obtain teaching materials integrated by various resources, and the learner can look up the document and the video information through the materials and can play the audio frequency corresponding to the document.
Description
Technical Field
The invention relates to the technical field of integration processing of voice-to-text and multi-format documents, in particular to a system and a method for recording a teaching process.
Background
At present, three methods of recording a teaching process include video recording, audio recording and manually writing a document, and all of the three methods can realize the function of recording the teaching process of an interphone, but have different defects. Specifically, the teaching process is recorded by adopting a video recording method, and the video recording method is limited in popularization because the video resources occupy a large storage space, the requirement on the memory of the equipment is relatively high, and the transmission of the video data is inconvenient. The method of recording the audio frequency is adopted to record the teaching process, and if the audio frequency resource is lost, the content of the pictures and the documents is more difficult and inconvenient for the instructor to understand. Meanwhile, the resources for recording the teaching process obtained by the two methods need to be edited by professional persons at the later stage, and the process of positioning the target content is long and inconvenient to look up. The teaching process is recorded by manually grasping the document, and the teaching process needs to be operated by a professional, so that time and labor are wasted, and the cost is greatly increased. It is easy to find that the existing method for recording the teaching process has the problems of low efficiency, time consumption and energy consumption.
Therefore, how to provide a system and a method for realizing the recording teaching process with high efficiency, convenience, accuracy and reliability is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
In view of the above, the present invention provides a method and system for recording teaching processes,
in order to achieve the purpose, the invention adopts the following technical scheme:
in one aspect, the present invention provides a system for recording a teaching process, the system comprising: the system comprises at least two clients and at least three servers, wherein the two clients are a lecturer client and a learner client respectively, and the three servers are respectively: the system comprises a file transfer server, a document processing server and an audio translation server;
the lecturer client is used for uploading pictures, documents and video data related to teaching, and is also used for collecting audio information and document page display information in the teaching process;
the file transferring server is used for transferring the document data uploaded to the lecturer client to generate corresponding document picture data;
the audio translation server is used for performing audio translation on the audio information acquired by the instructor client to obtain a corresponding translation sentence;
the document processing server is used for carrying out segmented processing on the translated sentences obtained by the audio translation server, carrying out redundant cleaning processing on document page display information, integrating the processed character paragraphs, the processed document page display information, document picture data generated by the translation server and picture and video data uploaded to the lecturer client side to obtain a combined document, and storing and sharing the combined document by two-dimensional codes;
the learner client is used for linking to the document processing server according to the two-dimension code information and playing and displaying the combined document content.
On the basis of the above scheme, the scheme provided by the invention is further explained.
Further, the document processing server includes:
the receiving module is used for receiving pictures, documents and video data which are uploaded by the lecture client and related to teaching, and receiving audio information and document page display information of the lecture process, which are acquired by the lecturer client;
the document processing module is used for uploading the document data to the file transfer server and receiving document picture data returned by the file transfer server;
the audio processing module is used for uploading the audio information to the audio translation server and receiving a translation sentence returned by the audio translation server;
the segmentation module is used for segmenting the translated sentence obtained by the audio translation server;
the redundancy cleaning module is used for removing redundant document pages according to the retention time of the document pages and the number of the meaningful characters during the document page display period;
the document combination module is used for integrating character paragraphs, the processed document page display information, document picture data generated by the file transfer server, and pictures and video data uploaded to the lecturer client to obtain a combined document;
a database for storing the combined document;
the sharing module is used for generating a two-dimensional code corresponding to the combined document and sharing the two-dimensional code picture to the learner client;
and the link module is used for linking to the database when receiving a two-dimensional code information acquisition request sent by the learner client and providing a combined document display service for the learner client.
Furthermore, the document processing server further comprises an editing module, and the editing module is used for performing custom editing on the translated sentence received by the audio processing module.
According to the technical scheme, compared with the prior art, the system for recording the teaching process integrates various resources such as voice, text, pictures, videos and the like for teaching, is convenient for learners to look up, is more convenient to transmit because the resources for recording the teaching process are highly integrated and are not scattered, and can be embedded into the existing intelligent terminal equipment for use, so that the system is low in cost and more suitable for popularization and application.
In another aspect, the present invention provides a method of recording a teaching process, the method comprising the steps of:
uploading pictures, documents and video data related to teaching, and acquiring audio information and document page display information in the teaching process;
transferring the uploaded document data to generate corresponding document picture data;
performing audio translation on the audio information acquired by the instructor client to obtain a corresponding translated sentence;
segmenting the translated sentence;
carrying out redundancy cleaning processing on the document page display information;
and integrating the processed character paragraphs, the processed document page display information, the document picture data, the uploaded picture and the uploaded video data to obtain a combined document, and storing and sharing the combined document by using the two-dimensional code.
Furthermore, the translated sentence can be edited after being obtained. Considering the situation that the lecturer Mandarin is not standard, the translated sentence after audio translation may have wrong content, and after editing, the accuracy rate of characters can be increased.
Further, the step of segmenting the translated sentence specifically comprises the following steps:
analyzing each sentence in the translated sentence one by one, and judging a split sentence existing in the translated sentence;
and segmenting the translation sentences according to the positions of the split sentences.
Further, the method for judging the split sentences in the translated sentences specifically comprises the following steps:
calibrating a finishing sentence in a translated sentence;
judging whether the interval duration between the marked finishing sentence and the previous sentence is larger than a preset multiple of the average interval duration of the sentences one by one, and extracting the sentences meeting the time interval condition;
judging whether a document page display action exists in the sentence starting process meeting the time interval condition, and extracting the sentences with the document page display action;
judging whether the number of sentences spaced between the sentence with the document page display action and the last split sentence is larger than a preset sentence number threshold value or not, if so, judging the sentence to be a split sentence, otherwise, judging the sentence to be a common sentence.
Furthermore, in the process of calibrating the finishing sentence in the translation sentence, the judgment basis of the finishing sentence is as follows: a sentence ends with a period, exclamation point, or question mark.
Further, the method for performing redundancy cleaning processing on the document page display information specifically comprises the following steps:
comparing the display time of each document page with a preset time threshold value one by one in the document page display process, finding out document pages with the display time less than the time threshold value and removing the document pages;
and judging whether the corresponding translation sentences in the display period of each document page have meaningful characters or not, and if not, rejecting the corresponding document pages.
Further, the meaningful words are subjects or nouns in sentences.
Further, the process of obtaining a combined document specifically includes the following steps:
circularly displaying each document page, finding out corresponding paragraphs within the retention time of each document page from the text paragraphs, and inserting the document page behind the corresponding paragraphs in a new paragraph form;
and splitting the audio according to each paragraph in the text paragraphs, and associating the audio with the corresponding paragraph.
According to the technical scheme, compared with the prior art, the method for recording the teaching process is characterized in that audio in the teaching process of a speaker is collected and translated into text information, and the text information is integrated with other uploaded teaching related documents, pictures or videos to obtain teaching materials integrated with various resources, learners can look up the document and the video information through the materials, and audio corresponding to the document can be played.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic diagram of a network architecture of a system for recording teaching processes according to the present invention;
FIG. 2 is a block diagram illustrating the architecture of a system for recording teaching processes according to the present invention;
FIG. 3 is a flow chart illustrating a method of recording a teaching process according to the present invention;
FIG. 4 is a flow diagram illustrating a segmentation process in accordance with an embodiment of the present invention;
FIG. 5 is a schematic flow chart illustrating splitting sentence determination according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating a process for performing redundancy cleaning on a document page according to an embodiment of the present invention;
FIG. 7 is a flowchart illustrating a process of obtaining a combined document according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In one aspect, referring to fig. 1, an embodiment of the present invention discloses a system for recording teaching processes, the system comprising: at least two clients and at least three servers, two clients are lecturer client 1 and learner client 5 respectively, and three servers are: a profile-shifting server 3, a document processing server 2 and an audio translation server 4;
the lecturer client 1 is used for uploading pictures, documents and video data related to teaching, and is also used for collecting audio information and document page display information in the course of teaching;
the document transferring server 3 is used for transferring the document data uploaded to the lecturer client 1 to generate corresponding document picture data;
the audio translation server 4 is used for performing audio translation on the audio information acquired by the instructor client 1 to obtain a corresponding translation sentence;
the document processing server 2 is used for performing segmentation processing on the translated sentences obtained by the audio translation server 4, performing redundancy cleaning processing on document page display information, integrating the processed character paragraphs, the processed document page display information, document picture data generated by the translation server 3, and pictures and video data uploaded to the instructor client 1 to obtain a combined document, and storing and sharing the combined document with two-dimensional codes;
the learner client 5 is used for linking to the document processing server 2 according to the two-dimension code information and playing and displaying the combined document content.
Referring to FIG. 2, in one particular embodiment, the document processing server 2 includes:
the receiving module 21 is configured to receive pictures, documents and video data related to teaching uploaded by the lecturer client 1, and receive audio information and document page display information of a teaching process acquired by the lecturer client 1;
the document processing module 22 is used for uploading the document data to the document-transferring server 3 and receiving the document picture data returned by the document-transferring server 3;
the audio processing module 23 is configured to upload audio information to the audio translation server 4, and receive a translated sentence returned by the audio translation server 4;
a segmenting module 24, configured to segment the translated sentence obtained by the audio translation server 4;
the redundancy cleaning module 25 is used for removing the redundant document pages according to the retention time of the document pages and the number of the meaningful characters during the document page display period;
the document combination module 26 is configured to integrate the text paragraphs, the processed document page display information, the document picture data generated by the document transfer server, and the picture and video data uploaded to the instructor client 1 to obtain a combined document;
a database 27 for storing the combined document;
the sharing module 28 is configured to generate a two-dimensional code corresponding to the combined document, and share a two-dimensional code picture to the learner client 5;
and the link module 29 is used for linking to the database 27 to provide a combined document display service for the learner client 5 when receiving a two-dimensional code information acquisition request sent by the learner client 5.
In a specific embodiment, the document processing server 2 further includes an editing module 20, and the editing module 20 is configured to perform custom editing on the translated sentence received by the audio processing module 23.
It can be seen from the above that, the embodiment of the present invention discloses a system for recording a lecture process, which integrates various resources such as audio, text, figures, video, etc. for lecture, and is convenient for learners to look up, and the resources for recording the lecture process are highly integrated and are not scattered, so that the transmission is more convenient, and meanwhile, the system can be embedded into the existing intelligent terminal device for use, and is low in cost and more suitable for popularization and application.
On the other hand, referring to fig. 3, the embodiment of the present invention further discloses a method for recording teaching process, which includes the following steps:
s1, uploading picture, document and video data related to teaching, and collecting audio information and document page display information in the teaching process;
s2, transferring the uploaded document data to generate corresponding document picture data;
s3, carrying out audio translation on the audio information acquired by the instructor client to obtain a corresponding translation sentence;
s4, carrying out segmentation processing on the translation sentences;
s5, performing redundancy cleaning processing on the document page display information;
and S6, integrating the processed text paragraphs, the processed document page display information, the document picture data, the uploaded picture and the uploaded video data to obtain a combined document, and storing and sharing the combined document by the two-dimension code.
In some embodiments, the translated sentence may be edited. In consideration of the situation that the lecturer Mandarin is not standard, the translated sentence after audio translation may have wrong contents, and after editing, the accuracy rate of characters can be increased.
Referring to fig. 4, in a specific embodiment, the segmenting process of the translation sentence in step S4 specifically includes the following steps:
s41, analyzing each sentence in the translated sentence one by one, and judging a split sentence existing in the translated sentence;
s42, segmenting the translation sentence according to the position of the split sentence.
Referring to fig. 5, in a specific embodiment, the step S41 of determining the split sentence existing in the translation sentence specifically includes the following steps:
s411, marking the finishing sentence in the translated sentence;
s412, judging whether the interval duration between the calibrated finishing sentence and the previous sentence is more than 2 times of the preset average interval duration of the sentences one by one, and extracting the sentences meeting the time interval condition;
s413, judging whether a document page display action exists in the sentence starting process meeting the time interval condition, and extracting the sentence with the document page display action;
and S414, judging whether the number of the sentences spaced between the sentence with the document page display action and the last split sentence is more than 6 sentences or not, if so, judging that the sentence is a split sentence, otherwise, judging that the sentence is a common sentence. The sentence number threshold set here is an empirical threshold, and is an optimal value obtained through a plurality of tests.
Specifically, in the process of calibrating the finishing sentence in the translation sentence, the judgment basis of the finishing sentence is as follows: a sentence ends with a period, exclamation point, or question mark.
Referring to fig. 6, in a specific embodiment, the performing of the redundancy clearing process on the document page display information in step S5 specifically includes the following steps:
s51, comparing the display time of each document page in the document page display process with a preset time threshold value of 1.5 seconds one by one, finding out document pages with the display time of less than 1.5 seconds and removing the document pages;
s52, judging whether the corresponding translation sentence in the display period of each document page has meaningful characters or not, and if not, rejecting the corresponding document page.
In particular, meaningful words are subjects or nouns in sentences.
Referring to fig. 7, in a specific embodiment, the process of obtaining the combined document in step S6 specifically includes the following steps:
s61, circularly displaying each document page, finding out corresponding paragraphs within the retention time of each document page from the text paragraphs, and inserting the document page behind the corresponding paragraphs in a new paragraph form;
s62, the audio is split according to each paragraph in the text paragraphs and is associated with the corresponding paragraph.
It can be seen from the above that, the embodiment of the present invention discloses a method for recording a lecture process, the method collects audio in the lecture process of an instructor, translates the audio into text information, and integrates the text information with other uploaded lecture-related documents, pictures or videos to obtain lecture materials integrated with various resources, a learner can look up the document and video information through the materials, and can also play audio corresponding to the document, the lecture resources recorded by the method are more convenient for the learner to look up and learn, and are more convenient and faster.
The following gives a general introduction to the flow of the practical application process of the method for recording the teaching process disclosed in the above embodiments:
1. the instructor first uploads in advance the pictures, documents (pdf, ppt or word) and video required for the teaching process. Wherein, the document (pdf, ppt or word) is preprocessed into pictures, and each page of the document is processed into a picture;
2. the lecturer uses a mobile device (such as a mobile phone) to perform lecturing, and projects a document page to a large screen (such as a television, a spliced screen or a computer screen) while talking, and the mobile device (the mobile phone) collects document page display information and audio;
3. after the instructor completes the instruction, the mobile equipment (mobile phone) uploads the collected document page display information and audio to a document processing server;
4. after receiving the processing data, the document processing server firstly delivers the audio to the audio translation server to translate the audio into characters;
5. segmenting text returned from the audio translation server:
a) Judging whether a document page is displayed during the sentence period, if so, marking as 'splitting sentence'
b) Calculating the multiple of the interval between the current sentence and the next sentence and the average interval duration, wherein the value of the first sentence is 0, and if the multiple exceeds 2, the first sentence is marked as a 'splitting sentence';
c) And judging whether the sentence is a final sentence or not, and if not, canceling the sign of 'splitting the sentence'. If the sentence has the document page display, marking the next finishing sentence as a split sentence;
d) Judging whether the interval between a sentence and the last split sentence exceeds 6 sentences, if so, marking the sentence as the split sentence;
e) Segmenting all sentences according to names marked as 'splitting sentences' in the sentences, wherein the 'splitting sentences' sentences are used as the last sentences of the paragraphs;
6. and (3) removing redundancy of the document page display:
a) Calculating the dwell time of each document page display by comparing the dwell time with the time of the upper page and the lower page;
b) Calculating meaningful characters (main language and noun are reserved) in each document page period from the character sentences;
c) Judging the display of each document page, and if the retention time is less than 1.5 seconds or no meaningful characters exist, deleting the document pages;
7. inserting a document page presentation into a paragraph:
a) Circulating each document page display, finding out each paragraph in the stay time of each document page, and inserting the paragraph behind the paragraph as a new paragraph;
8. splitting the audio according to paragraphs, and associating the audio with the corresponding paragraphs;
9. storing the document page display, the text paragraphs and the audio frequency into a database in a fixed format;
and finally, returning the document to the instructor in a two-dimensional code mode.
Specifically, three servers are involved in this embodiment: the document conversion server 3, the document processing server 2 and the audio translation server 4 may be a server cluster, and may include: the system comprises a front-end gateway server cluster, a connection server cluster, a core service server cluster, a database service cluster and a file server; wherein: the system comprises a front-end gateway server cluster, a front-end gateway server cluster and a front-end gateway server cluster, wherein the front-end gateway server cluster is respectively connected with at least 1 client, such as a lecturer client and a core service server cluster; the server is used for forwarding the request of the client and returning the response of the server to the corresponding client;
the connection server cluster is used for processing the service request acceptance of the client, the establishment of a connection session, the maintenance and the interruption of service; the core service server cluster is used for authenticating user login, verifying user authority, issuing, pushing, responding and implementing logics required to be executed, and performing read-write operation on the database if necessary; the database cluster is used for persistently storing all data of the intelligent management system; and the file server is used for storing all files of the intelligent experiment management system.
The connecting server cluster may further include: the PC is connected with the server cluster and the mobile terminal is connected with the server cluster; the PC connection server cluster is used for providing service for a client running on the PC; the mobile terminal connection server cluster is used for providing service for the client running on the mobile terminal. Clustering operation can reduce the number of single-point failures, and high availability of clustered resources and load balancing are realized. The embodiment of the disclosure does not limit the network connection and hardware configuration between the servers.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed in the embodiment corresponds to the method disclosed in the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A system for recording a teaching process, comprising: the system comprises at least two clients and at least three servers, wherein the two clients are a lecturer client and a learner client respectively, and the three servers are respectively: the system comprises a file transfer server, a document processing server and an audio translation server;
the lecturer client is used for uploading pictures, documents and video data related to teaching, and is also used for collecting audio information and document page display information in the teaching process;
the file transferring server is used for transferring the document data uploaded to the lecturer client to generate corresponding document picture data;
the audio translation server is used for performing audio translation on the audio information acquired by the instructor client to obtain a corresponding translation sentence;
the document processing server is used for performing segmented processing on the translated sentences obtained by the audio translation server, performing redundant cleaning processing on document page display information, integrating the processed text paragraphs, the processed document page display information, document picture data generated by the translation server and picture and video data uploaded to the lecturer client to obtain a combined document, and storing and sharing the combined document with the two-dimensional code;
the learner client is used for linking to the document processing server according to the two-dimension code information and playing and displaying the combined document content.
2. A system for recording a teaching process according to claim 1, wherein the document processing server includes:
the receiving module is used for receiving pictures, documents and video data which are uploaded by the lecture client and related to teaching, and receiving audio information and document page display information of the lecture process, which are acquired by the lecturer client;
the document processing module is used for uploading the document data to the file transfer server and receiving document picture data returned by the file transfer server;
the audio processing module is used for uploading the audio information to the audio translation server and receiving a translation sentence returned by the audio translation server;
the segmentation module is used for segmenting the translated sentence obtained by the audio translation server;
the redundancy cleaning module is used for removing redundant document pages according to the retention time of the document pages and the number of the meaningful characters during the document page display period;
the document combination module is used for integrating character paragraphs, the processed document page display information, document picture data generated by the file transfer server, and pictures and video data uploaded to the lecturer client to obtain a combined document;
a database for storing the combined document;
the sharing module is used for generating a two-dimensional code corresponding to the combined document and sharing the two-dimensional code picture to the learner client;
and the link module is used for linking to the database when receiving a two-dimensional code information acquisition request sent by the learner client and providing a combined document display service for the learner client.
3. A system for recording a teaching process according to claim 2, wherein the document processing server further comprises an editing module for custom editing the translated sentence received by the audio processing module.
4. A method of recording a teaching process, comprising the steps of:
uploading pictures, documents and video data related to teaching, and acquiring audio information and document page display information in the teaching process;
transferring the uploaded document data to generate corresponding document picture data;
performing audio translation on audio information acquired by a teacher client to obtain a corresponding translated sentence;
carrying out segmentation processing on the translated sentence;
carrying out redundancy cleaning processing on the document page display information;
and integrating the processed text paragraphs, the processed document page display information, the document picture data, the uploaded picture and the uploaded video data to obtain a combined document, and storing and sharing the combined document by the two-dimension code.
5. The method of claim 4, wherein the step of segmenting the translated sentence comprises the steps of:
analyzing each sentence in the translated sentence one by one, and judging a split sentence existing in the translated sentence;
and segmenting the translation sentences according to the positions of the split sentences.
6. The method of claim 5, wherein the step of determining the existence of a split sentence in a translated sentence comprises the following steps:
calibrating a finishing sentence in a translated sentence;
judging whether the interval duration of the marked finishing sentence and the last sentence is greater than the preset multiple of the average interval duration of the sentences one by one, and extracting the sentences meeting the time interval condition;
judging whether a document page display action exists in the sentence starting process meeting the time interval condition, and extracting the sentences with the document page display action;
judging whether the number of sentences spaced between the sentence with the document page display action and the last split sentence is larger than a preset sentence number threshold value or not, if so, judging the sentence to be a split sentence, otherwise, judging the sentence to be a common sentence.
7. A method according to claim 6, wherein in the process of marking the ending sentence in the translation sentence, the ending sentence is determined according to the following: a sentence ends with a period, exclamation point, or question mark.
8. The method for recording teaching process according to claim 4, wherein the redundancy cleaning process is performed on the document page display information, specifically comprising the following steps:
comparing the display time of each document page with a preset time threshold value one by one in the document page display process, finding out document pages with the display time less than the time threshold value and removing the document pages;
and judging whether the corresponding translation sentences in the display period of each document page have meaningful characters or not, and if not, rejecting the corresponding document pages.
9. A method of recording a teaching process according to claim 8, wherein the meaningful words are subjects or nouns in sentences.
10. A method of recording a teaching process according to claim 4, wherein the process of obtaining a combined document includes the following steps:
circularly displaying each document page, finding out corresponding paragraphs within the retention time of each document page from the text paragraphs, and inserting the document page behind the corresponding paragraphs in a new paragraph form;
and splitting the audio according to each paragraph in the text paragraphs, and associating the audio with the corresponding paragraph.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910550283.XA CN110275860B (en) | 2019-06-24 | 2019-06-24 | System and method for recording teaching process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910550283.XA CN110275860B (en) | 2019-06-24 | 2019-06-24 | System and method for recording teaching process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110275860A CN110275860A (en) | 2019-09-24 |
| CN110275860B true CN110275860B (en) | 2022-12-27 |
Family
ID=67962293
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910550283.XA Active CN110275860B (en) | 2019-06-24 | 2019-06-24 | System and method for recording teaching process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110275860B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112087656B (en) * | 2020-09-08 | 2022-10-04 | 远光软件股份有限公司 | Online note generation method and device and electronic equipment |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106485964A (en) * | 2016-10-19 | 2017-03-08 | 深圳市鹰硕技术有限公司 | A kind of recording of classroom instruction and the method and system of program request |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130145241A1 (en) * | 2011-12-04 | 2013-06-06 | Ahmed Salama | Automated augmentation of text, web and physical environments using multimedia content |
-
2019
- 2019-06-24 CN CN201910550283.XA patent/CN110275860B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106485964A (en) * | 2016-10-19 | 2017-03-08 | 深圳市鹰硕技术有限公司 | A kind of recording of classroom instruction and the method and system of program request |
Non-Patent Citations (1)
| Title |
|---|
| PPT录制型微课在病理学教学中的设计与实践;李建民等;《卫生职业教育》;20170531(第10期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110275860A (en) | 2019-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11151892B2 (en) | Internet teaching platform-based following teaching system | |
| CN109275046B (en) | Teaching data labeling method based on double video acquisition | |
| WO2018227761A1 (en) | Correction device for recorded and broadcasted data for teaching | |
| US20200286396A1 (en) | Following teaching system having voice evaluation function | |
| US8645121B2 (en) | Language translation of visual and audio input | |
| KR20170030297A (en) | System, Apparatus and Method For Processing Natural Language, and Computer Readable Recording Medium | |
| CN110166818B (en) | Method for generating audio/video to be matched, computer equipment and storage medium | |
| JP2017037588A (en) | Information processor and information processing program | |
| WO2019019406A1 (en) | Teaching recording data updating device | |
| CN113035199B (en) | Audio processing method, device, equipment and readable storage medium | |
| CN111225172A (en) | Training terminal based on cloud service | |
| JP5505989B2 (en) | Writing support apparatus, writing support method, and program | |
| US9525896B2 (en) | Automatic summarizing of media content | |
| CN112581965A (en) | Transcription method, device, recording pen and storage medium | |
| CN110275860B (en) | System and method for recording teaching process | |
| CN109862375B (en) | Cloud recording and broadcasting system | |
| CN112528799B (en) | Teaching live broadcast method and device, computer equipment and storage medium | |
| KR20190108467A (en) | System for Instructional visual content using Automatically convert images from electronic documents | |
| KR20110047389A (en) | Method and system for learning contents | |
| WO2005038683A1 (en) | Language education system, language education method and language education program recorded media based on corpus retrieval system, which use the functions of questions and answers | |
| CN109889916B (en) | Application system of recorded broadcast data | |
| CN112699687A (en) | Content cataloging method and device and electronic equipment | |
| TWI656448B (en) | Topic providing apparatus and could file prompting method thereof | |
| CN111312260A (en) | Human voice separation method, device and equipment | |
| CN111179648A (en) | Multimedia courseware making platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |