CN117874279A - Content positioning method, device and storage medium - Google Patents

Abstract

The application discloses a content positioning method, a content positioning device and a storage medium, wherein the method comprises the following steps: detecting a preset operation of a user on a current interface aiming at a target explanation carrier; the time position of the explanation content related to the preset operation in the target explanation carrier is determined. According to the scheme, the specified explanation content can be positioned rapidly and accurately.

Description

Content positioning method, device and storage medium

Technical Field

The present disclosure relates to the field of data processing technologies, and in particular, to a content positioning method and apparatus, and a storage medium.

Background

In the prior art, in order to facilitate students to consolidate and improve teaching knowledge, teachers usually record the explanation of problems in a classroom and send recorded explanation videos of problems to students. After a teacher sends the problem explanation video to students, when the students review the recorded explanation video, the students usually have longer recorded explanation time, and the teacher does not do any clipping treatment on the video after finishing recording, so that the students frequently search for the video content to be reviewed by repeatedly fast forwarding or reversing in order to listen to a problem or an unintelligible problem solving process of a problem, the learning efficiency of the students is greatly reduced, the learning enthusiasm is also greatly reduced, and the construction and the learning growth of a student knowledge system are not facilitated.

Based on the description of the above phenomena, the analysis reasons can find that the learning efficiency and learning enthusiasm of students are greatly reduced because the recorded video can not accurately locate the content of the comment when looking back.

Disclosure of Invention

The application provides at least one content positioning method, device and storage medium, which can rapidly and accurately position the specified explanation content.

The first aspect of the application provides a content positioning method, which comprises the following steps: detecting a preset operation of a user on a current interface aiming at a target explanation carrier, wherein the target explanation carrier is an explanation video or audio related to one or more problems, and the preset operation comprises at least one of a problem switching operation of an explanation person in the process of recording the target explanation carrier and a specified operation of a learner on local explanation content of the problems in the target explanation carrier; and determining the time position of the explanation content related to the preset operation in the target explanation carrier, wherein the explanation content related to the problem switching operation is the explanation content of each problem related to the problem switching operation, the explanation content related to the specified operation is the specified local explanation content, and the time position is used for searching the explanation content related to the preset operation from the target explanation carrier and providing the explanation content to a learner.

The target explanation carrier comprises a total explanation carrier recorded in the process that an interpreter explains a plurality of problems one by one, and the preset operation is a problem switching operation; determining a time position of the explanation content related to the preset operation in the target explanation carrier comprises: based on the occurrence time of the problem switching operation, determining the segmentation time position of the adjacent problems before and after the problem switching operation in the total explanation carrier, wherein the segmentation time position is used for segmenting the total explanation carrier into the problem explanation carrier corresponding to each problem, the problem explanation carrier is video or audio when the total explanation carrier is video, and the problem explanation carrier is audio when the total explanation carrier is audio.

Wherein after determining the time position of the explanation content related to the preset operation in the target explanation carrier, the method further comprises: based on the dividing time positions of the adjacent questions of each group, the total explanation carrier is divided into question explanation carriers corresponding to the questions respectively, and the question explanation carriers are used for providing the learner.

After the total explanation carrier is divided into the problem explanation carriers corresponding to the problems respectively based on the dividing time positions of the adjacent problems of each group, the method further comprises any one or more steps of: a plurality of question explanation carriers which belong to the same question are responded, and the plurality of question explanation carriers which belong to the same question are combined; and packaging the problem explanation carriers of all the problems under the general explanation carrier into the same folder, and providing the folder for learners.

The current interface comprises an explanation interface, the total explanation carrier is obtained by recording a plurality of questions by using the explanation interface by an explanation person, the total explanation carrier is used for recording at least the explanation interface and the sound of the explanation person when the total explanation carrier is a video, and the total explanation carrier is used for recording the sound of the talkback person when the total explanation carrier is an audio; the explanation interface comprises a question area, a question stem area and an explanation area, wherein the question area is used for displaying a plurality of questions, the question stem area is used for displaying the questions of the current explanation, and the explanation area is used for providing explanation contents for an explanation person to write the questions in the question stem area.

At least one of the question stem area and the explanation area has at least one of the following blackboard writing functions: changing the current display content in the area in a clicking mode, changing the current display content in the area in a sliding mode, zooming the current display content in the area, handwriting writing, handwriting erasing, handwriting selection, handwriting withdrawal, handwriting recovery and font size adjustment; and/or the stem region also has the function of transforming handwriting along with the problem content in the stem region.

Wherein the method further comprises any one or more of the following steps: detecting an area adjustment operation, and adjusting a local area of the question stem area selected by a user to be an explanation area, or adjusting a local area of the explanation area selected by the user to be a question stem area; detecting triggering operation of a preset blackboard writing function of a question stem area or an explanation area, and recording occurrence time of the preset blackboard writing function, wherein the occurrence time of the preset blackboard writing function is used for checking whether the time position of the local explanation content of the current explanation problem is correct; and/or before detecting the preset operation of the user on the target explanation carrier at the current interface, the method further comprises the following steps: performing problem segmentation on the problem file image to be explained to obtain a plurality of problems contained in the problem file image; in response to an instruction to explain the problem volume image, an explanation interface is displayed, and a problem area of the explanation interface displays a plurality of problems contained in the problem volume image.

The current interface comprises an explanation interface, wherein the general explanation carrier is obtained by recording a plurality of questions by an explanation person by utilizing the explanation interface, and the explanation interface comprises a question area used for displaying the plurality of questions; the detecting of the preset operation of the user on the current interface aiming at the target explanation carrier comprises the following steps: detecting an operation to reselect a question in the question area; or detecting triggering operation of switching the theme icons in the intercom solution interface.

Wherein the current interface comprises an explanation interface, the method further comprising: detecting triggering operation of a first video recording icon of an intercom explanation interface, recording a screen of a current explanation interface, and collecting environmental audio to form video content in a total explanation carrier; or detecting triggering operation of a second video recording icon of the intercom explanation interface, recording a screen of the current intercom explanation interface, and starting a camera to pick up the video of the intercom to form video content in the total intercom carrier; or detecting triggering operation of an audio recording icon of the intercom interpretation interface, and collecting environmental audio to form audio content of the total interpretation carrier; and detecting triggering operation of stopping recording icons of the intercom interpretation interface, and generating a total interpretation carrier by utilizing all video content or audio content formed in the recording process.

The target explanation carrier comprises a problem explanation carrier corresponding to the target problem, and explanation contents written by an explanation person in an explanation area of a target problem explanation interface are recorded in the problem explanation carrier, and the preset operation comprises the appointed operation of a learner on the local explanation contents of the target problem; the detecting of the preset operation of the user on the current interface aiming at the target explanation carrier comprises the following steps: detecting a local area in an explanation area of a user-specified target problem; determining a time position of the explanation content related to the preset operation in the target explanation carrier comprises: and searching the initial handwriting generating time and the final handwriting generating time of the appointed local area from the problem explanation carrier corresponding to the target problem, and taking the initial handwriting generating time and the final handwriting generating time as the time positions of the local explanation content related to the appointed operation in the problem explanation carrier of the target problem.

The current interface comprises a learning interface, the learning interface is currently used for playing a problem explanation carrier of a target problem and displaying an explanation overview chart of the target problem, the explanation overview chart comprises a question stem area and an explanation area, the content of the target problem is displayed in the question stem area, and the explanation area displays the explanation content of the target problem by an explanation person; detecting a local area in an explanation area of a user-specified target question, comprising: and detecting the circling operation of the explanation area of the intercom explanation overview by the user.

Wherein the method further comprises: responding to a learning instruction of a target problem, and displaying a learning interface; providing an operation icon of a problem explanation carrier of the target problem on a learning interface, wherein the operation icon comprises a play icon and a pause icon, triggering operation of the operation icon is detected, and an operation corresponding to the operation icon is executed on the problem explanation carrier of the target problem; and/or displaying the explanation overview of the target problem on the learning interface under the condition that the problem explanation carrier of the target problem does not start playing, pause playing or end playing.

Wherein before the learning interface is displayed in response to the learning instruction for the target problem, further comprising: detecting opening operation of a folder corresponding to a problem file, and displaying a thumbnail icon corresponding to a problem explanation carrier of each problem in the folder; detecting a selection operation of one of the questions in the folder, taking the selected question as a target question, and generating a learning instruction of the target question.

The method comprises the steps of finding out the initial handwriting generation time and the final handwriting generation time of a designated local area from a problem interpretation carrier corresponding to a target problem, and taking the initial handwriting generation time and the final handwriting generation time as the time positions of local interpretation contents related to designated operation in the problem interpretation carrier of the target problem, wherein the method further comprises any one or more of the following steps: reading an interpretation reference time of the target problem from the recorded data, the interpretation reference time including at least one of: the method comprises the steps that the audio frequency existing time of a target problem and the occurrence time of a preset board writing function of the target problem are the time when sound appears in a problem explanation carrier of the target problem, and the occurrence time of the preset board writing function of the target problem is the time when an interpreter uses the preset board writing function for a question stem area or an explanation area of the target problem in the process of recording the problem explanation carrier of the target problem; using the explanation reference time of the target problem to test the time position of the local explanation content in the problem explanation carrier of the target problem; and playing the carrier part of the target problem according to the corresponding time position of the local explanation content in the problem explanation carrier.

A second aspect of the present application provides an electronic device, including a memory and a processor coupled to each other, where the processor is configured to execute program instructions stored in the memory, so as to implement the content positioning method in the first aspect.

A third aspect of the present application provides a computer readable storage medium having stored thereon program instructions which, when executed by a processor, implement the content locating method of the first aspect described above.

According to the technical scheme, on one hand, the interpreter can determine the time position of the explanation content of each problem related to the problem switching operation in the target explanation carrier according to the problem switching operation in the process of recording the explanation video or the explanation audio of the problem, so that the time position of each problem in the target explanation carrier is distinguished, the learner can conveniently position the explanation content of each problem, and the learning efficiency is improved; on the other hand, the learner can search the explanation content corresponding to the appointed operation from the target explanation carrier according to the appointed operation of the learner on the local explanation content of the problem in the target explanation carrier in the current interface, and provide the explanation content for the learner to learn, so that the explanation content to be learned by the learner can be accurately positioned, the use experience of the user can be improved, and the learning efficiency can be improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and, together with the description, serve to explain the technical aspects of the application.

FIG. 1 is a flow chart of an embodiment of a method for locating content of the present application;

FIG. 2 is a schematic diagram of a framework of one embodiment of an interface according to the teachings of the present application;

FIG. 3 is a schematic diagram of a framework of one embodiment of a learning interface of the present application;

FIG. 4 is a schematic diagram of a framework of an embodiment of the electronic device of the present application;

FIG. 5 is a schematic diagram of a framework of one embodiment of a computer readable storage medium of the present application.

Detailed Description

The following describes the embodiments of the present application in detail with reference to the drawings.

In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, interfaces, techniques, etc., in order to provide a thorough understanding of the present application.

The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship. Further, "a plurality" herein means two or more than two. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

Referring to fig. 1, fig. 1 is a flow chart illustrating an embodiment of a positioning method according to the present disclosure. Specifically, the method may include the steps of:

step S110: and detecting the preset operation of the user on the target explanation carrier at the current interface.

The target explanation carrier is video or audio of explanation about one or more questions, and the preset operation comprises at least one of a question switching operation of an explanation person in the process of recording the target explanation carrier and a specified operation of a learner on local explanation content of the questions in the target explanation carrier.

The content positioning method is mainly applied to the fields of teaching, meeting summary and the like, and the technical scheme in the application can be oriented to different users, and the different users have different operation authorities and operation interfaces, for example, the explanation interface is used by an explanation person, and the learning interface is used by a learner. Specifically, for the interpreter, the total interpretation carrier can be divided into a plurality of question interpretation carriers corresponding to questions according to the question switching operation in the process of recording the target interpretation carrier on the interpretation interface, wherein the question interpretation carrier can be an interpretation audio or an interpretation video. Similarly, the learner can specify the local explanation content of interest in the target explanation carrier in the learning interface, so that the local explanation content can be quickly and accurately positioned for learning. And the target explanation carrier recorded by the explanation can be audio content only comprising the explanation, or recording of an explanation interface and recording of surrounding environment audio. The learner-facing target explanation carrier may also include only audio content, or both video content and audio content. The target explanation video or the target explanation audio which the learner learns is based on the target explanation carrier recorded by the lecturer.

In some embodiments, when the current interface includes an explanation interface, the total explanation carrier is obtained by recording a plurality of questions by using the explanation interface by an explanation person, and in the case that the total explanation carrier is a video, the total explanation carrier records at least sounds of the explanation interface and the explanation person, and in the case that the total explanation carrier is an audio, the sounds of the explanation person are recorded.

For example, when the recorded total explanation carrier is video, the talkback person can simultaneously record contents such as notes written and annotated by the talkback person on the explanation interface and sound of the talkback person in the process of explaining the questions, and the recorded total final generated explanation interface video content and audio content of the sound of the talkback person are combined to obtain the total explanation carrier, so that the learner can better understand the explanation content of the questions, and the learning interest of the learner is improved.

For example, when the recorded general explanation carrier is video, the learning interest of the learner is improved, the distance between the learner and the instructor is shortened, and in the process of the instructor to explain a plurality of problems, the instructor can record contents such as note writing and annotation on the instructor's interface and record the voice of the instructor in the process of the problem, and the instructor can record the image by using the image pickup device.

For example, when the recorded total explanation carrier is audio, only the voice of the lecturer is recorded in the process of the lecturer explaining a plurality of questions, and the audio content of the lecturer voice is generated to be the total explanation carrier, so that the storage space of the total explanation carrier is reduced, and the quick transmission is facilitated.

It should be understood that the recorded content of the general lecture carrier may be recorded by the lecturer himself or herself, in addition to the lecturer interface and the sound of the lecturer, and is not particularly limited herein.

In addition, in the case that the general explanation carrier is a video, the recorded explanation interface includes a question area 210, a stem area 220, and an explanation area 230, referring to fig. 2, the question area 210 is used to display a plurality of questions, the stem area 220 is used to display a question of a current explanation, and the explanation area 230 provides an explanation to an explanation person to write explanation about the question in the stem area 220. At least one of the stem section 220 and the explanation section 230 in the explanation interface has at least one of the following blackboard writing functions: the method comprises the steps of changing current display content in an area in a clicking mode, changing the current display content in the area in a sliding mode, zooming the current display content in the area, handwriting writing, handwriting erasing, handwriting selecting, handwriting canceling, handwriting recovering and adjusting the font size. A function button is further disposed in the explanation interface, and clicking on the function button can hide the question area 210, so that the display contents of the question stem area 220 and the explanation area 230 are increased. In addition, clicking on the function button here hides the question area 210 to be displayed.

In particular, when the problem in the stem area 220 is long, the stem area 220 cannot completely display the problem, so the stem area 220 can be slid by clicking to display the problem hidden in the stem area 220 in a scrolling manner.

The handwriting selection is to select the explanation content in the explanation area 230, for example, a local area in the explanation content may be circled, or a coordinate range in the explanation area 230 may be input to select the explanation content, so that a specific implementation manner of handwriting selection is not limited specifically.

In addition, the stem region 220 also has a function of transforming handwriting following the problem contents in the stem region 220. For example, the lecturer can write or annotate the questions in the stem area 220 while the lecturer is teaching the questions, but the questions in the stem area 220 are too long to be completely displayed, so the lecturer can touch the stem area 220 and slide the stem area 220, so that the part of the questions hidden in the stem area 220 is displayed in a rolling manner, and the part of the questions written or marked by the lecturer can correspondingly move along with the rolling of the questions.

In some embodiments, where the overall explanation carrier is video, it includes recording the explanation interface to obtain the overall explanation carrier. Specifically, please continue to combine fig. 2, the leftmost AI (Artificial Intelligence ) video recording icon at the bottom of the explanation area 230 in fig. 2 is a first video recording icon, a triggering operation of the first video recording icon of the intercom interface is detected, a screen is recorded on the current explanation interface, and environmental audio is collected to form video content in the total explanation carrier, and then if a triggering operation of stopping recording the icon of the intercom interface is detected, the total explanation carrier is generated by using all the video content formed in the current recording process. The triggering operation may be a clicking operation.

In other embodiments, the recording of the intercom interpretation interface takes the form of video recording to obtain the overall interpretation carrier. Specifically, the explanation interface includes a video recording icon, the video recording icon is a second video recording icon, a triggering operation of the second video recording icon of the intercom interface is detected, a screen is recorded on the current explanation interface, a camera is started to pick up an image of an interpreter to form video content in the total explanation carrier, and then the total explanation carrier is generated by using all video content formed in the recording process if the triggering operation of the stopping recording icon of the intercom interface is detected. The triggering operation may be a clicking operation.

In other embodiments, if the general lecture carrier is audio, the lecturer's voice may be recorded. Specifically, please continue to combine fig. 2, the AI audio recording icon at the leftmost side of the bottom of the explanation area 230 in fig. 2 is an audio recording icon, the triggering operation of the audio recording icon of the intercom interface is detected, the environmental audio is collected to form the audio content of the general explanation carrier, and then the triggering operation of the stop recording icon of the intercom interface is detected, and the general explanation carrier is generated by using all the audio content formed in the recording process.

In some embodiments, to make full use of the explanation interface, the stem area 220 and the explanation area 230 in the explanation interface may be adjusted according to actual use situations. Upon detecting the region adjustment operation, a local region of the stem region 220 selected by the user is adjusted to be the explanation region 230, or a local region of the explanation region 230 selected by the user is adjusted to be the stem region 220.

Specifically, a user clicking or dragging operation of a button on the boundary of the stem region 220 adjacent to the lecture region 230 is detected to change the current display contents of the stem region 220 and the lecture region 230. With continued reference to fig. 2, when the user clicks and drags down a button on an adjacent boundary, the display content in the stem area 220 will increase, while the display content in the explanation area 230 will decrease; or when the user clicks a button on an adjacent boundary and drags it upward, the display content in the stem region 220 will decrease and the display content in the lecture region 230 will increase. It should be understood that, in addition to the vertical arrangement of the stem area 220 and the explanation area 230 in fig. 2, the stem area 220 and the explanation area 230 may also be arranged left and right, and accordingly, if the stem area 220 and the explanation area 230 are arranged left and right, the buttons on the adjacent boundaries of the stem area 220 and the explanation area 230 are moved left and right to change the current display contents in the stem area 220 and the explanation area 230, so the present invention is not limited in detail herein.

In addition, the triggering operation of the preset writing function of the stem area 220 or the explanation area 230 is detected, the occurrence time of the preset writing function is recorded, and the occurrence time of the preset writing function is used for checking whether the time position of the local explanation content of the problem of the current explanation is correct or not. For example, after detecting that the lecturer writes or annotates the handwriting in the stem area 220 or the lecture area 230 of the lecture interface, the system will automatically record the start time of the handwriting writing or annotating operation for subsequent time and position verification.

In some embodiments, the problem area 210 is configured to support a problem switch function to select, switch, and/or otherwise select a plurality of problems in the problem area 210. For example, the lecturer detects an operation of reselecting one question in the question area 210 to switch the question of the lecture in the process of using the lecture interface to lecture a plurality of questions and recording the lecture interface to obtain the total lecture carrier. Or, a triggering operation of a switching question icon in the intercom and interpretation interface is detected, and the switching question icon is used for switching to another question, specifically, please continue to refer to fig. 2, a "next question" icon is arranged at the leftmost side of the bottom of the intercom region 230 in fig. 2, the "next question" icon is the switching question icon, and the user clicks the "next question" icon, so that the intercom question is switched from the current question to the next question adjacent to the current question.

In some embodiments, before the lecturer speaks the question in the intercom interface, the question needs to be input into the system, so before detecting the preset operation of the user on the target lecture carrier in the current interface, the method further includes:

step S111: and carrying out problem segmentation on the problem file image to be explained to obtain a plurality of problems contained in the problem file image.

The problem volume image may be an image such as a test paper or a test question set, or may be text, and is not particularly limited herein.

In some embodiments, each question in the question volume image may be manually segmented, and the segmented questions may be entered into the lecture interface.

In other embodiments, OCR (Optical Character Recognition ) thematic techniques may be employed to segment individual questions in the question volume image and automatically enter the segmented questions into the lecture interface. It will be appreciated that the subject technology is not specifically defined herein.

Step S112: in response to an instruction to explain the problem volume image, an explanation interface is displayed, and a problem area of the explanation interface displays a plurality of problems contained in the problem volume image.

In some embodiments, after completing the problem segmentation on the problem volume image, the instructor may click on an instructor button in the system to begin instrumenting the problem volume image and display an instructor interface, where the problem area 210 of the instructor interface displays a plurality of problems contained in the problem volume image. Further, before the explanation is performed, the instructor can select the questions in the input system, after confirming the selected questions, the questions selected by the instructor are displayed in the question area 210 of the explanation interface, and the question area 210 supports sliding display of more questions, and supports clicking to switch the explanation questions.

In some embodiments, the current interface includes a learning interface, please refer to fig. 3 in combination, fig. 3 is a schematic diagram of a framework of an embodiment of the learning interface of the present application, where the learning interface is currently used to play a question explanation carrier of a target question, and display an explanation overview of the target question, the explanation overview includes a stem area 220 and an explanation area 230, the content of the target question is displayed in the stem area 220, the explanation area 230 displays the explanation content of the target question by an interpreter, and the operation of the learner to specify the local explanation content of the target question is a circle drawing operation of the explanation area 230 of the explanation overview. It should be understood that the explanation overview chart may further include the question area 210 in addition to the question area 220 and the explanation area 230, and thus, the area actually included in the explanation overview chart may be set according to the scale of the drawing or the use condition, and is not limited herein.

For example, when the learner detects that the learner uses the annotation function in the learning interface to speak the explanation area 230 in the overview chart to perform the drawing operation in the case where the question interpretation carrier is a video, the positioning of the local explanation contents in the explanation area 230 which is drawn by the drawing operation is started.

For another example, when the question explanation carrier is audio, the learning interface is currently used to play the question explanation audio of the target question, and displays an explanation overview of the target question, where the explanation overview includes a stem area 220 and an explanation area 230, and the content of the target question is displayed in the stem area 220, and the explanation area 230 displays the explanation content of the target question by the instructor, and when detecting that the learner performs the drawing operation on the local explanation content of the target question by using the annotating function in the learning interface, the learner starts to locate the local explanation audio content in the explanation area that is drawn by the drawing operation.

Step S120: the time position of the explanation content related to the preset operation in the target explanation carrier is determined.

The explanation content related to the question switching operation is the explanation content of each question related to the question switching operation, the explanation content related to the appointed operation is the appointed local explanation content, and the time position is used for searching the explanation content related to the preset operation from the target explanation carrier and providing the explanation content to a learner.

In some embodiments, when the current interface includes an explanation interface, the target explanation carrier includes a total explanation carrier recorded in a process that an interpreter carries out one-by-one explanation on a plurality of questions, the total explanation carrier is recorded by the talkback interface, the preset operation is a question switching operation, and then based on an occurrence time of the question switching operation of the interpreter, a dividing time position of an adjacent question before and after the question switching operation in the total explanation carrier is determined, where the dividing time position is used to divide the total explanation carrier into question explanation carriers corresponding to each question, where in a case that the total explanation carrier is a video, the question explanation carrier is a video or an audio, and in a case that the total explanation carrier is an audio, the question explanation carrier is an audio.

For example, when the target explanation carrier is a video, the intercom interface is used for recording, in the process that the lecturer is explaining the questions in the question area 210, after the explanation of one question is completed, the lecturer can click on the remaining questions in the question area 210, the question is selected as the next question for explanation, the clicking operation is a question switching operation, and the clicking operation is used as the dividing time position of the adjacent questions of the front and rear explanation, so that the total explanation video can be divided into question explanation videos corresponding to the questions through the clicking operation.

For example, when the target explanation carrier is audio, the voice of the lecturer is collected, the lecturer can still operate at the explanation interface, and the lecturer can also operate as a question switching operation according to the clicking operation of the lecturer in the question area 210, and the clicking operation is used as the dividing time position of the adjacent questions of the front and rear explanation, so that the total explanation audio can be divided into the question explanation audio corresponding to each question through the clicking operation.

In some embodiments, after determining the time position of the lecture content related to the preset operation in the target lecture video, the total lecture carrier is split into question lecture carriers corresponding to the plurality of questions respectively, based on the split time positions of the respective sets of adjacent questions in the question area 210 of the lecture interface, the question lecture carriers being used for providing to the learner. The resulting question explanation carrier is sent to the learner. Under the condition that the total explanation carrier is a video, the total explanation carrier can be divided into problem explanation videos corresponding to a plurality of problems respectively, and the problem explanation videos are sent to learners; under the condition that the total explanation carrier is audio, the total explanation carrier can be divided into problem explanation audio corresponding to a plurality of problems respectively, and the problem explanation audio is sent to a learner.

In some embodiments, considering that the lecturer has some similar problems in the explanation process of the problems, the lecturer can compare the back and forth switching when explaining the problems, which also results in that the same problem in the multiple problem explanation carriers is divided into multiple videos in the overall explanation carrier, so that multiple problem explanation carriers belonging to the same problem can be combined. Each question can be marked according to the dividing time position of the adjacent questions, and each mark has uniqueness, so that a plurality of question explanation carriers with the same mark can be combined. In order to facilitate the learner to quickly find out the required problem explanation carrier, the problem explanation carrier of each problem under the total explanation carrier can be packaged into the same folder, and the folder is provided for the learner.

In addition, in the case where the general explanation carrier is a video, the explanation video data of each question under the general explanation carrier may be packaged into the same folder, and the folder may be provided to the learner. Or when the general explanation carrier is audio, the explanation audio data of each problem under the general explanation carrier is packaged into one folder and sent to the learner. Or, in the case that the total explanation carrier is video, the explanation content of each problem under the total explanation carrier is divided into explanation audio data and explanation video data, so that one explanation audio data and one explanation video data corresponding to the same problem are corresponding to each problem, so that the explanation audio data corresponding to all the problems under the total explanation carrier are packaged into one folder, the explanation video data corresponding to all the problems under the total explanation carrier are packaged into another folder, and the two folders are simultaneously sent to a learner for the learner to select.

In some embodiments, the target explanation carrier includes a problem explanation carrier corresponding to the target problem, in which explanation contents written by the instructor in the explanation area 230 of the explanation interface of the target problem are recorded, and the preset operation includes a specific operation of the learner on the local explanation contents of the target problem. After receiving the file folder packed by the problem explanation carrier, the learner can select and play the problems in the file folder. Specifically, an opening operation of a folder corresponding to a problem file is detected, and a thumbnail icon corresponding to a problem explanation carrier of each problem in the folder is displayed, where the problem file may be a test paper or a problem set, and the thumbnail icon may be a reduction of a screenshot of a target problem corresponding to the problem explanation carrier in the question stem area 220 and the explanation area 230 of the explanation interface. Then, the system detects a selection operation of one of the questions in the folder, takes the selected question as a target question, and generates a learning instruction of the target question. In response to a learning instruction for a target problem, displaying a learning interface, providing an operation icon of a problem interpretation carrier of the target problem on the learning interface, wherein the operation icon comprises a play icon and a pause icon, detecting a triggering operation of the operation icon, and executing an operation corresponding to the operation icon on the problem interpretation carrier of the target problem.

In addition, when the question explanation carrier of the target question does not start playing, pause playing, or end playing, an explanation overview of the target question is displayed on the learning interface.

When the target explanation carrier is a video, the target explanation carrier includes a question explanation video corresponding to the target question, and the question explanation video records the explanation content written by the lecturer in the explanation area 230 of the explanation interface of the target question. After receiving the folders packed by the problem explanation videos, the learner can play the problem which is not selected in the folders, a learning interface is displayed after selection confirmation, the learning interface comprises a play icon and a pause icon so as to play and pause the problem explanation videos, and under the condition that the problem explanation videos do not start to play, pause to play or end to play, an explanation overview of the target problem is displayed on the learning interface.

Under the condition that the target explanation carrier is audio, the target explanation carrier comprises problem explanation audio corresponding to the target problem, and audio content for explaining the target problem by an interpreter is recorded in the problem explanation video. After receiving the file folder packed by the problem explanation audio, the learner can play the problem which is not selected in the file folder, the learning interface is displayed after the selection is confirmed, the learning interface comprises a play icon and a pause icon to play and pause the problem explanation audio, and the explanation overview of the target problem is displayed on the learning interface under the condition that the problem explanation audio does not start to play, pause to play or end to play.

In some embodiments, after the learner enters the learning interface and detects a local area in the interpretation area of the target question specified by the user, the initial handwriting generating time and the final handwriting generating time of the specified local area are searched out from the question interpretation carrier corresponding to the target question, and the initial handwriting generating time and the final handwriting generating time are used as the time positions of the local interpretation content related to the specified operation in the question interpretation carrier of the target question.

In some embodiments, in order to avoid inaccuracy problems such as content missing caused by the fact that the time position of the local explanation content related to the specified operation in the target problem does not match the actual time position in the explanation carrier, the obtained time position needs to be checked, and the checked reference data is an explanation reference time for reading the target problem from the record data, where the explanation reference time includes at least one of the following: the audio frequency existing time of the target problem and the occurrence time of the preset writing function of the target problem are the time when the audio frequency of the target problem occurs in the problem explanation carrier, and the occurrence time of the preset writing function of the target problem is the time when an interpreter uses the preset writing function for a question stem area or an explanation area of the target problem in the process of recording the problem explanation carrier of the target problem.

And then, checking the time position of the local explanation content in the problem explanation carrier of the target problem by using the explanation reference time of the target problem. And according to the corresponding time position of the local explanation content, playing the carrier part of the local explanation content in the problem explanation carrier of the target problem.

For example, when the problem interpretation carrier is a video, if the verification result is that the time position of the local interpretation content in the problem interpretation video of the target problem is the same as the interpretation reference time, playing the video part related to the local interpretation content in the problem interpretation video of the target problem according to the time position corresponding to the local interpretation content; if the verification results are different, according to the explanation reference time, the video part of the local explanation content in the problem explanation video of the playing target problem is displayed.

For example, when the problem interpretation carrier is audio, in order to avoid inaccurate problems such as content missing caused by the fact that the time position of the local interpretation content related to the specified operation in the problem interpretation audio of the target problem is not coincident with the actual time position, the obtained time position needs to be checked, and the checked reference data is the interpretation reference time for reading the target problem from the recording data, and the interpretation reference time includes the audio existence time of the target problem.

And then, checking the time position of the local explanation content in the problem explanation audio of the target problem by using the explanation reference time of the target problem. If the verification result is that the time position of the local explanation content in the problem explanation audio of the target problem is the same as the explanation reference time, playing an audio part related to the local explanation content in the problem explanation audio of the target problem according to the time position corresponding to the local explanation content; if the verification results are different, according to the explanation reference time, the audio part of the local explanation content in the problem explanation audio of the playing target problem is displayed.

In a specific application scenario, the lecturer is a teacher and the learner is a student, the scheme is applied to learning software, and the teacher and the student can log in the learning software. Firstly, a teacher can log in the learning software by using a teacher account number, a problem file image required to be explained by the teacher is a test paper, after logging in the learning software, the teacher can segment the problems in the test paper by utilizing an OCR (optical character recognition) problem-cutting technology in the learning software, and a plurality of segmented problems are selected and input into a problem area 210 of an explanation interface of the learning software.

The lecture interface is provided with an AI lesson recording function, which includes AI audio recording and AI video recording functions, and the teacher clicks an AI video recording icon of the lecture interface, i.e. a first video recording icon, starts screen recording, collects environmental audio, and can interpret and annotate the questions in the question stem area 220 and board explanation in the lecture area 230.

Because each question is displayed independently in the question area 210 of the explanation interface, a teacher can have a purpose and planned manual switching problem in actual teaching, and the segmentation time position between the question video and another video is calculated and determined by using the explicit question feature, so that the accuracy of the generated video in content segmentation is ensured. When the teacher switches questions, pre-segmentation of the questions is set at the point, and the question numbers before/after segmentation are recorded. And dividing the total explanation video into problem explanation videos corresponding to a plurality of problems respectively according to the dividing time positions of the adjacent problems of each group, and generating an explanation overview chart of the handwriting of the question stem area 220+the board explanation area 230 on the basis of saving the total explanation video data, wherein the explanation overview chart is used for displaying an interface when the video is not started to be played, when the video is paused and when the video is ended to be played, and then is used for accurately positioning the ring drawing of single question contents. In addition, the audio existing time of the target problem and the occurrence time of a preset writing function of the target problem are acquired, and the data are used for verifying the accurate positioning of the time position of the single problem. After the teacher clicks the stop recording icon of the explanation interface, a total explanation video is generated, and the problem explanation videos of all the problems under the total explanation video are packaged into the same folder, and the folder is provided for students through the learning software.

After a student logs in the learning software by using the student account, the student can check and receive the problem explanation video file folder sent by the teacher under the account, open the file folder, and determine the problem explanation video corresponding to the problem explanation video which cannot be displayed in the file folder according to the thumbnail icon corresponding to the problem explanation video of each problem. After clicking the problem explanation video, displaying a learning interface, and when the problem explanation video does not start to be played, displaying an explanation overview chart of the target problem by the learning interface, wherein a student can click a progress bar circle playing function at the bottom of the learning interface, please refer to fig. 3 in combination, the student can talkback the content of the handwriting which is not understood by the explanation overview chart in the learning interface, and calculate the initial audio time and the termination audio time in the area according to the handwriting content of the circle region as the position of the local explanation content related to the circle operation in the problem explanation audio of the target problem. Then, verifying the time position by utilizing the occurrence time of the preset blackboard writing function of the target problem, namely, the time of using the preset blackboard writing function in the stem area 220 or the explanation area 230 of the target problem in the process of recording the problem explanation video of the target problem, and if the verification is passed, playing a video part related to the local explanation content in the problem explanation video of the target problem according to the time position corresponding to the local explanation content; if the verification is not passed, playing the video part of the local explanation content in the problem explanation video of the target problem according to the occurrence time of the preset blackboard writing function of the target problem. The leftmost icon at the bottom of the explanation area 230 in fig. 3 is a circling operation trigger icon, the right side of the circling operation trigger icon is a play icon and a pause icon, and the right sides of the play icon and the pause icon are video playing progress bars.

According to the method and the device, the problem of accurate checking of the explanation content of the students after video or audio is recorded by a teacher is solved by means of the explanation interface provided and the mode of problem segmentation and circle drawing operation time positioning, so that the beneficial effects of improving picture cutting accuracy, improving viewing efficiency, improving positioning content expansibility and improving individualized learning experience are achieved.

The method is simpler from the realization of the technical scheme by grasping explicit thematic action of a teacher in the process of explanation of the test questions and using the explicit thematic action to make cutting burial points at video or audio thematic places; and meanwhile, the accuracy of the segmentation of the video content or the audio content in large granularity is improved.

Through improving the picture cutting accuracy, a final video or audio generation result is obtained, and students can intuitively see single-topic videos by only clicking on folders; and the accurate positioning of small particles of the content can be realized only by circling for watching the explanation content of a single question.

Students can collect, share, repeatedly check, edit and the like single-topic video or audio files. If the video or audio of the error-prone problem is reestablished to the error-prone problem folder for stable learning, the video or audio has higher expansibility.

Different students can learn individually according to the mastering conditions of the problems on the learning of the comment video, so that the requirements of different students on learning different comment contents are met, the learning is more free, and the learning interest can be stimulated.

It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.

Referring to fig. 4, fig. 4 is a schematic diagram of a frame of an embodiment of an electronic device 40 of the present application. The electronic device 40 comprises a memory 41 and a processor 42 coupled to each other, the processor 42 being adapted to execute program instructions stored in the memory 41 for implementing the steps of any of the content localization method embodiments described above. In one particular implementation scenario, electronic device 40 may include, but is not limited to: the microcomputer and the server, and the electronic device 40 may also include a mobile device such as a notebook computer and a tablet computer, which is not limited herein.

In particular, the processor 42 is adapted to control itself and the memory 41 to implement the steps of any of the content locating method embodiments described above. The processor 42 may also be referred to as a CPU (Central Processing Unit ). The processor 42 may be an integrated circuit chip having signal processing capabilities. The processor 42 may also be a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a Field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. In addition, the processor 42 may be commonly implemented by an integrated circuit chip.

Referring to fig. 5, fig. 5 is a schematic diagram illustrating an embodiment of a computer readable storage medium 50 of the present application. The computer readable storage medium 50 stores program instructions 501 executable by a processor, the program instructions 501 for implementing the steps in any of the content locating method embodiments described above.

In some embodiments, functions or modules included in an apparatus provided by the embodiments of the present disclosure may be used to perform a method described in the foregoing method embodiments, and specific implementations thereof may refer to descriptions of the foregoing method embodiments, which are not repeated herein for brevity.

The foregoing description of various embodiments is intended to highlight differences between the various embodiments, which may be the same or similar to each other by reference, and is not repeated herein for the sake of brevity.

In the several embodiments provided in the present application, it should be understood that the disclosed methods and apparatus may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical, or other forms.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in part or all or part of the technical solution contributing to the prior art or in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Claims (16)

1. A content locating method, comprising:

detecting a preset operation of a user on a current interface aiming at a target explanation carrier, wherein the target explanation carrier is video or audio of explanation about one or more problems, and the preset operation comprises at least one of a problem switching operation of an explanation person in the process of recording the target explanation carrier and a specified operation of a learner on local explanation content of the problems in the target explanation carrier;

and determining a time position of the explanation content related to the preset operation in the target explanation carrier, wherein the explanation content related to the question switching operation is the explanation content of each question related to the question switching operation, the explanation content related to the specified operation is the specified local explanation content, and the time position is used for searching the explanation content related to the preset operation in the target explanation carrier and providing the explanation content to the learner.

2. The method of claim 1, wherein the target lecture carrier includes a total lecture carrier recorded during a procedure of the lecturer lecturing a plurality of questions one by one, the preset operation is the question switching operation; the determining the time position of the explanation content related to the preset operation in the target explanation carrier comprises the following steps:

Determining a segmentation time position of adjacent questions of the total explanation carrier before and after the question switching operation based on the occurrence time of the question switching operation, wherein the segmentation time position is used for segmenting the total explanation carrier into question explanation carriers corresponding to the questions, the question explanation carrier is video or audio when the total explanation carrier is video, and the question explanation carrier is audio when the total explanation carrier is audio.

3. The method of claim 2, further comprising, after said determining a time position of the lecture content associated with the preset operation in the target lecture carrier:

based on the dividing time positions of the adjacent questions of each group, dividing the total explanation carrier into question explanation carriers respectively corresponding to the questions, wherein the question explanation carriers are used for providing the learner.

4. A method according to claim 3, further comprising, after the dividing the total interpretation carrier into question interpretation carriers corresponding to the plurality of questions respectively based on the dividing time positions of the respective sets of adjacent questions, any one or more of the following steps:

Combining the plurality of question explanation carriers belonging to the same question in response to the plurality of question explanation carriers belonging to the same question;

and packaging the question explanation carriers of all the questions under the general explanation carrier into the same folder, and providing the folder for the learner.

5. The method according to claim 2, wherein the current interface includes an explanation interface, the total explanation carrier is obtained by recording the plurality of questions by the lecturer using the explanation interface, and in the case that the total explanation carrier is a video, the total explanation carrier records at least the explanation interface and the sound of the lecturer, and in the case that the total explanation carrier is an audio, the sound of the lecturer;

the explanation interface comprises a question area, a question stem area and an explanation area, wherein the question area is used for displaying the questions, the question stem area is used for displaying the questions of the current explanation, and the explanation area is provided for the explanation person to write explanation contents about the questions in the question stem area.

6. The method of claim 5, wherein at least one of the stem section and the lecture section has at least one of the following blackboard writing functions: changing the current display content in the area in a clicking mode, changing the current display content in the area in a sliding mode, zooming the current display content in the area, handwriting writing, handwriting erasing, handwriting selection, handwriting withdrawal, handwriting recovery and font size adjustment;

And/or the stem region is also provided with a function of transforming handwriting along with the problem content in the stem region.

7. The method of claim 5, further comprising any one or more of the following steps:

detecting an area adjustment operation, and adjusting a local area of the question stem area selected by a user to be the explanation area, or adjusting a local area of the explanation area selected by the user to be the question stem area;

detecting triggering operation of a preset blackboard writing function of the question stem area or the explanation area, and recording occurrence time of the preset blackboard writing function, wherein the occurrence time of the preset blackboard writing function is used for checking whether the time position of the local explanation content of the current explanation problem is correct;

and/or before the detection of the preset operation of the user on the target explanation carrier at the current interface, the method further comprises the following steps:

performing problem segmentation on a problem file image to be explained to obtain a plurality of problems contained in the problem file image;

and responding to the explanation instruction of the problem file image, displaying the explanation interface, and displaying the problems contained in the problem file image in a problem area of the explanation interface.

8. The method of claim 2, wherein the current interface includes an explanation interface, the general explanation carrier being recorded by the instructor using the explanation interface to explain the plurality of questions, the explanation interface including a question area for displaying the plurality of questions;

the detecting the preset operation of the user on the target explanation carrier at the current interface comprises the following steps:

detecting an operation to reselect one of the questions in the question area; or,

and detecting triggering operation of switching the theme icons in the explanation interface.

9. The method of claim 2, wherein the current interface comprises an explanation interface, the method further comprising:

detecting triggering operation of a first video recording icon of the explanation interface, recording a screen of the current explanation interface, and collecting environmental audio to form video content in the total explanation carrier; or,

detecting triggering operation of a second video recording icon of the explanation interface, recording a screen of the current explanation interface, and starting a camera to pick up the image of the explanation person so as to form video content in the total explanation carrier; or detecting triggering operation of an audio recording icon of the explanation interface, and collecting environment audio to form audio content of the total explanation carrier;

And detecting triggering operation of stopping recording icons on the explanation interface, and generating the total explanation carrier by utilizing all the video content or the audio content formed in the recording process.

10. The method of claim 1, wherein the target explanation carrier includes a problem explanation carrier corresponding to a target problem, the problem explanation carrier having recorded therein explanation contents written by an instructor in an explanation area of an explanation interface of the target problem, and the preset operation includes an operation of the learner to specify a local explanation content of the target problem;

the detecting the preset operation of the user on the target explanation carrier at the current interface comprises the following steps:

detecting a local area in an explanation area of the target problem designated by a user;

the determining the time position of the explanation content related to the preset operation in the target explanation carrier comprises the following steps:

and searching the initial handwriting generating time and the final handwriting generating time of the appointed local area from the problem interpretation carrier corresponding to the target problem, and taking the initial handwriting generating time and the final handwriting generating time as the time positions of the local interpretation content related to the appointed operation in the problem interpretation carrier of the target problem.

11. The method of claim 10, wherein the current interface includes a learning interface that is currently used to play a question explanation carrier of the target question and displays an explanation overview of the target question, the explanation overview including a stem region in which content of the target question is displayed and an explanation region in which content of the target question is displayed by the lecturer;

the detecting of the local area in the interpretation zone of the target question specified by the user comprises:

and detecting the circling operation of the user on the explanation area of the explanation overview chart.

12. The method of claim 11, wherein the method further comprises:

responding to a learning instruction of the target problem, and displaying the learning interface;

providing an operation icon of the problem explanation carrier of the target problem on the learning interface, wherein the operation icon comprises a play icon and a pause icon, triggering operation of the operation icon is detected, and operation corresponding to the operation icon is executed on the problem explanation carrier of the target problem; and/or the number of the groups of groups,

and displaying an explanation overview of the target problem on the learning interface under the condition that the problem explanation carrier of the target problem does not start playing, pause playing or end playing.

13. The method of claim 12, further comprising, prior to said displaying the learning interface in response to a learning instruction for the target question:

detecting an opening operation of a folder corresponding to a problem file, and displaying a thumbnail icon corresponding to a problem explanation carrier of each problem in the folder;

detecting a selection operation of one of the questions in the folder, taking the selected question as a target question, and generating a learning instruction of the target question.

14. The method according to claim 10, wherein after finding the handwriting initial generation time and the handwriting termination generation time of the specified local area in the question interpretation carrier corresponding to the target question as the time positions of the local interpretation contents related to the specified operation in the question interpretation carrier of the target question, the method further comprises any one or more of the steps of:

reading an explanation reference time of the target problem from the recorded data, the explanation reference time including at least one of: the audio frequency existing time of the target problem and the occurrence time of the preset writing function of the target problem are the time when the sound appears in the problem explanation carrier of the target problem, and the occurrence time of the preset writing function of the target problem is the time when an explanation person uses the preset writing function for a question stem area or an explanation area of the target problem in the process of recording the problem explanation carrier of the target problem; using the explanation reference time of the target problem to check the time position of the local explanation content in the problem explanation carrier of the target problem;

And playing the carrier part of the local explanation content in the question explanation carrier of the target question according to the corresponding time position of the local explanation content.

15. An electronic device comprising a memory and a processor coupled to each other, the processor configured to execute program instructions stored in the memory to implement the content locating method of any one of claims 1 to 14.

16. A computer readable storage medium having stored thereon program instructions, which when executed by a processor implement the content locating method of any of claims 1 to 14.