CN114745594A - Method and device for generating live playback video, electronic equipment and storage medium - Google Patents

Method and device for generating live playback video, electronic equipment and storage medium Download PDF

Info

Publication number
CN114745594A
CN114745594A CN202210376016.7A CN202210376016A CN114745594A CN 114745594 A CN114745594 A CN 114745594A CN 202210376016 A CN202210376016 A CN 202210376016A CN 114745594 A CN114745594 A CN 114745594A
Authority
CN
China
Prior art keywords
live
video
instruction
playback video
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210376016.7A
Other languages
Chinese (zh)
Inventor
刘煊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Gaotu Yunji Education Technology Co Ltd
Original Assignee
Beijing Gaotu Yunji Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Gaotu Yunji Education Technology Co Ltd filed Critical Beijing Gaotu Yunji Education Technology Co Ltd
Priority to CN202210376016.7A priority Critical patent/CN114745594A/en
Publication of CN114745594A publication Critical patent/CN114745594A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks

Abstract

The present disclosure provides a method and an apparatus for generating a live playback video, an electronic device, and a storage medium, where the method for generating a live playback video includes: displaying a first marker icon based on a live broadcast picture; the live broadcast picture comprises a teaching teacher picture and a teaching content picture; generating a marking instruction under the condition that the first marking icon is detected to be triggered; and based on the time generated by the marking instruction, clipping processing is carried out on the live video, and a first live playback video is generated. According to the embodiment of the present disclosure, the corresponding live playback video can be generated according to the requirements of the user, and the applicability and the user experience of the method are improved.

Description

Method and device for generating live playback video, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of online live broadcast technologies, and in particular, to a method and an apparatus for generating a live playback video, an electronic device, and a storage medium.
Background
At present, in the live broadcasting teaching process, the generation ratio of live broadcasting and playback is 1:1, namely, the playback video is the same as the video in the live broadcasting process, however, for most courses, some matters irrelevant to the courses exist in the live broadcasting, such as self introduction of teachers, course introduction of teachers, active interaction in classes and the like, so that when students watch the playback video, the students need to search for relevant videos from the playback video, and the operation is complicated.
Disclosure of Invention
The embodiment of the disclosure at least provides a method and a device for generating a live playback video, an electronic device and a storage medium.
In a first aspect, an embodiment of the present disclosure provides a method for generating a live playback video, including:
displaying a first marker icon based on a live broadcast picture; the live broadcast picture comprises a teaching teacher picture and a teaching content picture;
under the condition that the first mark icon is detected to be triggered, generating a mark instruction;
and performing clipping processing on the live video based on the time generated by the marking instruction to generate a first live playback video.
In the embodiment of the disclosure, since the first marker icon is displayed on the live broadcast picture, the user can trigger the first marker icon according to the requirement, and then the first live broadcast playback video meeting the requirement of the user is generated, so that the operation of searching for the related video from the playback video is avoided, the efficiency of watching the playback video by the user is improved, and the user experience is also improved.
In a possible implementation manner, according to the first aspect, the first marker icon is displayed on the teaching teacher picture.
According to the first aspect, in a possible implementation manner, in a case where the first marker icon is triggered multiple times, multiple sets of marker instructions are generated, where each set of marker instructions includes a start marker instruction and an end marker instruction;
the clipping processing is carried out on the live video based on the time generated by the marking instruction, and a first live playback video is generated, and the method comprises the following steps:
based on the generation time of the starting marking instruction and the ending marking instruction, performing clipping processing on the live video to obtain a plurality of live video segments;
and fusing the plurality of video segments to generate the first direct-playing playback video.
In the embodiment of the disclosure, a user can trigger the first mark icon for multiple times according to own requirements, and then generate multiple groups of mark instructions, so that corresponding first live playback videos can be generated according to the requirements of the user at different time periods in the live broadcasting process, the requirements of the user are met better, and the applicability of the method is improved.
According to the first aspect, in one possible implementation, the live view further shows a second marker icon; the method further comprises the following steps:
generating a recording instruction under the condition that the second mark icon is triggered;
responding to the recording instruction, and recording the marked content input by the user;
and associating the marked content with the live broadcast video to generate a second live broadcast playback video.
In the embodiment of the disclosure, not only can the different periods in the live broadcast process be marked, but also the content input by the user can be recorded in the live broadcast process, so that the student can watch the corresponding operation record when reviewing the live broadcast, the prompt function is played, and the student can review and review the live broadcast content conveniently.
In a possible implementation manner, according to the first aspect, the lecture content screen displays the second marker icon.
In the embodiment of the disclosure, the second mark icon and the first mark icon are displayed in a partitioned manner, so that the situation that a user touches by mistake is avoided.
According to the first aspect, in a possible implementation, before the associating the markup content with the live video and generating the second played back video, the method further includes:
identifying keywords in the tagged content;
and in the live broadcasting process, highlighting the part of the teaching content picture including the keywords.
In the embodiment of the disclosure, after the marked content input by the user is recorded, the keyword in the marked content is identified, and in the live broadcasting process, the part of the teaching content picture including the keyword is highlighted, so that the part related to the marked content of the user can be reminded of the user in the live broadcasting process, and the user can be helped to deepen the memory.
In a possible implementation manner, the associating the tagged content with the live video to generate a second playback video includes:
and associating the marked content with the live video comprising the keywords to generate the second live playback video.
In the embodiment, as long as the user inputs the corresponding marked content, the live video related to the keyword in the marked content can be associated without marking for many times by the user, so that the generation efficiency of the second live playback video is improved.
In a possible implementation manner, the recording the marked content input by the user in response to the recording instruction includes:
responding to the recording instruction, and respectively recording the video frame information when the user starts inputting and the video frame information when the user finishes inputting;
and recording the mark content between the video frame information at the initial input and the video frame information at the end input of the user.
In a second aspect, an embodiment of the present disclosure further provides an apparatus for generating a live playback video, including:
the icon display module is used for displaying a first mark icon based on a live broadcast picture; the live broadcast picture comprises a teaching teacher picture and a teaching content picture;
the instruction generation module is used for generating a marking instruction under the condition that the first marking icon is detected to be triggered;
and the video generation module is used for carrying out clipping processing on the live video based on the time generated by the marking instruction to generate a first live playback video.
In a possible embodiment, the first marker icon is displayed on the lecturer screen.
According to the second aspect, in a possible implementation, in a case where the first marker icon is triggered multiple times, multiple sets of marker instructions are generated, each set of marker instructions including a start marker instruction and an end marker instruction; the video generation module is specifically configured to:
based on the generation time of the starting marking instruction and the ending marking instruction, performing clipping processing on the live video to obtain a plurality of live video segments;
and fusing the plurality of video segments to generate the first direct-playing playback video.
According to the second aspect, in a possible implementation manner, the icon presenting module is further configured to present a second marker icon on the live view; the device also includes a content recording module;
the instruction generating module is further used for generating a recording instruction under the condition that the second mark icon is detected to be triggered;
the content recording module is used for responding to the recording instruction and recording the marked content input by the user;
the video generation module is further configured to associate the marked content with the live video to generate a second live playback video.
In a possible implementation manner, according to the second aspect, the lecture content picture shows the second marker icon.
According to a second aspect, in a possible implementation, the apparatus further comprises:
the content identification module is used for identifying key words in the marked content;
and the highlight display module is used for highlighting the part of the teaching content picture including the keywords in the live broadcasting process.
According to the second aspect, in a possible implementation manner, the video generation module is specifically configured to:
and associating the marked content with the live video comprising the keywords to generate the second live playback video.
According to the second aspect, in a possible implementation manner, the content recording module is specifically configured to:
responding to the recording instruction, and respectively recording the video frame information when the user starts inputting and the video frame information when the user finishes inputting;
and recording the mark content between the video frame information when the user starts inputting and the video frame information when the user finishes inputting.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, including: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, the processor and the memory communicate with each other through the bus when the electronic device runs, and the machine-readable instructions are executed by the processor to perform the steps of the method for generating live playback video according to the first aspect or any one of the possible implementation manners of the first aspect.
In a fourth aspect, the disclosed embodiments further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program, when executed by a processor, performs the steps of the method for generating live playback video in the first aspect, or any one of the possible implementation manners in the first aspect.
For the description of the effects of the above-mentioned live playback video generation apparatus, electronic device, and computer-readable storage medium, reference is made to the description of the above-mentioned live playback video generation method, and details are not repeated here.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
Fig. 1 illustrates an exemplary architecture diagram of a live broadcast system provided by an embodiment of the present disclosure;
fig. 2 shows a flowchart of a method for generating a live playback video according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram illustrating a live interface of a student end provided by an embodiment of the present disclosure;
fig. 4 shows a flowchart of a method for generating a first live playback video according to an embodiment of the present disclosure;
fig. 5 shows a flowchart of another method for generating live playback video provided by an embodiment of the present disclosure;
FIG. 6 is a schematic diagram illustrating another live interface of the student end provided by the embodiment of the disclosure;
FIG. 7 is a flowchart illustrating a method for recording the marked content input by the user according to an embodiment of the present disclosure;
fig. 8 shows a flowchart of a method for generating a live playback video according to an embodiment of the present disclosure;
fig. 9 is a schematic diagram illustrating a generation apparatus for live playback video provided by an embodiment of the present disclosure;
fig. 10 is a schematic diagram illustrating another apparatus for generating live playback video provided by an embodiment of the present disclosure;
fig. 11 shows a schematic diagram of an electronic device provided by an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
With the development of networks and scientific technologies, the learning modes of people are more and more diversified and more convenient, and online learning becomes an important learning mode for people. At present, in the live teaching process, for the convenience of students to warm the course that the live in-process teacher said, can generate corresponding live playback video after the live usually.
Research shows that the generation ratio of the current live broadcast to the playback is 1:1, namely the playback video is the same as the video in the live broadcast process. However, for most courses, there are some matters unrelated to the courses in the live broadcast, such as teacher self-introduction, teacher course introduction, active classroom interaction, etc., so that when a student watches the playback video, the student needs to search for the relevant video from the playback video, which is cumbersome to operate.
Based on the research, the present disclosure provides a method for generating a live playback video, which displays a first marker icon based on a live frame; generating a marking instruction under the condition that the first marking icon is detected to be triggered; and based on the time generated by the marking instruction, editing the live video to generate a first live playback video, so that the user can trigger the first marking icon according to the requirement to further generate the first live playback video meeting the requirement of the user, the operation of searching related videos from the playback video is avoided, the efficiency of watching the playback video by the user is improved, and the user experience is also improved.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The following describes the present application scheme in detail with reference to a specific system application architecture.
Referring to fig. 1, fig. 1 illustrates an exemplary architecture diagram of a live broadcast system according to an embodiment of the present application. The live broadcast system in the embodiment of the present application takes live teaching as an example for explanation.
As shown in fig. 1, the live system architecture 1000 may include a server 100, a teacher end 200, and a plurality of student ends 300. Wherein, communication connections are established between the teacher end 200 and the server 100, and between the server 100 and the plurality of student ends 300 through the network 400. That is, the network 400 is a medium for providing a communication link between the teacher side 200 and the student side 300. Network 400 may include various types of wired or wireless communication links, such as: the wired communication link includes an optical fiber, a twisted pair wire or a coaxial cable, and the Wireless communication link includes a bluetooth communication link, a Wireless-Fidelity (Wi-Fi) communication link, a microwave communication link, or the like.
The teacher side 200 and the student side 300 may interact with the server 100 through the network 400 to receive messages from the server 100 or to transmit messages to the server 100. The teacher end 200 and the student end 300 may have various communication client applications installed thereon, such as: drawing applications, video recording applications, video playing applications, voice acquisition applications, voice interaction applications, search-type applications, instant messaging tools, mailbox clients, social platform software, and the like.
The teacher end 200 and the student end 300 may be hardware or software. When teacher end 200 and student end 300 are hardware, they may be various electronic devices with display screens, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like. The user can view the displayed text, pictures, videos and other information by using the display screens on the teacher end 200 and the student end 300. When the teacher end 200 and the student end 300 are software, they may be installed in the electronic devices listed above, and they may be implemented as a plurality of software or software modules (for example, to provide distributed services), or as a single software or software module, and are not limited in this respect.
In this embodiment, the teacher end 200 and the student end 300 are both electronic devices, such as a mobile phone and a tablet computer.
The server 100 may be a business server providing various services. The server 100 may be hardware or software. When the server 100 is hardware, it may be implemented as a distributed server cluster composed of a plurality of servers, or may be implemented as a single server. When the server 100 is software, it may be implemented as a plurality of software or software modules (for example, to provide distributed services), or may be implemented as a single software or software module, and is not limited in particular herein.
It should be understood that the number of teacher end 200, student end 300, server 100, and network 400 in fig. 1 is illustrative only. Any number of teacher terminals, student terminals, servers and networks may be used, depending on implementation requirements.
An execution subject of the live playback video generation method provided by the embodiment of the present disclosure is generally an electronic device with certain computing capability, and the electronic device includes, for example: a terminal device or a server (e.g., the server 100 in fig. 1) or other processing device, and the terminal device may be a mobile phone, a tablet computer, or the like.
Referring to fig. 2, a flowchart of a method for generating a live playback video according to an embodiment of the present disclosure is shown, where the method may be applied to the above-mentioned electronic device (e.g., the student terminal 300), or applied to a server in a local or cloud end. The generation method of the live playback video shown in fig. 2 includes the following S101 to S103:
s101, displaying a first marker icon based on a live broadcast picture; the live broadcast pictures comprise teaching teacher pictures and teaching content pictures.
Referring to fig. 3, a schematic view of a display interface of a student terminal 300 according to an embodiment of the present disclosure is shown, as shown in fig. 3, in a live teaching process, a teacher teaching picture 301 and a teaching content picture 302 can be displayed on the display interface of the student terminal 300.
The teaching teacher picture 301 is used for displaying a real-time explanation video of the teacher, and the teaching content picture 302 is used for displaying courseware content to be explained by the teacher. The courseware is course software and the like which are manufactured according to the requirements of the teaching outline through the links of teaching target determination, teaching content and task analysis, teaching activity structure, interface design and the like. In some embodiments, the courseware content may be in the form of a PPT. In other embodiments, the courseware is not limited in display form.
In some embodiments, the lecturer screen 301 displays the first mark icon, so that the first mark icon is operated without affecting the display of courseware content.
It is understood that, in some embodiments, in order to meet the personalized requirements of the user, the first marker icon may also change the display position of the first marker icon on the teaching teacher screen 301 in response to the drag operation applied by the user.
S102, generating a marking instruction when the first marking icon is triggered.
And under the condition that the first mark icon is triggered, indicating that the user needs to record the current live video at the moment, and further generating a mark instruction. It can be understood that, in general, if a live playback video required by a user needs to be generated in a live process, at least one start marking instruction and one end marking instruction are required, and the live playback video between the start marking instruction and the end marking instruction is clipped to generate the live playback video. Therefore, the start marking instruction can be generated when the first marking icon is detected to be triggered by the user for the first time, if the first marking icon is detected to be triggered by the user again, the end marking instruction is generated, if the first marking icon is triggered by the user for the third time, the start marking instruction of the next video segment is generated, and so on until the live broadcast is ended.
S103, based on the time generated by the marking instruction, the live video is clipped, and a first live playback video is generated.
In the embodiment of the disclosure, since the first marker icon is displayed on the live broadcast picture, the user can trigger the first marker icon according to the requirement, and then the first live broadcast playback video meeting the requirement of the user is generated, so that the operation of searching for the related video from the playback video is avoided, the efficiency of watching the playback video by the user is improved, and the user experience is also improved.
It can be understood that, in the live broadcasting process, a user can be interested in live videos of a plurality of different time periods in the live broadcasting process, and further can trigger the first mark icon for a plurality of times to generate a plurality of mark instructions.
Specifically, in some embodiments, when the live video is clipped based on the time generated by the marking instruction to generate the first live playback video, as shown in fig. 4, the following S1031 to S1032 may be included:
and S1031, based on the generation time of the start marking instruction and the end marking instruction, performing clipping processing on the live video to obtain a plurality of live video segments.
S1032, the plurality of video segments are fused to generate the first live playback video.
In the embodiment of the disclosure, a user can trigger the first mark icon for multiple times according to own requirements, and then generate multiple groups of mark instructions, so that corresponding first live playback videos can be generated according to the requirements of the user at different time periods in the live broadcasting process, the requirements of the user are met better, and the applicability of the method is improved.
Referring to fig. 5, which is a flowchart of another method for generating a live playback video provided in an embodiment of the present disclosure, the method for generating a live playback video may include the following steps S201 to S203:
s201, generating a recording instruction under the condition that the second mark icon is detected to be triggered.
Referring to fig. 6, the live view further shows a second marker icon, and in some embodiments, the second marker icon is shown on the lecture content view 302. And under the condition that the second mark icon is detected to be triggered, the situation shows that the user needs to input the content of the corresponding mark, and at the moment, a recording instruction needs to be generated.
It can be understood that, since the second marker icon is used for inputting the marker content, the second marker icon is displayed on the teaching content screen, so that the user can conveniently mark the corresponding content in the courseware content. In addition, the second mark icon and the first mark icon are displayed in a partitioned mode, and the situation that a user touches the second mark icon and the first mark icon by mistake can be avoided.
And S202, responding to the recording instruction, and recording the marked content input by the user.
It can be understood that when the user inputs the markup content, the currently input markup content needs to be associated with the current live video, and therefore, in some embodiments, as shown in fig. 7, when recording the markup content input by the user in response to the recording instruction, the following S2021 to S2022 may be included:
s2021, in response to the recording instruction, respectively recording the video frame information at the time of the user 'S initial input and the video frame information at the time of the user' S end input.
S2022, recording the mark content between the video frame information at the time of the user start input and the video frame information at the time of the user end input.
S203, associating the marked content with the live broadcast video to generate a second live broadcast playback video.
In the embodiment of the disclosure, not only can the different periods in the live broadcast process be marked, but also the content input by the user can be recorded in the live broadcast process, so that the student can watch the corresponding operation record when reviewing the live broadcast, the prompt function is played, and the student can review and review the live broadcast content conveniently.
It should be noted that, in the actual application process, the first marker icon and the second marker icon may be triggered separately, that is, in the live broadcast process, only the first marker icon is triggered or only the second marker icon is triggered; in addition, the first marker icon and the second marker icon may also be used in combination, which is not limited herein.
Referring to fig. 8, which is a flowchart of a method for generating a live playback video according to another embodiment of the present disclosure, as shown in fig. 8, the method for generating a live playback video includes the following steps S301 to S305:
and S301, generating a recording instruction when the second mark icon is triggered.
This step is similar to step S201 and will not be described herein.
S302, responding to the recording instruction, recording the marked content input by the user.
The steps are similar to step S202, and are not described in detail herein
S303, identifying the key words in the marked content.
It is understood that, when the user marks the content of the mark as the key content, the keyword in the marked content can be identified. Specifically, a keyword library may be established according to the current teaching content, where the keyword library may include a formula, an idiom, a term, a common term, and the like, and after receiving the tag content input by the user, the tag content may be matched with a word in the keyword library, so as to determine a keyword related to the tag content.
S304, in the live broadcasting process, highlighting the part of the teaching content picture including the keywords.
For example, the font of the keyword may be displayed in bold, the color of the font of the keyword may be changed and displayed, or the ground color corresponding to the keyword may be colored and displayed.
S305, associating the marked content with the live broadcast video comprising the keywords, and generating the second live broadcast playback video.
This step is similar to step S203, except that in the process of generating the second live playback video, not only the mark content is associated with the live video, but also the live video including the keyword is associated, and the second live playback video is generated.
In the embodiment of the disclosure, after the marked content input by the user is recorded, the keyword in the marked content is also identified, and the part of the teaching content picture including the keyword is highlighted in the live broadcasting process, so that the part related to the marked content of the user can be reminded of the user in the live broadcasting process, and the deepening of the memory of the user is facilitated.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
Based on the same inventive concept, the embodiment of the present disclosure further provides a device for generating a live playback video corresponding to the method for generating a live playback video, and because the principle of solving the problem of the device in the embodiment of the present disclosure is similar to the method for generating a live playback video in the embodiment of the present disclosure, the method can be referred to for implementation of the device, and repeated details are not repeated.
Referring to fig. 9, a schematic architecture diagram of a device for generating a live playback video according to an embodiment of the present disclosure is shown, where the device includes:
an icon displaying module 501, configured to display a first marker icon based on a live view; the live broadcast picture comprises a teaching teacher picture and a teaching content picture;
an instruction generating module 502, configured to generate a marking instruction when it is detected that the first marker icon is triggered;
and a video generating module 503, configured to perform clipping processing on the live video based on the time generated by the marking instruction, and generate a first live playback video.
In one possible embodiment, the lecturer screen displays the first marker icon.
In a possible implementation manner, in a case that the first marker icon is triggered multiple times, multiple sets of marker instructions are generated, where each set of marker instructions includes a start marker instruction and an end marker instruction; the video generation module 503 is specifically configured to:
based on the generation time of the starting marking instruction and the ending marking instruction, performing clipping processing on the live video to obtain a plurality of live video segments;
and fusing the plurality of video segments to generate the first direct-playing playback video.
In a possible implementation, the icon presenting module 501 is further configured to present a second markup icon on the live view; referring to fig. 10, the apparatus further includes a content recording module 504;
the instruction generating module 501 is further configured to generate a recording instruction when it is detected that the second marker icon is triggered;
the content recording module 504 is configured to record the marked content input by the user in response to the recording instruction;
the video generation module 503 is further configured to associate the marked content with the live video to generate a second live playback video.
In one possible embodiment, the lecture content screen displays the second marker icon.
In a possible embodiment, the apparatus further comprises:
a content identification module 505 for identifying keywords in the tagged content;
and a highlight display module 506, configured to highlight, in a live broadcast process, a part of the lecture content picture that includes the keyword.
In a possible implementation manner, the video generating module 503 is specifically configured to:
and associating the marked content with the live video comprising the keywords to generate the second live playback video.
In a possible implementation manner, the content recording module 504 is specifically configured to:
responding to the recording instruction, and respectively recording the video frame information when the user starts inputting and the video frame information when the user finishes inputting;
and recording the mark content between the video frame information at the initial input and the video frame information at the end input of the user.
The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.
Based on the same technical concept, the embodiment of the disclosure also provides an electronic device. Referring to fig. 11, a schematic structural diagram of an electronic device 700 provided in the embodiment of the present disclosure includes a processor 701, a memory 702, and a bus 703. The memory 702 is used for storing execution instructions and includes a memory 7021 and an external memory 7022; the memory 7021 is also referred to as an internal memory and temporarily stores operation data in the processor 701 and data exchanged with an external memory 7022 such as a hard disk, and the processor 701 exchanges data with the external memory 7022 via the memory 7021.
In this embodiment, the memory 702 is specifically configured to store application program codes for executing the scheme of the present application, and is controlled by the processor 701 to execute. That is, when the electronic device 700 is running, the processor 701 communicates with the memory 702 via the bus 703, so that the processor 701 executes the application program code stored in the memory 702, thereby executing the method described in any of the foregoing embodiments.
The Memory 702 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like.
The processor 701 may be an integrated circuit chip having signal processing capabilities. The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 700. In other embodiments of the present application, the electronic device 700 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The disclosed embodiment also provides a computer readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program executes the steps of the live playback video generation method described in the above method embodiment. The storage medium may be a volatile or non-volatile computer-readable storage medium.
The embodiments of the present disclosure also provide a computer program product, where the computer program product carries a program code, and instructions included in the program code may be used to execute the steps of the live playback video generation method in the foregoing method embodiments, which may be referred to specifically for the foregoing method embodiments, and are not described herein again.
The computer program product may be implemented by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the units into only one type of logical function may be implemented in other ways, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk or an optical disk, and various media capable of storing program codes.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, but not to limit the technical solutions, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims (11)

1. A method for generating a live playback video, comprising:
displaying a first marker icon based on a live broadcast picture; the live broadcast picture comprises a teaching teacher picture and a teaching content picture;
under the condition that the first mark icon is detected to be triggered, generating a mark instruction;
and based on the time generated by the marking instruction, clipping processing is carried out on the live video, and a first live playback video is generated.
2. The method of claim 1, wherein said lecturer picture is presented with said first marker icon.
3. The method according to claim 1 or 2, wherein in case the first marker icon is triggered multiple times, generating multiple sets of marker instructions, each set of marker instructions comprising a start marker instruction and an end marker instruction;
the clipping processing is carried out on the live video based on the time generated by the marking instruction, and a first live playback video is generated, and the clipping processing comprises the following steps:
based on the generation time of the starting marking instruction and the ending marking instruction, performing clipping processing on the live video to obtain a plurality of live video segments;
and fusing the plurality of video segments to generate the first direct-playing playback video.
4. The method of claim 1, wherein the live view further presents a second marker icon; the method further comprises the following steps:
under the condition that the second mark icon is triggered, generating a recording instruction;
responding to the recording instruction, and recording the marked content input by the user;
and associating the marked content with the live broadcast video to generate a second live broadcast playback video.
5. The method according to claim 4, wherein the lecture content screen displays the second marker icon.
6. The method of claim 4 or 5, wherein prior to associating the tagged content with the live video to generate a second live playback video, the method further comprises:
identifying keywords in the tagged content;
and in the live broadcasting process, highlighting the part of the teaching content picture, which comprises the keyword.
7. The method of claim 6, wherein associating the tagged content with the live video to generate a second playback video comprises:
and associating the marked content with the live video comprising the keywords to generate the second live playback video.
8. The method of claim 4, wherein recording the marked content input by the user in response to the recording instruction comprises:
responding to the recording instruction, and respectively recording the video frame information when the user starts inputting and the video frame information when the user finishes inputting;
and recording the mark content between the video frame information at the initial input and the video frame information at the end input of the user.
9. An apparatus for generating a live playback video, comprising:
the icon display module is used for displaying a first mark icon based on a live broadcast picture; the live broadcast picture comprises a teaching teacher picture and a teaching content picture;
the instruction generation module is used for generating a marking instruction under the condition that the first marking icon is detected to be triggered;
and the video generating module is used for carrying out clipping processing on the live video based on the time generated by the marking instruction to generate a first live playback video.
10. An electronic device, comprising: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the method of generating live playback video of any of claims 1 to 8.
11. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, performs a method of generating live playback video as claimed in any one of claims 1 to 8.
CN202210376016.7A 2022-04-11 2022-04-11 Method and device for generating live playback video, electronic equipment and storage medium Pending CN114745594A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210376016.7A CN114745594A (en) 2022-04-11 2022-04-11 Method and device for generating live playback video, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210376016.7A CN114745594A (en) 2022-04-11 2022-04-11 Method and device for generating live playback video, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114745594A true CN114745594A (en) 2022-07-12

Family

ID=82281300

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210376016.7A Pending CN114745594A (en) 2022-04-11 2022-04-11 Method and device for generating live playback video, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114745594A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115460429A (en) * 2022-09-06 2022-12-09 河北先河环保科技股份有限公司 Method for monitoring and supervising water quality sampling, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106804000A (en) * 2017-02-28 2017-06-06 北京小米移动软件有限公司 Direct playing and playback method and device
CN107888988A (en) * 2017-11-17 2018-04-06 广东小天才科技有限公司 A kind of video clipping method and electronic equipment
CN110446096A (en) * 2019-08-15 2019-11-12 天脉聚源(杭州)传媒科技有限公司 Video broadcasting method, device and storage medium a kind of while recorded
CN111523293A (en) * 2020-04-08 2020-08-11 广东小天才科技有限公司 Method and device for assisting user in information input in live broadcast teaching
CN113391745A (en) * 2021-06-15 2021-09-14 杭州米络星科技(集团)有限公司 Method, device, equipment and storage medium for processing key contents of network courses
CN114157877A (en) * 2021-10-08 2022-03-08 钉钉(中国)信息技术有限公司 Playback data generation method and device, and playback method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106804000A (en) * 2017-02-28 2017-06-06 北京小米移动软件有限公司 Direct playing and playback method and device
CN107888988A (en) * 2017-11-17 2018-04-06 广东小天才科技有限公司 A kind of video clipping method and electronic equipment
CN110446096A (en) * 2019-08-15 2019-11-12 天脉聚源(杭州)传媒科技有限公司 Video broadcasting method, device and storage medium a kind of while recorded
CN111523293A (en) * 2020-04-08 2020-08-11 广东小天才科技有限公司 Method and device for assisting user in information input in live broadcast teaching
CN113391745A (en) * 2021-06-15 2021-09-14 杭州米络星科技(集团)有限公司 Method, device, equipment and storage medium for processing key contents of network courses
CN114157877A (en) * 2021-10-08 2022-03-08 钉钉(中国)信息技术有限公司 Playback data generation method and device, and playback method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115460429A (en) * 2022-09-06 2022-12-09 河北先河环保科技股份有限公司 Method for monitoring and supervising water quality sampling, electronic equipment and storage medium
CN115460429B (en) * 2022-09-06 2024-03-01 河北先河环保科技股份有限公司 Method, electronic equipment and storage medium for monitoring and supervising water quality sampling

Similar Documents

Publication Publication Date Title
CN110570698B (en) Online teaching control method and device, storage medium and terminal
US9984426B2 (en) Data processing system for managing activities linked to multimedia content
CN110673777A (en) Online teaching method and device, storage medium and terminal equipment
Wang et al. Intelligent mobile cloud education: smart anytime-anywhere learning for the next generation campus environment
US11645725B2 (en) Data processing system for managing activities linked to multimedia content
CN105262601B (en) Method and system for processing group member information
CN110069738B (en) Information processing method and device, terminal equipment and server
CN107592255B (en) Information display method and equipment
CN113079417A (en) Method, device and equipment for generating bullet screen and storage medium
CN108449255B (en) Comment interaction method and equipment, client device and electronic equipment
CN112698895A (en) Display method, device, equipment and medium of electronic equipment
CN114745594A (en) Method and device for generating live playback video, electronic equipment and storage medium
KR20210017478A (en) System for managing learning through preparation and review and method thereof
CN112015635A (en) Page testing method, page testing device, electronic equipment and storage medium
CN111008312A (en) Course reviewing method and system suitable for network teaching
CN111933128B (en) Method and device for processing question bank of questionnaire and electronic equipment
Diaz Cardona Ambient text and the becoming space of writing
US20230316429A1 (en) Data processing system for managing activities linked to multimedia content
US20230215282A1 (en) Generative artificial intelligence learning method and system for an on-line course
CN111309211A (en) Picture processing method and device and storage medium
US20220230558A1 (en) Coding Education System
CN115963963A (en) Interactive novel generation method, presentation method, device, equipment and medium
CN114780183A (en) Online programming learning method and device, electronic equipment and storage medium
CN109120783A (en) Information acquisition method and device, mobile terminal and computer readable storage medium
CN114741594A (en) Information pushing method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination