CN112988008A - Information display method and device, computer equipment and storage medium - Google Patents
Information display method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN112988008A CN112988008A CN202110271916.0A CN202110271916A CN112988008A CN 112988008 A CN112988008 A CN 112988008A CN 202110271916 A CN202110271916 A CN 202110271916A CN 112988008 A CN112988008 A CN 112988008A
- Authority
- CN
- China
- Prior art keywords
- information
- display
- recording
- target
- presentation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000002452 interceptive effect Effects 0.000 claims description 49
- 230000004044 response Effects 0.000 claims description 15
- 230000006870 function Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 11
- 230000001360 synchronised effect Effects 0.000 abstract description 8
- 238000012552 review Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000007667 floating Methods 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 239000000725 suspension Substances 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present disclosure provides an information display method, apparatus, computer device and storage medium, wherein the method comprises: displaying multimedia information in a display area of target equipment; responding to the playback operation of the multimedia information, and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area; the target information comprises at least one of video information, image information and audio information; and displaying the target information in a display window, and displaying the display window on the display area in an overlapping manner. The embodiment of the disclosure can realize instant playback of the multimedia information displayed in the display area, and display the multimedia information in a superposition display mode, and the content displayed after superposition does not influence the content continuously displayed in the display area, thereby realizing synchronous playing.
Description
Technical Field
The present disclosure relates to the field of video processing technologies, and in particular, to an information display method and apparatus, a computer device, and a storage medium.
Background
Nowadays, for a scene being live broadcast, a live broadcast video watched by a user cannot be played back instantly, and if a content which is difficult to understand exists in the process of watching the live broadcast by the user and needs to be watched again, the user can only watch a playback video generated after the live broadcast is finished to further review the content. However, such a solution has a high requirement for the user, for example, the user needs to remember a confusion point in the live broadcast content, and the user can review and watch the live broadcast content after the live broadcast is finished; in addition, the problem of instant playback of live video as described above is still unsolved.
Disclosure of Invention
The embodiment of the disclosure at least provides an information display method, an information display device, computer equipment and a storage medium, and effectively solves the technical problem that a live video cannot be played back instantly.
In a first aspect, an embodiment of the present disclosure provides an information display method, including:
displaying multimedia information in a display area of target equipment;
responding to the playback operation of the multimedia information, and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area; the target information comprises at least one of video information, image information and audio information;
and displaying the target information in a display window, and displaying the display window on the display area in an overlapping manner.
In an optional implementation manner, the determining, in response to a playback operation on the multimedia information and based on the multimedia information shown in the display area, target information corresponding to the playback operation includes:
responding to the playback operation of the multimedia information, and determining playback starting point information corresponding to the playback operation;
determining the position information of the target information in a storage file based on the playback starting point information and the multimedia information displayed in the display area; the storage file stores recording information obtained by recording the screen display content of the target equipment;
and determining target information corresponding to the playback operation based on the position information.
In an alternative embodiment, the screen display content includes:
multimedia information displayed in the display area; alternatively, the first and second electrodes may be,
multimedia information displayed in the display area and interactive information displayed in the interactive area.
In an optional implementation manner, the recording information obtained by recording the screen display content of the target device by the target device includes:
recording the screen display content through the system function of the target equipment to obtain the recording information;
and recording the screen display content through a user-defined recording tool so as to obtain the recording information.
In an optional embodiment, when the screen display content includes multimedia information displayed in the display area and interactive information displayed in the interactive area, recording the screen display content through a custom recording tool to obtain the recording information, including:
and respectively recording the multimedia information and the interactive information through a user-defined recording tool, and combining the two obtained recording files to obtain the recording information.
In an optional embodiment, the method further comprises:
moving the presentation window within a presentation area in response to a move operation.
In an optional embodiment, after displaying the target information in a display window and displaying the display window on the display area in an overlapping manner, the method further includes:
and closing the display window in response to the exit operation.
In a second aspect, an embodiment of the present disclosure further provides an information displaying apparatus, including:
the first display module is used for displaying the multimedia information in a display area of the target equipment;
the determining module is used for responding to the playback operation of the multimedia information and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area; the target information comprises at least one of video information, image information and audio information;
and the second display module is used for displaying the target information in a display window and displaying the display window on the display area in an overlapping manner.
In an optional implementation manner, the determining module is configured to determine, in response to a playback operation on the multimedia information, playback start point information corresponding to the playback operation; determining the position information of the target information in a storage file based on the playback starting point information and the multimedia information displayed in the display area; the storage file stores recording information obtained by recording the screen display content of the target equipment; and determining target information corresponding to the playback operation based on the position information.
In an alternative embodiment, the screen display content includes: multimedia information displayed in the display area; or the multimedia information displayed in the display area and the interactive information displayed in the interactive area.
In an optional implementation manner, the information display apparatus further includes a recording module, configured to record the screen display content through a system function of the target device to obtain the recording information; and recording the screen display content through a user-defined recording tool so as to obtain the recording information.
In an optional implementation manner, the recording module is further configured to record the multimedia information and the interactive information respectively through a user-defined recording tool, and merge two obtained recording files to obtain the recording information.
In an optional embodiment, the information presentation apparatus further comprises a moving module for moving the presentation window within the presentation area in response to a moving operation.
In an optional implementation manner, the information display apparatus further includes a closing module, configured to close the display window in response to an exit operation after the target information is displayed in the display window and the display window is displayed in an overlapping manner on the display area.
In a third aspect, an embodiment of the present disclosure further provides a computer device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the computer device is running, the machine-readable instructions when executed by the processor performing the steps of the first aspect described above, or any possible implementation of the first aspect.
In a fourth aspect, this disclosed embodiment also provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps in the first aspect or any one of the possible implementation manners of the first aspect.
For the description of the effects of the information presentation apparatus, the computer device and the storage medium, reference is made to the description of the information presentation method, which is not repeated herein.
According to the information display method, the information display device, the computer equipment and the storage medium, the multimedia information is displayed in the display area of the target equipment; responding to the playback operation of the multimedia information, and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area; the target information comprises at least one of video information, image information and audio information; the target information is displayed in the display window, the display window is displayed on the display area in an overlapped mode, compared with the live video which cannot be played back in the prior art, the multimedia information displayed in the display area can be played back in an immediately mode, the multimedia information is displayed in the display area in an overlapped mode, the content of continuous display in the display area is not affected by the target information displayed after the multimedia information is overlapped, and synchronous video playing is achieved.
Further, according to the information display method and apparatus, the computer device, and the storage medium provided by the embodiments of the present disclosure, the multimedia information and the interactive information are recorded respectively by a user-defined recording tool, and the obtained two recording files are merged to obtain the recording information, so that the display information and the interactive information are synchronously recorded.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly described below, and the drawings herein incorporated in and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It is appreciated that the following drawings depict only certain embodiments of the disclosure and are therefore not to be considered limiting of its scope, for those skilled in the art will be able to derive additional related drawings therefrom without the benefit of the inventive faculty.
Fig. 1a is a schematic view illustrating an application scenario of an information presentation method provided by an embodiment of the present disclosure;
FIG. 1b is a flow chart of an information presentation method provided by an embodiment of the present disclosure;
FIG. 2 is a schematic diagram illustrating an application client presentation effect under a playback operation indication provided by an embodiment of the present disclosure;
FIG. 3 is a flow chart illustrating determining target information for playback when a playback operation is performed as provided by an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of an information presentation device provided by an embodiment of the present disclosure;
fig. 5 shows a schematic structural diagram of a computer device provided by an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
Furthermore, the terms "first," "second," and the like in the description and in the claims, and in the drawings described above, in the embodiments of the present disclosure are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein.
Reference herein to "a plurality or a number" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Research shows that in a live scene, a live video watched by a user cannot be played back, and if the user has content which is difficult to understand in the live watching process and needs to watch again, the user can only watch the playback video generated after the live watching is finished to further review the content. However, such a solution is highly desirable for users, for example, the user is required to remember a confusion point in the live content, and the live content can be viewed in a review mode after the live content is finished.
Based on the research, the present disclosure provides an information display method, an information display apparatus, a computer device, and a storage medium, which can realize instant playback of multimedia information displayed in a display area, and display the multimedia information in a display mode by superposition, wherein target information displayed after superposition does not affect the content continuously displayed in the display area, thereby realizing synchronous video playing.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
To facilitate understanding of the present embodiment, an application scenario of the information display method disclosed in the embodiment of the present disclosure is first described. As shown in fig. 1a, which is a schematic view of an application scenario of the information presentation method, a user 10 logs in an application server 12 through an application client 11 installed in a terminal device, where the application client 11 may be a browser of a web page, or an application client installed in a terminal device, such as a mobile phone, a tablet computer, and the like.
The terminal device and the application server 12 are communicatively connected through a communication network, which may be a local area network, a cellular network, a wide area network, and the like. The terminal device may be a portable device, such as a mobile phone, a tablet Computer, a notebook Computer, or a Personal Computer (PC). Application server 12 may be any device capable of providing internet services.
The application server 12 may provide different internet services for the User, for example, in a scene for live broadcast, the application server 12 may provide live broadcast video for the User, specifically, in a case that the User 10 watches the live broadcast video, the network download module 1110 of the live broadcast player 111 may download the live broadcast video from the application server 12 according to a live broadcast address, the live broadcast player 111 performs decoding rendering processing on an image in the obtained live broadcast video, and displays the decoded rendered image to the User 10 through a live broadcast Interface (UI) 1131 in the User Interface layer 113. Or, the application server 12 may also provide live broadcast manuscript pictures for the user, specifically, when the user 10 watches live broadcast manuscript pictures, the network download module 1110 of the live broadcast player 111 may download live broadcast manuscript pictures from the application server 12 according to a live broadcast address, the live broadcast player 111 performs decoding rendering processing on the obtained live broadcast manuscript pictures, and displays the decoded rendered manuscript pictures to the user 10 through the live broadcast UI1131 in the user interface layer 113. Alternatively, the application server 12 may also provide live audio for the user, and specifically, in a case where the user 10 listens to the live audio, the network download module 1110 of the live player 111 may download the live audio from the application server 12 according to the live address, and play the live audio to the user 10 through the live UI1131 in the user interface layer 113.
To facilitate understanding of the present embodiment, first, an information displaying method disclosed in the embodiments of the present disclosure is described in detail, where an execution subject of the information displaying method provided in the embodiments of the present disclosure is generally a computer device with certain computing capability, and the computer device includes, for example: a terminal device, which may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle mounted device, a wearable device, or a server or other processing device. In some possible implementations, the information presentation method may be implemented by a processor calling computer readable instructions stored in a memory.
The information presentation method provided by the embodiment of the present disclosure is described below by taking an execution subject as a computer device as an example.
The scene of trial of the information display method provided by the embodiment of the disclosure is a scene of realizing synchronous playback of live courses in an online education system, for example, students can synchronously watch live course contents when watching the live courses. By adopting the method, the condition that the user temporarily reviews the content of the previous moment when watching the live course can be met, the user has novel experience of synchronously reviewing the picture of the previous moment when watching the live course, meanwhile, an instant playback function is added for the live course, the rationality of the live course is improved, especially when the student watches the live course, the student is effectively helped to review the knowledge point of the previous moment, and the learning quality and the learning efficiency of the student in a live course are improved.
Based on the above live broadcast scenario, an embodiment of the present disclosure provides an information display method, as shown in fig. 1b, which may include steps S101 to S103, where:
s101: and displaying the multimedia information in a display area of the target equipment.
In this step, the target device may be a terminal device, including a portable device, such as a mobile phone, a tablet computer, a notebook computer, and the like; or, a PC. The presentation area may be the live UI1131, or may be any presentation window, and the like, where the meaning of the presentation area in different application scenes may be different, and is not specifically limited herein.
Here, the multimedia information displayed in the presentation area may be displayed through a screen, and in addition, the screen display content may further include the multimedia information presented in the presentation area and the interactive information presented in the interactive area. Of course, the on-screen display content may also include other information displayed on the screen, such as anchor avatar information, status bar information, and the like.
Specifically, the multimedia information may be an image transmitted through all transmission paths that can be seen by a user displayed in the display area; alternatively, audio transmitted over all transmission paths that are audible to a user presented in the area may also be presented. Here, the overall transmission path may include one or more of a path for a player to upload video, images, and audio, a path for an interactive module to upload interactive images, and the like. The images may include video images, presentation (Power Point, PPT), and the like.
In addition, the embodiment of the disclosure can also realize synchronous playback and recording for the multimedia information displayed in real time.
Here, the screen display content may be recorded through a system function of the target device to obtain recording information; or, the screen display content can be recorded through a user-defined recording tool to obtain recording information. The embodiments of the present disclosure do not limit this.
In a possible implementation manner, the multimedia information and the interactive information may be recorded separately by a user-defined recording tool, and the two obtained recording files are combined to obtain the recording information. Illustratively, the multimedia information may include video, pictures, audio, text, animation, etc. that is being live. The interactive information may include interactive information between the management client and the user client, and specifically may include interactive images, interactive audio, and the like.
Here, the recording information may be stored in a storage file, in which recording information obtained by recording the screen display content of the target device is stored.
In one embodiment, in the case that the multimedia information includes a video image or a manuscript image, the image frame group can be continuously extracted from the multimedia information displayed by the target device through the system function or the customized recording tool of the target device; and respectively determining the target image frame corresponding to each image frame group, realizing the recording of the image, and storing the target image frame into a storage file.
Here, the storage file may be a local temporary file in the application client 11.
The image frame group may include screen display content, specifically, multimedia information, such as a video view image, presented in the presentation area at the same time, or may further include a video view image and an interactive image overlaid on the video view image.
For example, the video view image may be a live video image and a play control image, the interactive image may be an interactive information image between the management client and the user client, and in a scene in which live lessons are played in online education, the interactive image may be an interactive information image between the teacher client and the student client, such as an answer message image provided by a teacher, a message image for a student to answer a question, and the like.
For the case that the video view image or two different images of the video view image and the interactive image overlaid on the video view image exist in the image frame group, the storage of the image can be completed by the following processing modes:
one embodiment is that, in the case of extracting the interactive image from the multimedia information, the interactive image and the video view image with the same presentation time instant extracted from the multimedia information are used as the image frame group; and when the image frame group comprises the interactive image and the video view image, combining the interactive image and the video view image in the image frame group to obtain a target image frame corresponding to the image frame group, and storing the target image frame into a storage file. In specific implementation, when an interactive image is displayed in a display area, the interactive image and a video view image displayed at the same time as the interactive image are extracted from multimedia information, the video view image having the same display time as the interactive image can be merged with the interactive image through a view drawing cache module (e.g., view.
In another embodiment, under the condition that the interactive image is not extracted from the multimedia information, the video view image extracted from the multimedia information at the moment is used as the image frame group; and taking the video view image in the image frame group as a target image frame corresponding to the image frame group. In specific implementation, when the interactive image is not extracted from the multimedia information, the video view image extracted from the multimedia information may be transmitted to a video coding model for coding, and each frame of the target image after coding may be stored in a storage file in a time sequence.
For example, when the live UI1131 displays a live video image, the screen recording module 112 in the application client 11 may synchronously extract image frames continuously displayed in the multimedia information in the live UI, and store the extracted continuous image frames in a local temporary file in the application client 11 when there is no interactive image in the currently extracted continuous image frames, so as to implement synchronous recording. Under the condition that interactive images exist in currently extracted continuous image frames, combining the video view images with the same display time as the interactive images with the interactive images to obtain target image frames, and storing the continuously combined multi-frame image frames in a local temporary file in an application client 11 to realize synchronous recording. It should be noted that, after the user views the live video, the image resource stored in the local temporary file automatically clears the specified temporary file by the application client.
Here, the screen recording module 112 includes a system function or a custom recording tool of the target device.
In another embodiment, in the case that the multimedia information includes audio information, audio data may be continuously extracted from the multimedia information displayed by the target device through a system function of the target device or a custom recording tool, so as to record audio, and store the audio data in the storage file.
S102: and responding to the playback operation of the multimedia information, and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area.
In this step, the playback operation may be any position point of the display content progress bar generated in the display area by clicking, as shown in fig. 2, which is a schematic diagram of the application client display effect under the instruction of the playback operation, where the display content progress bar 21, the playback position point 22, the display window 23, and the display area 24 are shown.
Referring to fig. 3, a flowchart for determining target information for playback when a playback operation is performed includes steps S301 to S303, where:
s301: in response to a playback operation on the multimedia information, playback start point information corresponding to the playback operation is determined.
In this step, the playback start point information may include a final stop position of the progress bar for displaying the content triggered by the user. And aiming at the video images and/or the manuscript images stored in the storage file, the position of the display content progress bar corresponds to the storage time of each target image frame in the storage file. And aiming at the audio data stored in the storage file, the position of the display content progress bar corresponds to each audio data continuously stored in the storage file.
S302: and determining the position information of the target information in the storage file based on the playback starting point information and the multimedia information displayed in the display area.
In one embodiment, for playing back a live video, the start position of the playback video corresponding to the progress bar of the display content may be determined based on the playback start point information and the multimedia information displayed in the display area, and a ratio between a time length from the start position of the live video to the playback start point position and a time length of the stored file may be further determined; based on the ratio, the location information of the target information in the storage file can be determined. Here, the target information may include the above-described target image frame.
For example, as shown in fig. 2, it may be determined that the playback start point information is a position point corresponding to 28 minutes, the position point when the live video is currently broadcast is 59 minutes, based on the live broadcast time length and the time length of the storage file, a ratio between the time length from the start position of the live video to the playback start point position and the time length of the storage file is 28/59, and the position of the target image frame in the storage file may be correspondingly found according to the time sequence of the target image frame stored in the storage file.
In one embodiment, for the playback audio information, the start position of the playback video corresponding to the display content progress bar may be determined based on the playback start point information and the multimedia information displayed in the display area, and a ratio between a time length from the start position of the live audio to the playback start point position and a time length of the stored file may be further determined; based on the ratio, the location information of the target information in the storage file can be determined. Here, the target information may include the above-described audio data.
S303: based on the position information, target information corresponding to the playback operation is determined.
Specifically, the target information may include multimedia information stored in a storage file; or multimedia information and interactive information.
Continuing the above example, after the position of the target image frame in the storage file corresponding to the playback start point indicated by the playback operation is determined, that is, the position point of 28 minutes, the target image frame corresponding to the 28-minute time instant is found in the storage file, and the target image frame at the position corresponding to the playback operation for 28 minutes and the subsequent target image frames are displayed in the display window. In the case where the application client does not respond to the closing operation, the video playback time may continue until a point in time at which the live broadcast ends.
Continuing the step S102:
s103: and displaying the target information in the display window, and displaying the display window on the display area in an overlapping manner.
In specific implementation, after the application client 11 responds to the playback operation, a display window, that is, the playback UI1132 pops up in the display area, where the playback UI1132 may be a floating window and is used to display target information corresponding to the playback operation.
Illustratively, under the scene that a student watches a live video course, the student can display a plurality of continuous target image frames in a suspension window in an overlapping manner by clicking a video position point needing to be played back of a progress bar for displaying the content, and the student can review knowledge points in the previous period of time through the suspension window, so that the learning quality and the learning efficiency of the student in the live video course are effectively improved.
Illustratively, in a scene that a student listens to a live audio course, the student can display the played back audio data and the interaction information in a floating window in an overlapping manner by clicking a position point of the audio needing to be played back of the content progress bar, and the student reviews the knowledge point in the last period of time through the floating window.
It should be noted that, while the playback UI1132 displays content, live content played by the live UI1131 is not affected, and illustratively, live video information and playback video information are displayed synchronously, so that a dual-interface playing form is implemented.
In a possible implementation, after the application client 11 responds to the playback operation, it may also respond to a moving operation, where the moving operation is used to arbitrarily move the presentation window within the presentation area, so as to avoid the presentation window from blocking the key content being live. Here, the ratio of the size of the area of the display window to the size of the area of the display area may be set in a preset ratio, or may be defined according to an empirical value of a skilled person, and is not limited herein.
In one possible embodiment, after the application client 11 responds to the playback operation, the presentation window may be closed in response to an exit operation. For example, in a scene in which a student watches a live course, when the student finishes reviewing a playback knowledge point, the student may close the playback UI1132 and stop playing the playback video by clicking the playback UI1132 or the live UI 1131.
Through the steps S101 to S103, the screen display content in the live broadcast process is stored in the storage file in real time, and the storage file is called, so that the instant display of the playback target information is realized, the instant playback function in the live broadcast process is increased, and a user has novel experience of synchronously playing back the previous picture when watching the live broadcast video; in addition, the display windows are displayed in the display area in an overlapped mode, synchronous display of live videos and playback videos is achieved, namely a double-interface display mode is achieved, the playback UI does not influence content display of the live UI, when a student watches live courses, the student is effectively helped to review last knowledge points, and learning quality and learning efficiency of the student in live courses are improved.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
Based on the same inventive concept, an information display device corresponding to the information display method is also provided in the embodiments of the present disclosure, and as the principle of solving the problem of the device in the embodiments of the present disclosure is similar to the information display method in the embodiments of the present disclosure, the implementation of the device may refer to the implementation of the method, and repeated details are not repeated.
Referring to fig. 4, a schematic diagram of an information displaying apparatus provided in an embodiment of the present disclosure is shown, where the apparatus includes: a first display module 401, a determination module 402, a second display module 403; wherein the content of the first and second substances,
a first presentation module 401, configured to present multimedia information in a presentation area of a target device;
a determining module 402, configured to determine, in response to a playback operation on the multimedia information, target information corresponding to the playback operation based on the multimedia information displayed in the display area; the target information comprises at least one of video information, image information and audio information;
the second display module 403 is configured to display the target information in a display window, and display the display window on the display area in an overlapping manner.
In an optional implementation manner, the determining module 402 is configured to determine, in response to a playback operation on the multimedia information, playback start point information corresponding to the playback operation; determining the position information of the target information in a storage file based on the playback starting point information and the multimedia information displayed in the display area; the storage file stores recording information obtained by recording the screen display content of the target equipment; and determining target information corresponding to the playback operation based on the position information.
In an alternative embodiment, the screen display content includes: multimedia information displayed in the display area; or the multimedia information displayed in the display area and the interactive information displayed in the interactive area.
In an optional implementation manner, the information displaying apparatus further includes a recording module 404, configured to record the screen display content through a system function of the target device to obtain the recording information; and recording the screen display content through a user-defined recording tool so as to obtain the recording information.
In an optional implementation manner, the recording module 404 is further configured to record the multimedia information and the interactive information respectively through a user-defined recording tool, and combine the two obtained recording files to obtain the recording information.
In an optional embodiment, the information display apparatus further comprises a moving module 405 for moving the display window within the display area in response to the moving operation.
In an optional implementation manner, the information displaying apparatus further includes a closing module 406, configured to close the display window in response to an exit operation after the target information is displayed in the display window and the display window is displayed in an overlapping manner on the display area.
The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.
Based on the same technical concept, the embodiment of the application also provides computer equipment. Referring to fig. 5, a schematic structural diagram of a computer device provided in an embodiment of the present application includes:
a processor 51, a memory 52 and a bus 53. Wherein the memory 52 stores machine-readable instructions executable by the processor 51, and the processor 51 is configured to execute the machine-readable instructions stored in the memory 52, and when the machine-readable instructions are executed by the processor 51, the processor 51 performs the following steps: s101: displaying multimedia information in a display area of target equipment; s102: responding to the playback operation of the multimedia information, and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area; s103: and displaying the target information in the display window, and displaying the display window on the display area in an overlapping manner.
The storage 52 includes a memory 521 and an external storage 522; the memory 521 is also referred to as an internal memory, and is used for temporarily storing the operation data in the processor 51 and the data exchanged with the external storage 522 such as a hard disk, the processor 51 exchanges data with the external storage 522 through the memory 521, and when the computer device is operated, the processor 51 communicates with the storage 52 through the bus 53, so that the processor 51 executes the execution instructions mentioned in the above method embodiments.
The embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the information presentation method in the foregoing method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.
The embodiments of the present disclosure also provide a computer program product, where the computer program product carries a program code, and instructions included in the program code may be used to execute the steps of the information displaying method in the foregoing method embodiments, which may be referred to specifically in the foregoing method embodiments, and are not described herein again.
The computer program product may be implemented by hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and there may be other divisions in actual implementation, and for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or modules through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional modules in the embodiments of the present disclosure may be integrated into one processing module, or each module may exist alone physically, or two or more modules are integrated into one module.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (10)
1. An information display method, comprising:
displaying multimedia information in a display area of target equipment;
responding to the playback operation of the multimedia information, and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area; the target information comprises at least one of video information, image information and audio information;
and displaying the target information in a display window, and displaying the display window on the display area in an overlapping manner.
2. The information presentation method according to claim 1, wherein the determining, in response to a playback operation on the multimedia information, target information corresponding to the playback operation based on the multimedia information presented in the presentation area comprises:
responding to the playback operation of the multimedia information, and determining playback starting point information corresponding to the playback operation;
determining the position information of the target information in a storage file based on the playback starting point information and the multimedia information displayed in the display area; the storage file stores recording information obtained by recording the screen display content of the target equipment;
and determining target information corresponding to the playback operation based on the position information.
3. The information presentation method of claim 2, wherein the screen display content comprises:
multimedia information displayed in the display area; alternatively, the first and second electrodes may be,
multimedia information displayed in the display area and interactive information displayed in the interactive area.
4. The information presentation method of claim 3, wherein the recording information obtained by recording the screen display content of the target device comprises:
recording the screen display content through the system function of the target equipment to obtain the recording information;
and recording the screen display content through a user-defined recording tool so as to obtain the recording information.
5. The information presentation method of claim 4, wherein when the screen presentation content includes the multimedia information presented in the presentation area and the interactive information presented in the interactive area, recording the screen display content by a customized recording tool to obtain the recorded information, comprising:
and respectively recording the multimedia information and the interactive information through a user-defined recording tool, and combining the two obtained recording files to obtain the recording information.
6. The information presentation method of claim 2, further comprising:
moving the presentation window within a presentation area in response to a move operation.
7. The information presentation method according to claim 1, further comprising, after presenting the target information in a presentation window and displaying the presentation window on the presentation area in an overlapping manner:
and closing the display window in response to the exit operation.
8. An information presentation device, comprising:
the first display module is used for displaying the multimedia information in a display area of the target equipment;
the determining module is used for responding to the playback operation of the multimedia information and determining target information corresponding to the playback operation based on the multimedia information displayed in the display area; the target information comprises at least one of video information, image information and audio information;
and the second display module is used for displaying the target information in a display window and displaying the display window on the display area in an overlapping manner.
9. A computer device, comprising: processor, memory and bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when a computer device is running, the machine-readable instructions when executed by the processor performing the steps of the information presentation method according to any one of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the information presentation method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110271916.0A CN112988008A (en) | 2021-03-12 | 2021-03-12 | Information display method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110271916.0A CN112988008A (en) | 2021-03-12 | 2021-03-12 | Information display method and device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112988008A true CN112988008A (en) | 2021-06-18 |
Family
ID=76335365
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110271916.0A Pending CN112988008A (en) | 2021-03-12 | 2021-03-12 | Information display method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112988008A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114501113A (en) * | 2022-01-30 | 2022-05-13 | 深圳创维－Rgb电子有限公司 | Screen projection recording method, screen projection recording equipment and computer readable storage medium |
| CN114554234A (en) * | 2022-01-18 | 2022-05-27 | 阿里巴巴（中国）有限公司 | Method, device, storage medium, processor and system for generating live broadcast record |
| CN114501113B (en) * | 2022-01-30 | 2024-05-31 | 深圳创维－Rgb电子有限公司 | Screen projection recording method, device and computer readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917591A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Method and device for playing back live video |
| CN106385619A (en) * | 2016-09-14 | 2017-02-08 | 乐视控股（北京）有限公司 | Replay method and device for live broadcast video stream |
| CN106804000A (en) * | 2017-02-28 | 2017-06-06 | 北京小米移动软件有限公司 | Direct playing and playback method and device |
| CN108540854A (en) * | 2018-03-29 | 2018-09-14 | 努比亚技术有限公司 | Live video clipping method, terminal and computer readable storage medium |
| CN109600678A (en) * | 2018-12-19 | 2019-04-09 | 北京达佳互联信息技术有限公司 | Information displaying method, apparatus and system, server, terminal, storage medium |
| EP3471421A1 (en) * | 2017-09-01 | 2019-04-17 | Wangsu Science & Technology Co., Ltd. | Live broadcast video replay method, server, and system |
-
2021
- 2021-03-12 CN CN202110271916.0A patent/CN112988008A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917591A (en) * | 2009-12-17 | 2010-12-15 | 新奥特（北京）视频技术有限公司 | Method and device for playing back live video |
| CN106385619A (en) * | 2016-09-14 | 2017-02-08 | 乐视控股（北京）有限公司 | Replay method and device for live broadcast video stream |
| CN106804000A (en) * | 2017-02-28 | 2017-06-06 | 北京小米移动软件有限公司 | Direct playing and playback method and device |
| EP3471421A1 (en) * | 2017-09-01 | 2019-04-17 | Wangsu Science & Technology Co., Ltd. | Live broadcast video replay method, server, and system |
| CN108540854A (en) * | 2018-03-29 | 2018-09-14 | 努比亚技术有限公司 | Live video clipping method, terminal and computer readable storage medium |
| CN109600678A (en) * | 2018-12-19 | 2019-04-09 | 北京达佳互联信息技术有限公司 | Information displaying method, apparatus and system, server, terminal, storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114554234A (en) * | 2022-01-18 | 2022-05-27 | 阿里巴巴（中国）有限公司 | Method, device, storage medium, processor and system for generating live broadcast record |
| CN114501113A (en) * | 2022-01-30 | 2022-05-13 | 深圳创维－Rgb电子有限公司 | Screen projection recording method, screen projection recording equipment and computer readable storage medium |
| CN114501113B (en) * | 2022-01-30 | 2024-05-31 | 深圳创维－Rgb电子有限公司 | Screen projection recording method, device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10448081B2 (en) | Multimedia information processing method, terminal, and computer storage medium for interactive user screen | |
| CN111078070B (en) | PPT video barrage play control method, device, terminal and medium | |
| CN111131876B (en) | Control method, device and terminal for live video and computer readable storage medium | |
| US20140181674A1 (en) | Multimedia presentation editor for a small-display communication terminal or computing device | |
| CN112437353B (en) | Video processing method, video processing device, electronic apparatus, and readable storage medium | |
| CN107333164B (en) | Image data processing method and device | |
| CN109508090B (en) | Augmented reality panel system with interchangeability | |
| CN111078078B (en) | Video playing control method, device, terminal and computer readable storage medium | |
| CN106095229A (en) | The display packing of a kind of mobile terminal and device | |
| CN114205635A (en) | Live comment display method, device, equipment, program product and medium | |
| CN105575198A (en) | Method and device for demonstrating teaching video | |
| CN111629222A (en) | Video processing method, device and storage medium | |
| CN102663907B (en) | Video teaching system and video teaching method | |
| CN112988008A (en) | Information display method and device, computer equipment and storage medium | |
| CN110753246A (en) | Video playing method, client, server and system | |
| CN111984126A (en) | Answer record generation method and device, electronic equipment and storage medium | |
| CN106790196A (en) | The interactive method and apparatus of red packet | |
| CN116069211A (en) | Screen recording processing method and terminal equipment | |
| JP6567461B2 (en) | Recognition device, video content presentation system, program | |
| CN116137662A (en) | Page display method and device, electronic equipment, storage medium and program product | |
| KR100688387B1 (en) | method for providing animation lecture for PDA | |
| CN106375825A (en) | Picture generation processing method and apparatus, and picture display processing method and apparatus | |
| CN114846808A (en) | Content distribution system, content distribution method, and content distribution program | |
| CN106648757B (en) | Data processing method of virtual reality terminal and virtual reality terminal | |
| CN114666648B (en) | Video playing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210618 |