CN113794936B - Method, device, system, equipment and medium for generating highlight instant - Google Patents

Method, device, system, equipment and medium for generating highlight instant Download PDF

Info

Publication number
CN113794936B
CN113794936B CN202111057574.9A CN202111057574A CN113794936B CN 113794936 B CN113794936 B CN 113794936B CN 202111057574 A CN202111057574 A CN 202111057574A CN 113794936 B CN113794936 B CN 113794936B
Authority
CN
China
Prior art keywords
video frame
highlight
viewing angle
target
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111057574.9A
Other languages
Chinese (zh)
Other versions
CN113794936A (en
Inventor
金友芝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN202111057574.9A priority Critical patent/CN113794936B/en
Publication of CN113794936A publication Critical patent/CN113794936A/en
Application granted granted Critical
Publication of CN113794936B publication Critical patent/CN113794936B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

The embodiment of the disclosure discloses a method, a device, a system, equipment and a medium for generating a highlight instant, wherein the method is applied to a user side and comprises the following steps: if the highlight instant generation operation triggered by the user aiming at the current video frame displayed currently in the free view video is detected, determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame; transmitting the highlight instant generation request to a media server, so that the media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and transmits the target video frame to a user side based on a preset transmitting mode; based on a preset display mode matched with a preset issuing mode, the received target video frame is displayed on a playing interface, so that the wonderful moment in the free view video can be dynamically generated, the personalized requirements of users are met, and the viewing experience of the users is improved.

Description

Method, device, system, equipment and medium for generating highlight instant
Technical Field
The embodiment of the disclosure relates to the internet technology, in particular to a method, a device, a system, equipment and a medium for generating a wonderful instant.
Background
With the rapid development of internet technology and the increasing demand of users, a free view video has been developed so that users can watch videos from different views. However, in the process of watching the video at the free viewing angle, the user can only watch the video frame corresponding to a certain viewing angle at the same playing time, and cannot support the user to watch the video frame corresponding to a certain playing time at different viewing angles, namely, the wonderful moment. As can be seen, there is a great need for a way in which the highlight instants can be dynamically generated so that the user can view the highlight instants at any time in the freeview video.
Disclosure of Invention
The embodiment of the disclosure provides a method, a device, a system, equipment and a medium for generating a wonderful moment, so as to dynamically generate the wonderful moment in a free view video, meet the personalized requirements of users and promote the watching experience of the users.
In a first aspect, an embodiment of the present disclosure provides a method for generating a highlight instant, which is applied to a user terminal, including:
if the highlight instant generation operation triggered by the user aiming at the current video frame displayed currently in the free view video is detected, determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame;
The highlight instant generation request is sent to a media server, so that the media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode;
and displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
In a second aspect, an embodiment of the present disclosure further provides a method for generating a highlight moment, which is applied to a media server, including:
receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by the user aiming at the current displayed video frame in the free view video;
determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request;
And sending the target video frame to the user side based on a preset issuing mode, so that the user side displays the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
In a third aspect, an embodiment of the present disclosure further provides a device for generating a wonderful moment, integrated at a user terminal, including:
the highlight instant generation request determining module is used for determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame if highlight instant generation operation triggered by a user aiming at the current video frame displayed in the free view video is detected;
a highlight moment generation request sending module, configured to send the highlight moment generation request to a media server, so that the media server determines, according to the current video frame identification information in the highlight moment generation request, each target video frame having a different viewing angle at the same playing time as the current video frame, and sends the target video frame to the user terminal based on a preset issuing mode;
and the target video frame display module is used for displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
In a fourth aspect, an embodiment of the present disclosure further provides a wonderful instant generating device, integrated in a media server, including:
the highlight instant generation request receiving module is used for receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by a user aiming at the current video frame displayed in the free view video;
the target video frame determining module is used for determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request;
and the target video frame sending module is used for sending the target video frame to the user side based on a preset issuing mode so that the user side can display the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
In a fifth aspect, embodiments of the present disclosure also provide a highlight instant generating system, the system comprising: a user terminal and a media server;
The client is used for realizing the highlight instant generation method provided by the first aspect of the disclosure;
the media server is configured to implement the highlight instant generating method as provided in the second aspect of the present disclosure.
In a sixth aspect, embodiments of the present disclosure further provide an electronic device, including:
one or more processors;
a memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the highlight moment generating method as described in any one of the embodiments of the present disclosure.
In a seventh aspect, the disclosed embodiments also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a highlight moment generating method according to any of the disclosed embodiments.
According to the technical scheme, when the user side detects the highlight instant generation operation triggered by the user on the current video frame currently displayed in the free view video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server. The media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode. The user side displays the received target video frames under different viewing angles on the playing interface based on the preset display mode matched with the preset issuing mode, namely, the highlight moment under the same playing time with the current video frame, so that the highlight moment under any playing time in the free viewing angle video can be dynamically generated and displayed based on the user triggering operation, the personalized requirements of the user are met, the video playing effect is enriched, and the viewing experience of the user is improved.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
FIG. 1 is a flow chart of a highlight moment generating method according to a first embodiment of the present disclosure;
FIG. 2 is an example of a highlight moment generation process according to one embodiment of the present disclosure;
FIG. 3 is a flow chart of a highlight instant generation method according to a second embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a highlight instant generating device according to a third embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a highlight instant generating device according to a fourth embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a wonderful momentary generating system according to a fifth embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to a sixth embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
Example 1
Fig. 1 is a flowchart of a method for generating a highlight moment according to a first embodiment of the present disclosure, where the present embodiment is applicable to a situation of dynamically generating a highlight moment at any play time in a free view video, and particularly may be used to generate an application scene of the highlight moment in a live or on-demand free view video. The method may be performed by a highlight reel generating device, which may be implemented in software and/or hardware, integrated in the client. As shown in fig. 1, the method specifically includes the following steps:
s110, if the highlight instant generation operation triggered by the user aiming at the current video frame displayed in the free view video is detected, determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame.
The free view video may be a video shot in real time, i.e., a live video. For example, live video obtained by shooting the same object in real time by using cameras under different view angles. The freeview video may also be a video that has been captured, i.e., an on-demand video. For example, video-on-demand obtained after shooting the same object by using cameras under different view angles in advance is completed. The current video frame may refer to a video frame presented on the current playback interface when the user triggers the highlight instant generating operation. The current video frame may be used to characterize the play time corresponding to the highlight instant the user wants to watch. Each video frame in the freeview video can be uniquely identified by using the identification information so as to distinguish the video frames at different playing moments. For example, the current video frame identification information may be, but is not limited to, a play time stamp or a frame number corresponding to the current video frame. The play time stamp may refer to a play time of the current video frame in the freeview video. The frame number may refer to a play position of the current video frame in the video stream at the current viewing angle.
Specifically, when the user views the video stream at a certain viewing angle on the playing interface of the user side, if the user wants to view the wonderful moment at a certain playing moment, the user can pause the video onto the video frame corresponding to the playing moment, for example, the user can pause the video onto the playing moment corresponding to the wonderful moment to be generated by dragging the video playing progress. The user can trigger the highlight instant generation operation in a preset trigger mode on the basis of the current video frame displayed after the video is paused, for example, the user can trigger the highlight instant generation operation in a mode of clicking a preset button, so that when the user side detects the highlight instant generation operation triggered by the user, a highlight instant generation request is obtained based on the current video frame identification information corresponding to the current displayed current video frame. For example, the user side may generate a request for generating a highlight moment including a play time stamp corresponding to the current video frame, or generate a request for generating a highlight moment including a frame number corresponding to the current video frame.
And S120, sending the highlight instant generation request to the media server, so that the media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sending the target video frame to the user side based on a preset issuing mode.
The media server may refer to a background server for storing video streams corresponding to each view angle. The target video frame may refer to a video frame at the same play time as the current video frame. The target video frames may include current video frames, i.e., the number of target video frames is equal to the number of viewing perspectives supported for viewing by the freeview video. The target video frames may not include the current video frame, i.e., the viewing angle corresponding to each target video frame is different from the viewing angle corresponding to the current video frame. For example, the freeview video supports viewing 128 views, so that 128 target video frames at the same play time or 127 target video frames other than the current video frame can be obtained. The preset issuing mode may be a sending mode of sending the target video frame by the media server, which is preset based on the service requirement. For example, the preset issuing mode may include active issuing or passive issuing.
Specifically, the client sends the highlight instant generation request to the media server, after receiving the highlight instant generation request, the media server can determine, from the video streams corresponding to each viewing angle, a target video frame at the same playing time as the current video frame based on the current video frame identification information in the highlight instant generation request, for example, the video frames with the same video frame identification information in each video stream are used as target video frames, so that each target video frame in different viewing angles can be obtained, and the highlight instant corresponding to the current video frame is obtained. The media server may send the target video frame to the client according to a preset issuing mode.
S130, displaying the received target video frame on a playing interface based on a preset display mode matched with a preset issuing mode.
The preset display mode can be preset based on service requirements and used for displaying target video frames with different viewing angles, namely a wonderful instant display mode. The preset display mode can be configured correspondingly based on the preset issuing mode, so that the preset display mode is matched with the preset issuing mode.
Specifically, after receiving the target video frame sent by the media server based on the preset issuing mode, the user can display the target video frame on the playing interface based on the preset display mode matched with the preset issuing mode, for example, the target video frame can be displayed on the playing interface in a popup window mode, so that the user can watch the highlight moment corresponding to the current video frame, the video playing effect is enriched, the user can trigger the highlight moment generating operation aiming at the video frame at any playing moment, the highlight moment at any playing moment in the free view video can be dynamically generated and displayed, the personalized requirements of the user are met, and the user watching experience is improved. For example, a referee can view video frames corresponding to different viewing angles at any key time by viewing the dancing game video, so that whether the dancing gesture of a competitor is standard or not can be accurately determined from multiple angles.
According to the technical scheme, when the user side detects the highlight instant generation operation triggered by the user on the current video frame currently displayed in the free view video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server. The media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode. The user side displays the received target video frames under different viewing angles on the playing interface based on the preset display mode matched with the preset issuing mode, namely, the highlight moment under the same playing time with the current video frame, so that the highlight moment under any playing time in the free viewing angle video can be dynamically generated and displayed based on the user triggering operation, the personalized requirements of the user are met, the video playing effect is enriched, and the viewing experience of the user is improved.
Based on the above technical solution, as an implementation manner of the preset display manner, S130 may include: receiving each target video frame corresponding to each viewing angle sent by a media server, and caching each target video frame; determining the target viewing angle information after switching based on the viewing angle switching operation triggered by the user; and determining target video frames to be displayed corresponding to the target viewing angle information from the cached target video frames, and displaying the target video frames to be displayed on a playing interface.
The viewing angle switching operation may be an operation of switching a current viewing angle of a currently played free-view video by a user. The user can select a highlight moment at a certain viewing angle that is desired to be viewed by using the viewing angle switching operation.
Specifically, the media server may actively issue all the determined target video frames to the user side at one time, where the user side caches all the received target video frames, detects whether there is a viewing angle switching operation triggered by the user in real time, if the viewing angle switching operation is detected, determines the switched target viewing angle information based on the viewing angle switching operation, and obtains the target video frame to be displayed corresponding to the target viewing angle information according to the viewing angle information corresponding to each cached target video frame. The user side can enable the user to watch the wonderful moment at the appointed visual angle which the user wants to watch by displaying the target video frame to be displayed on the playing interface. According to the embodiment of the invention, the user side caches all target video frames sent by the media server, so that the highlight moment under the appointed visual angle can be rapidly displayed based on the visual angle switching operation triggered by the user, the user can rapidly browse the highlight moment, and the user watching experience is further improved.
By way of example, fig. 2 gives an example of a highlight instant generation process. As shown in fig. 2, the media server stores N video streams corresponding to the aligned N views. When the video watched by the user in the user terminal is a video stream corresponding to the view angle 2 and the user triggers a highlight moment generating operation for the current video frame currently displayed by the video stream (namely, the user triggering moment identified in fig. 2), the media server can send each target video frame at the playing moment corresponding to the user triggering moment to the user terminal, namely, send the target video frame at each view angle from the view angle 1 to the view angle N to the user terminal, the user terminal can cache each target video frame and display the corresponding target video frame based on the watch view angle switching operation triggered by the user, so that the user can browse the highlight moment freely and quickly.
Illustratively, the switched target viewing angle information may be determined by at least the following:
the first determination mode is as follows: and determining the switched target viewing angle information according to the sliding operation of the user.
Specifically, the user may slide on a preset disc including each view angle to perform view angle switching, or may perform a sliding operation on a user side screen to perform view angle switching. For example, determining the switched target viewing angle information according to the user sliding operation may include: if the user slides the screen leftwards, the next viewing angle information of the current viewing angle information along the anticlockwise direction is used as the target viewing angle information after switching; and if the user slides the screen rightward, taking the next viewing angle information of the current viewing angle viewing information along the clockwise direction as target viewing angle information after the viewing angle is switched. As shown in fig. 2, the current viewing angle of the user is angle 2, and when the user slides left, angle 1 can be used as the switched target viewing angle, so that the target video frame corresponding to angle 1 can be displayed. When the user slides right, the view angle 3 can be used as a switched target viewing view angle, so that a target video frame corresponding to the view angle 3 can be displayed.
The user side in the embodiment of the disclosure may further determine target viewing angle information after the angle of view is switched according to the sliding direction and the sliding distance of the user. For example, the viewing angle offset direction is determined according to the user sliding direction, and the number of viewing angle offsets with respect to the current viewing angle is determined according to the user current sliding distance, so that a plurality of viewing angles can be switched at one time, and the switching operation is simplified. Illustratively, if the user slides the screen to the left, the viewing angle offset direction is determined to be a counterclockwise direction; if the user slides the screen to the right, the viewing angle offset direction is determined to be clockwise. According to the preset corresponding relation between the sliding distance and the offset number and the current sliding distance of the user, the offset number of the viewing angle relative to the current viewing angle can be determined, and the information of the target viewing angle after switching is obtained.
The second determination mode: and determining the target viewing angle information after switching according to the operation of clicking the viewing angle by the user.
Specifically, a viewing angle button corresponding to each viewing angle that the user can select to view can be displayed on a playing interface of the user side, so that the user can click on the corresponding viewing angle button based on the viewing angle that the user wants to switch, the user side can quickly obtain target viewing angle information after the viewing angle is switched based on the viewing angle button clicked by the user, and further the viewing angle switching efficiency is improved.
Based on the above technical solutions, as another implementation manner of the preset display manner, S130 may further include: determining the target viewing angle information after switching based on the viewing angle switching operation triggered by the user; the target viewing angle information is sent to a media server, so that the media server obtains target video frames to be displayed corresponding to the target viewing angle information from each determined target video frame, and sends the target video frames to be displayed to a user side; and displaying the received target video frame to be displayed on the playing interface.
The determination manner of the target viewing angle information may be referred to the above related content, and will not be described herein.
Specifically, after sending the highlight instant generation request to the media server, the user side may detect whether there is a viewing angle switching operation triggered by the user, and if so, determine the target viewing angle information after switching based on the viewing angle switching operation, and send the target viewing angle information to the media server. After each target video frame with different viewing angles is determined, the media server can wait to receive the switched target viewing angle information sent by the user side, when the target viewing angle information is received, the target video frame to be displayed corresponding to the target viewing angle information can be obtained from each determined target video frame, the target video frame to be displayed is sent to the user side, and the user side displays the received target video frame to be displayed on a playing interface, so that the user can watch the wonderful moment under the appointed viewing angle which is wanted to be watched. The user side in the embodiment of the disclosure sends the target viewing angle information to the media server, so that the media server passively transmits a corresponding target video frame to be displayed without transmitting all target video frames, thereby realizing dynamic downloading of the target video frames, saving the buffer space and improving the running performance.
Based on the above technical solutions, as another implementation manner of the preset display manner, S130 may further include: receiving each target video frame corresponding to each viewing angle sent by a media server; generating a highlight instant video based on each target video frame, and displaying the highlight instant video on a playing interface.
Specifically, the media server can actively issue all the determined target video frames to the user side at one time, and the user side can generate the wonderful instant video containing all the target video frames according to the rotation direction of the visual angle and the video playing speed after receiving all the target video frames. Wherein the viewing angle rotation direction may include a clockwise rotation direction or a counterclockwise rotation manner. The video playing speed can be the original playing speed of the free view video; the speed of the video playing method can be larger than the original playing speed so as to play the wonderful instant video faster and reduce the playing time; and the speed is lower than the original playing speed, so that the wonderful instant video can be played slowly, and the user can more clearly view each target video frame. The rotation direction of the visual angle and the video playing speed can be preset or selected by the user. For example, as shown in fig. 2, a highlight moment video played clockwise from view 1 to view N may be generated, and a highlight moment video played counterclockwise from view N to view 1 may be generated. The generated wonderful instant video is displayed on the playing interface, so that a user can directly view target video frames under all view angles without triggering operation of the user, and the viewing experience of the user is further improved.
Example two
Fig. 3 is a flowchart of a method for generating a highlight moment provided in a second embodiment of the present disclosure, where the present embodiment is applicable to a situation of dynamically generating a highlight moment at any play time in a free view video, and particularly may be used to generate an application scene of the highlight moment in a live or on-demand free view video. The method may be performed by a highlight reel generating device, which may be implemented in software and/or hardware, integrated in a media server. As shown in fig. 3, the method specifically includes the following steps:
s310, receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by the user aiming at the current displayed video frame in the free view video.
The media server may refer to a background server for storing video streams corresponding to each view angle.
Specifically, the specific determination process of the request for generating the highlight instant may be referred to the description related to the above embodiment, which is not repeated herein. The media server may receive a request for generating a highlight instant sent by the client and containing the identification information of the current video frame.
S320, determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request.
Specifically, the media server may parse the request for generating the wonderful moment to obtain the identification information of the current video frame, and determine, from the video stream corresponding to each viewing angle, the target video frame at the same playing time as the current video frame based on the identification information of the current video frame, so as to obtain each target video frame at different viewing angles, i.e. obtain the wonderful moment corresponding to the current video frame.
Illustratively, S320 may include: and regarding the video stream corresponding to each viewing angle, taking the video frame which is the same as the current video frame identification information in the video stream corresponding to the viewing angle as a target video frame corresponding to the viewing angle.
Specifically, in the video stream corresponding to each viewing angle, the video frame identical to the current video frame identification information may be regarded as the target video frame corresponding to the corresponding viewing angle, so that the target video frame corresponding to each viewing angle may be obtained. For example, a video frame with the same playing time stamp as the current video frame in the video stream may be used as the target video frame, or a video frame with the same frame number as the current video frame in the video stream may be used as the target video frame, so that each corresponding target video frame at the same playing time may be accurately determined.
S330, the target video frame is sent to the user side based on the preset issuing mode, so that the user side displays the received target video frame on the playing interface based on the preset display mode matched with the preset issuing mode.
The preset issuing mode may be a sending mode of sending the target video frame by the media server, which is preset based on the service requirement. For example, the preset issuing mode may include active issuing or passive issuing. The related description of the preset display manner may be referred to the above embodiments, and will not be repeated here.
Specifically, the media server can send the target video frame to the user terminal according to a preset issuing mode, and the user terminal can display the target video frame on the playing interface based on a preset display mode matched with the preset issuing mode, so that a user can watch the highlight moment corresponding to the current video frame, the video playing effect is enriched, the user can trigger the highlight moment generating operation aiming at the video frame at any playing moment, the highlight moment at any playing moment in the free view video can be dynamically generated and displayed, the personalized requirements of the user are met, and the user watching experience is improved.
According to the technical scheme, when the user side detects the highlight instant generation operation triggered by the user on the current video frame currently displayed in the free view video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server. The media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode. The user side displays the received target video frames under different viewing angles on the playing interface based on the preset display mode matched with the preset issuing mode, namely, the highlight moment under the same playing time with the current video frame, so that the highlight moment under any playing time in the free viewing angle video can be dynamically generated and displayed based on the user triggering operation, the personalized requirements of the user are met, the video playing effect is enriched, and the viewing experience of the user is improved.
Based on the above technical solutions, as an implementation manner of the preset issuing manner, S330 may further include: and sending each determined target video frame to the user side.
Specifically, the media server may actively issue all the determined target video frames to the client at one time. After receiving each target video frame, the user side can cache all the target video frames and rapidly show the wonderful moment of the switched target viewing angles based on the viewing angle switching operation triggered by the user, so that the user can rapidly browse the wonderful moment, and the user viewing experience is further improved; the user side can also generate the wonderful instant video based on each target video frame and display the wonderful instant video on the playing interface, so that the user can directly view the target video frames under all visual angles without triggering operation of the user, and the user viewing experience is further improved.
Based on the above technical solution, as another implementation manner of the preset issuing manner, S330 may include: receiving switched target viewing angle information sent by a user side, wherein the target viewing angle information is determined based on a viewing angle switching operation triggered by a user; and obtaining target video frames to be displayed corresponding to the target viewing angle information from the determined target video frames, and sending the target video frames to be displayed to the user side.
Specifically, after sending the highlight instant generation request to the media server, the user side may detect whether there is a viewing angle switching operation triggered by the user, and if so, determine the target viewing angle information after switching based on the viewing angle switching operation, and send the target viewing angle information to the media server. After each target video frame with different viewing angles is determined, the media server can wait for receiving the switched target viewing angle information sent by the user side, and when the target viewing angle information is received, the media server can obtain a target video frame to be displayed corresponding to the target viewing angle information from each determined target video frame, and send the target video frame to be displayed to the user side. The user side displays the received target video frame to be displayed on the playing interface, so that the user can watch the wonderful moment at the appointed visual angle which is wanted to watch. The media server in the embodiment of the disclosure can passively issue a corresponding target video frame to be displayed based on the view angle switching operation triggered by the user without issuing all the target video frames, so that the user side can realize dynamic downloading of the target video frames, save the cache space and improve the running performance.
The following is an embodiment of a highlight moment generating device provided by an embodiment of the present disclosure, which belongs to the same inventive concept as the highlight moment generating method of the first embodiment, and details which are not described in detail in the embodiment of the highlight moment generating device may refer to the highlight moment generating method provided by the first embodiment.
Example III
Fig. 4 is a schematic structural diagram of a device for generating a highlight moment according to a third embodiment of the present disclosure, where the present embodiment is applicable to dynamically generating a highlight moment at any play time in a free view video, and particularly may be used to generate an application scene of the highlight moment in a live or on-demand free view video. The device is integrated at the user side. As shown in fig. 4, the apparatus specifically includes: a highlight reel generation request determination module 410, a highlight reel generation request transmission module 420, and a target video frame presentation module 430.
The highlight moment generation request determining module 410 is configured to determine a highlight moment generation request according to current video frame identification information corresponding to a current video frame if a highlight moment generation operation triggered by a user for a current video frame currently displayed in the freeview video is detected; a highlight moment generation request sending module 420, configured to send a highlight moment generation request to a media server, so that the media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight moment generation request, and sends the target video frame to a user terminal based on a preset issuing mode; the target video frame display module 430 is configured to display the received target video frame on the playing interface based on a preset display mode that matches the preset issuing mode.
According to the technical scheme, when the user side detects the highlight instant generation operation triggered by the user on the current video frame currently displayed in the free view video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server. The media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode. The user side displays the received target video frames under different viewing angles on the playing interface based on the preset display mode matched with the preset issuing mode, namely, the highlight moment under the same playing time with the current video frame, so that the highlight moment under any playing time in the free viewing angle video can be dynamically generated and displayed based on the user triggering operation, the personalized requirements of the user are met, the video playing effect is enriched, and the viewing experience of the user is improved. On the basis of the technical scheme, in a video live broadcast scene, the view angle switching information comprises target view angle information after view angle switching; in the video-on-demand scene, the view angle switching information comprises target view angle information after the view angle is switched and a current playing progress mark when a user triggers the view angle switching operation.
Based on the above technical solutions, the current video frame identification information is a play time stamp or a frame number corresponding to the current video frame.
Based on the above technical solutions, the target video frame display module 430 includes:
the target video frame buffer unit is used for receiving each target video frame corresponding to each viewing angle sent by the media server and buffering each target video frame;
a target viewing angle information determining unit configured to determine target viewing angle information after switching based on a viewing angle switching operation triggered by a user;
the target video frame display unit is used for determining target video frames to be displayed corresponding to the target viewing angle information from the cached target video frames, and displaying the target video frames to be displayed on the playing interface.
Based on the above technical solutions, the target video frame display module 430 includes:
a target viewing angle information determining unit configured to determine target viewing angle information after switching based on a viewing angle switching operation triggered by a user;
the target viewing angle information sending unit is used for sending the target viewing angle information to the media server so that the media server obtains target video frames to be displayed corresponding to the target viewing angle information from the determined target video frames and sends the target video frames to be displayed to the user side;
And the target video frame display unit is used for displaying the received target video frames to be displayed on the playing interface.
Based on the above technical solutions, the target viewing angle information determining unit is specifically configured to: and determining the switched target viewing angle information according to the sliding operation of the user or the clicking angle operation of the user.
On the basis of the above technical solutions, the target viewing angle information determining unit is further specifically configured to:
if the user slides the screen leftwards, the next viewing angle information of the current viewing angle information along the anticlockwise direction is used as the target viewing angle information after switching; and if the user slides the screen rightward, taking the next viewing angle information of the current viewing angle viewing information along the clockwise direction as target viewing angle information after the viewing angle is switched.
Based on the above technical solutions, the target video frame display module 430 is further specifically configured to:
receiving each target video frame corresponding to each viewing angle sent by a media server; generating a highlight instant video based on each target video frame, and displaying the highlight instant video on a playing interface.
The highlight instant generating device provided by the embodiment of the disclosure can execute the highlight instant generating method provided by the first embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of executing the highlight instant generating method.
It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.
The following is an embodiment of a highlight moment generating device provided by an embodiment of the present disclosure, which belongs to the same inventive concept as the highlight moment generating method of the second embodiment, and details which are not described in detail in the embodiment of the highlight moment generating device may refer to the highlight moment generating method provided by the second embodiment.
Example IV
Fig. 5 is a schematic structural diagram of a highlight moment generating device according to a fourth embodiment of the present disclosure, where the present embodiment is applicable to dynamically generating a highlight moment at any play time in a free view video, and particularly may be used to generate an application scene of the highlight moment in a live or on-demand free view video. The apparatus is integrated with a media server. As shown in fig. 5, the apparatus specifically includes: a highlight instant generation request receiving module 510, a target video frame determining module 520, and a target video frame transmitting module 530.
The highlight moment generation request receiving module 510 is configured to receive a highlight moment generation request sent by a user terminal, where the highlight moment generation request is determined according to current video frame identification information corresponding to a current video frame when the user terminal detects a highlight moment generation operation triggered by a user for a current video frame currently displayed in a free view video; the target video frame determining module 520 is configured to determine each target video frame having a different viewing angle at the same playing time as the current video frame according to the current video frame identification information in the highlight instant generation request; the target video frame sending module 530 is configured to send a target video frame to the user terminal based on a preset issuing mode, so that the user terminal displays the received target video frame on the playing interface based on a preset display mode matched with the preset issuing mode.
According to the technical scheme, when the user side detects the highlight instant generation operation triggered by the user on the current video frame currently displayed in the free view video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server. The media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode. The user side displays the received target video frames under different viewing angles on the playing interface based on the preset display mode matched with the preset issuing mode, namely, the highlight moment under the same playing time with the current video frame, so that the highlight moment under any playing time in the free viewing angle video can be dynamically generated and displayed based on the user triggering operation, the personalized requirements of the user are met, the video playing effect is enriched, and the viewing experience of the user is improved.
Based on the above technical solution, the target video frame determining module 520 is specifically configured to:
and regarding the video stream corresponding to each viewing angle, taking the video frame which is the same as the current video frame identification information in the video stream corresponding to the viewing angle as a target video frame corresponding to the viewing angle.
Based on the above technical solutions, the target video frame sending module 530 is specifically configured to:
and sending each determined target video frame to the user side.
Based on the above technical solutions, the target video frame sending module 530 is further specifically configured to:
receiving switched target viewing angle information sent by a user side, wherein the target viewing angle information is determined based on a viewing angle switching operation triggered by a user; and obtaining target video frames to be displayed corresponding to the target viewing angle information from the determined target video frames, and sending the target video frames to be displayed to the user side.
The highlight instant generating device provided by the embodiment of the disclosure can execute the highlight instant generating method provided by the second embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of executing the highlight instant generating method.
It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.
Example five
Fig. 6 is a schematic structural diagram of a wonderful momentary generating system according to a fifth embodiment of the present disclosure. The embodiment can be suitable for the situation of dynamically generating the highlight moment at any play time in the free view video, and particularly can be used for generating the application scene of the highlight moment in the free view video of live broadcast or on demand. As shown in fig. 6, the system includes: a client 610, and a media server 620.
The user side 610 may be configured to implement the highlight moment generating method according to the first embodiment of the present disclosure; the media server 620 may be used to implement the highlight instant generation method as provided by the second embodiment of the present disclosure.
As an implementation manner, the working process of the highlight instant generating system in the embodiment of the present disclosure may be: if the user side 610 detects a highlight instant generation operation triggered by the user for the current video frame currently displayed in the freeview video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server 620. The media server 620 determines each target video frame having a different viewing angle at the same playing time as the current video frame according to the current video frame identification information in the highlight instant generation request, and sends each determined target video frame to the user terminal 610. The client 610 receives each target video frame corresponding to each viewing angle sent by the media server 620, and caches each target video frame. When detecting the viewing angle switching operation triggered by the user, the user side 610 determines the target viewing angle information after switching based on the viewing angle switching operation triggered by the user, determines the target video frame to be displayed corresponding to the target viewing angle information from the cached target video frames, and displays the target video frame to be displayed on the playing interface. The client 610 in the embodiment of the present disclosure caches all the target video frames sent by the media server 620, so that a wonderful moment under a specified viewing angle can be quickly displayed based on a viewing angle switching operation triggered by a user, so that the user can quickly browse the wonderful moment, and the user viewing experience is further improved.
As another implementation manner, the working process of the highlight instant generating system in the embodiment of the present disclosure may further be: if the user side 610 detects a highlight instant generation operation triggered by the user for the current video frame currently displayed in the freeview video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server 620. The media server 620 determines each target video frame having a different viewing angle at the same playing time as the current video frame according to the current video frame identification information in the highlight instant generation request. Upon detecting the user-triggered viewing angle switching operation, the user side 610 determines the target viewing angle information after switching based on the user-triggered viewing angle switching operation, and sends the target viewing angle information to the media server 620. The media server 620 obtains, from each of the determined target video frames, a target video frame to be displayed corresponding to the target viewing angle information according to the received target viewing angle information, and sends the target video frame to be displayed to the user terminal 610. The user terminal 610 displays the received target video frame to be displayed on the playing interface. The client 610 in the embodiment of the present disclosure sends the target viewing angle information to the media server 620, so that the media server 620 passively transmits a corresponding target video frame to be displayed, and does not need to transmit all the target video frames, thereby realizing dynamic downloading of the target video frames, saving the buffer space, and improving the running performance.
As another implementation manner, the working process of the highlight instant generating system in the embodiment of the present disclosure may further be: if the user side 610 detects a highlight instant generation operation triggered by the user for the current video frame currently displayed in the freeview video, the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame, and the highlight instant generation request is sent to the media server 620. The media server 620 determines each target video frame having a different viewing angle at the same playing time as the current video frame according to the current video frame identification information in the highlight instant generation request, and sends each determined target video frame to the user terminal 610. The user side 610 receives each target video frame corresponding to each viewing angle sent by the media server 620, generates a highlight instant video based on each target video frame, and displays the highlight instant video on the playing interface. The generated wonderful instant video is displayed on the playing interface, so that a user can directly view target video frames under all view angles without triggering operation of the user, and the viewing experience of the user is further improved.
In the highlight moment generating system provided in the embodiments of the present disclosure, when detecting a highlight moment generating operation triggered by a user for a current video frame currently displayed in a freeview video, the user side 610 determines a highlight moment generating request according to current video frame identification information corresponding to the current video frame, and sends the highlight moment generating request to the media server 620. The media server 620 determines each target video frame having a different viewing angle at the same playing time as the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user terminal 610 based on a preset issuing mode. The user side 610 displays the received target video frames under different viewing angles on the playing interface based on the preset display mode matched with the preset issuing mode, namely, the highlight moment under the same playing time with the current video frame, so that the highlight moment under any playing time in the free viewing angle video can be dynamically generated and displayed based on the user triggering operation, the personalized requirement of the user is met, the video playing effect is enriched, and the viewing experience of the user is improved.
Example six
Referring now to fig. 7, a schematic diagram of an electronic device (e.g., a client or server in fig. 7) 900 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 7 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 7, the electronic device 900 may include a processing means (e.g., a central processor, a graphics processor, etc.) 901, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 902 or a program loaded from a storage means 908 into a Random Access Memory (RAM) 903. In the RAM 903, various programs and data necessary for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input/output (I/O) interface 905 is also connected to the bus 904.
In general, the following devices may be connected to the I/O interface 905: input devices 906 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 907 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 908 including, for example, magnetic tape, hard disk, etc.; and a communication device 909. The communication means 909 may allow the electronic device 900 to communicate wirelessly or by wire with other devices to exchange data. While fig. 7 shows an electronic device 900 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When executed by the processing device 901, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
The electronic device provided by the embodiment of the present disclosure and the method for generating a wonderful instant provided by the above embodiment belong to the same inventive concept, and technical details not described in detail in the embodiment of the present disclosure can be seen in the above embodiment, and the embodiment of the present disclosure has the same beneficial effects as the above embodiment.
Example seven
The presently disclosed embodiments provide a computer storage medium having a computer program stored thereon, which when executed by a processor, implements the highlight moment generating method provided by any of the above embodiments.
It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:
if the highlight instant generation operation triggered by the user aiming at the current video frame displayed currently in the free view video is detected, determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame; transmitting the highlight instant generation request to a media server, so that the media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and transmits the target video frame to a user side based on a preset transmitting mode; and displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
Or alternatively, the process may be performed,
receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by the current video frame currently displayed in the free view video; determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request; and sending the target video frame to the user side based on the preset issuing mode, so that the user side displays the received target video frame on the playing interface based on the preset display mode matched with the preset issuing mode.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the name of the unit does not constitute a limitation of the unit itself in some cases, for example, the editable content display unit may also be described as an "editing unit".
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method, applied to a user terminal, the method including:
if the highlight instant generation operation triggered by the user aiming at the current video frame displayed currently in the free view video is detected, determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame;
the highlight instant generation request is sent to a media server, so that the media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode;
and displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method, applied to a user terminal, the method further comprising:
optionally, the current video frame identification information is a play time stamp or a frame number corresponding to the current video frame.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method, applied to a user terminal, the method further comprising:
optionally, the displaying the received target video frame on the playing interface based on the preset display mode matched with the preset issuing mode includes:
receiving each target video frame corresponding to each viewing angle sent by the media server, and caching each target video frame;
determining the target viewing angle information after switching based on the viewing angle switching operation triggered by the user;
and determining target video frames to be displayed corresponding to the target viewing angle information from the cached target video frames, and displaying the target video frames to be displayed on a playing interface.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method, applied to a user terminal, the method further comprising:
optionally, the displaying the received target video frame on the playing interface based on the preset display mode matched with the preset issuing mode further includes:
determining the target viewing angle information after switching based on the viewing angle switching operation triggered by the user;
The target viewing angle information is sent to the media server, so that the media server obtains target video frames to be displayed corresponding to the target viewing angle information from each determined target video frame, and the target video frames to be displayed are sent to the user side;
and displaying the received target video frame to be displayed on a playing interface.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method, applied to a user terminal, the method further comprising:
optionally, the determining the target viewing angle information after switching based on the viewing angle switching operation triggered by the user includes:
and determining the switched target viewing angle information according to the sliding operation of the user or the clicking angle operation of the user.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method, applied to a user terminal, the method further comprising:
optionally, the determining the target viewing angle information after switching according to the user sliding operation includes:
if the user slides the screen leftwards, the next viewing angle information of the current viewing angle information along the anticlockwise direction is used as the target viewing angle information after switching;
And if the user slides the screen rightward, taking the next viewing angle information of the current viewing angle viewing information along the clockwise direction as target viewing angle information after the viewing angle is switched.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method, applied to a user terminal, the method further comprising:
optionally, the displaying the received target video frame on the playing interface based on the preset display mode matched with the preset issuing mode further includes:
receiving each target video frame corresponding to each viewing angle sent by the media server;
generating a highlight instant video based on each target video frame, and displaying the highlight instant video on a playing interface.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method applied to a media server, the method comprising:
receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by the user aiming at the current displayed video frame in the free view video;
Determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request;
and sending the target video frame to the user side based on a preset issuing mode, so that the user side displays the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method applied to a media server, the method further comprising:
optionally, the determining, according to the current video frame identification information in the highlight instant generation request, each target video frame having a different viewing angle at the same playing time as the current video frame includes:
and regarding the video stream corresponding to each viewing angle, taking the video frame which is the same as the current video frame identification information in the video stream corresponding to the viewing angle as a target video frame corresponding to the viewing angle.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method applied to a media server, the method further comprising:
Optionally, the sending the target video frame to the user side based on a preset issuing manner further includes:
and sending each determined target video frame to the user side.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating method applied to a media server, the method further comprising:
optionally, the sending the target video frame to the user side based on a preset issuing mode includes:
receiving the switched target viewing angle information sent by the user side, wherein the target viewing angle information is determined based on a viewing angle switching operation triggered by a user;
and obtaining target video frames to be displayed corresponding to the target viewing angle information from each determined target video frame, and sending the target video frames to be displayed to the user side.
According to one or more embodiments of the present disclosure, there is provided a highlight instant generating device, integrated in a user terminal, the device including:
the highlight instant generation request determining module is used for determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame if highlight instant generation operation triggered by a user aiming at the current video frame displayed in the free view video is detected;
A highlight moment generation request sending module, configured to send the highlight moment generation request to a media server, so that the media server determines, according to the current video frame identification information in the highlight moment generation request, each target video frame having a different viewing angle at the same playing time as the current video frame, and sends the target video frame to the user terminal based on a preset issuing mode;
and the target video frame display module is used for displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
According to one or more embodiments of the present disclosure, there is provided a highlight moment generating apparatus, integrated with a media server, the apparatus comprising:
the highlight instant generation request receiving module is used for receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by a user aiming at the current video frame displayed in the free view video;
The target video frame determining module is used for determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request;
and the target video frame sending module is used for sending the target video frame to the user side based on a preset issuing mode so that the user side can display the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims (15)

1. The highlight instant generation method is characterized by being applied to a user side and comprising the following steps of:
if the highlight instant generation operation triggered by a user aiming at the current video frame displayed currently in the free view video is detected, determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame, wherein the current video frame is any frame in a video stream determined by the user;
the current video frame identification information is a playing time stamp or a frame sequence number corresponding to the current video frame;
the highlight instant generation request is sent to a media server, so that the media server determines each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request, and sends the target video frame to the user side based on a preset issuing mode;
And displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
2. The method according to claim 1, wherein displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode comprises:
receiving each target video frame corresponding to each viewing angle sent by the media server, and caching each target video frame;
determining the target viewing angle information after switching based on the viewing angle switching operation triggered by the user;
and determining target video frames to be displayed corresponding to the target viewing angle information from the cached target video frames, and displaying the target video frames to be displayed on a playing interface.
3. The method according to claim 1, wherein displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode, further comprises:
determining the target viewing angle information after switching based on the viewing angle switching operation triggered by the user;
The target viewing angle information is sent to the media server, so that the media server obtains target video frames to be displayed corresponding to the target viewing angle information from each determined target video frame, and the target video frames to be displayed are sent to the user side;
and displaying the received target video frame to be displayed on a playing interface.
4. A method according to claim 2 or 3, wherein said determining the switched target viewing angle information based on the user-triggered viewing angle switching operation comprises:
and determining the switched target viewing angle information according to the sliding operation of the user or the clicking angle operation of the user.
5. The method of claim 4, wherein determining the switched target viewing angle information according to the user sliding operation comprises:
if the user slides the screen leftwards, the next viewing angle information of the current viewing angle information along the anticlockwise direction is used as the target viewing angle information after switching;
and if the user slides the screen rightward, taking the next viewing angle information of the current viewing angle viewing information along the clockwise direction as target viewing angle information after the viewing angle is switched.
6. The method according to claim 1, wherein displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode, further comprises:
receiving each target video frame corresponding to each viewing angle sent by the media server;
generating a highlight instant video based on each target video frame, and displaying the highlight instant video on a playing interface.
7. A method of highlight instant generation, applied to a media server, comprising:
receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by the user aiming at the current displayed video frame in the free view video; the current video frame is any frame in the video stream determined by the user;
the current video frame identification information is a playing time stamp or a frame sequence number corresponding to the current video frame;
determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request;
And sending the target video frame to the user side based on a preset issuing mode, so that the user side displays the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
8. The method of claim 7, wherein said determining each target video frame having a different viewing angle at the same playing time as the current video frame based on the current video frame identification information in the highlight instant generation request comprises:
and regarding the video stream corresponding to each viewing angle, taking the video frame which is the same as the current video frame identification information in the video stream corresponding to the viewing angle as a target video frame corresponding to the viewing angle.
9. The method of claim 7, wherein the sending the target video frame to the client based on a preset delivery manner further comprises:
and sending each determined target video frame to the user side.
10. The method of claim 7, wherein the sending the target video frame to the client based on a preset delivery method comprises:
Receiving the switched target viewing angle information sent by the user side, wherein the target viewing angle information is determined based on a viewing angle switching operation triggered by a user;
and obtaining target video frames to be displayed corresponding to the target viewing angle information from each determined target video frame, and sending the target video frames to be displayed to the user side.
11. The utility model provides a wonderful instantaneous generating device which is characterized in that, integrate in the user side, include:
the highlight instant generation request determining module is used for determining a highlight instant generation request according to the current video frame identification information corresponding to the current video frame if highlight instant generation operation triggered by a user aiming at the current video frame displayed in the free view video is detected, wherein the current video frame is any frame in a video stream determined by the user;
the current video frame identification information is a playing time stamp or a frame sequence number corresponding to the current video frame;
a highlight moment generation request sending module, configured to send the highlight moment generation request to a media server, so that the media server determines, according to the current video frame identification information in the highlight moment generation request, each target video frame having a different viewing angle at the same playing time as the current video frame, and sends the target video frame to the user terminal based on a preset issuing mode;
And the target video frame display module is used for displaying the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
12. A highlight instant generating device integrated with a media server, comprising:
the highlight instant generation request receiving module is used for receiving a highlight instant generation request sent by a user terminal, wherein the highlight instant generation request is determined according to the current video frame identification information corresponding to the current video frame when the user terminal detects highlight instant generation operation triggered by a user aiming at the current video frame displayed in the free view video; the current video frame is any frame in the video stream determined by the user;
the current video frame identification information is a playing time stamp or a frame sequence number corresponding to the current video frame;
the target video frame determining module is used for determining each target video frame with different viewing angles at the same playing time with the current video frame according to the current video frame identification information in the highlight instant generation request;
and the target video frame sending module is used for sending the target video frame to the user side based on a preset issuing mode so that the user side can display the received target video frame on a playing interface based on a preset display mode matched with the preset issuing mode.
13. A highlight instant-generating system, the system comprising: a user terminal and a media server;
wherein, the user side is used for realizing the highlight instant generation method according to any one of claims 1-6;
the media server is configured to implement the highlight moment generating method according to any one of claims 7-10.
14. An electronic device, the electronic device comprising:
one or more processors;
a memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the highlight moment generating method of any one of claims 1-10.
15. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the highlight moment generating method according to any one of claims 1-10.
CN202111057574.9A 2021-09-09 2021-09-09 Method, device, system, equipment and medium for generating highlight instant Active CN113794936B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111057574.9A CN113794936B (en) 2021-09-09 2021-09-09 Method, device, system, equipment and medium for generating highlight instant

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111057574.9A CN113794936B (en) 2021-09-09 2021-09-09 Method, device, system, equipment and medium for generating highlight instant

Publications (2)

Publication Number Publication Date
CN113794936A CN113794936A (en) 2021-12-14
CN113794936B true CN113794936B (en) 2023-06-13

Family

ID=78879813

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111057574.9A Active CN113794936B (en) 2021-09-09 2021-09-09 Method, device, system, equipment and medium for generating highlight instant

Country Status (1)

Country Link
CN (1) CN113794936B (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9462301B2 (en) * 2013-03-15 2016-10-04 Google Inc. Generating videos with multiple viewpoints
CN108174265B (en) * 2016-12-07 2019-11-29 华为技术有限公司 A kind of playback method, the apparatus and system of 360 degree of panoramic videos
CN110198457B (en) * 2018-02-26 2022-09-02 腾讯科技（深圳）有限公司 Video playing method and device, system, storage medium, terminal and server thereof
CN112738010B (en) * 2019-10-28 2023-08-22 阿里巴巴集团控股有限公司 Data interaction method and system, interaction terminal and readable storage medium

Also Published As

Publication number Publication date
CN113794936A (en) 2021-12-14

Similar Documents

Publication Publication Date Title
CN112261459B (en) Video processing method and device, electronic equipment and storage medium
CN113110783B (en) Control display method and device, electronic equipment and storage medium
CN111064987B (en) Information display method and device and electronic equipment
CN113141524B (en) Resource transmission method, device, terminal and storage medium
CN112351222B (en) Image special effect processing method and device, electronic equipment and computer readable storage medium
CN112995759A (en) Interactive service processing method, system, device, equipment and storage medium
JP2023528398A (en) Live distribution room creation method, device, electronic device and storage medium
CN109462779B (en) Video preview information playing control method, application client and electronic equipment
EP4297416A1 (en) Angle-of-view switching method, apparatus and system for free angle-of-view video, and device and medium
CN114168018A (en) Data interaction method, data interaction device, electronic equipment, storage medium and program product
US20240121349A1 (en) Video shooting method and apparatus, electronic device and storage medium
CN112348748A (en) Image special effect processing method and device, electronic equipment and computer readable storage medium
CN113824629A (en) House display method, device, equipment and medium
WO2023197811A1 (en) Video downloading method and apparatus, video transmission method and apparatus, terminal device, server and medium
CN109714628B (en) Method, device, equipment, storage medium and system for playing audio and video
CN113794936B (en) Method, device, system, equipment and medium for generating highlight instant
CN114827750B (en) Viewing angle prediction method, device, equipment and storage medium
CN112351221A (en) Image special effect processing method and device, electronic equipment and computer readable storage medium
CN113965768B (en) Live broadcasting room information display method and device, electronic equipment and server
CN114860139A (en) Video playing method, video playing device, electronic equipment, storage medium and program product
CN113794836B (en) Bullet time video generation method, device, system, equipment and medium
CN114554292A (en) Method and device for switching visual angle, electronic equipment, storage medium and program product
CN111710046A (en) Interaction method and device and electronic equipment
CN115904591B (en) Media content display method and device, electronic equipment and storage medium
CN114501041B (en) Special effect display method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant