CN113923530B - Interactive information display method and device, electronic equipment and storage medium - Google Patents

Interactive information display method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113923530B
CN113923530B CN202111211077.XA CN202111211077A CN113923530B CN 113923530 B CN113923530 B CN 113923530B CN 202111211077 A CN202111211077 A CN 202111211077A CN 113923530 B CN113923530 B CN 113923530B
Authority
CN
China
Prior art keywords
target
interactive information
video data
video
retransmitted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111211077.XA
Other languages
Chinese (zh)
Other versions
CN113923530A (en
Inventor
熊名男
辛彦哲
宋毓韬
王钦功
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN202111211077.XA priority Critical patent/CN113923530B/en
Publication of CN113923530A publication Critical patent/CN113923530A/en
Application granted granted Critical
Publication of CN113923530B publication Critical patent/CN113923530B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the disclosure discloses an interactive information display method, an interactive information display device, electronic equipment and a storage medium, wherein the method applied to a cloud broadcasting server comprises the following steps: writing supplementary enhancement information into the target video data to be retransmitted according to a preset time interval, and transmitting the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises the playing time of a first frame video image in the target video data to be retransmitted, into which the supplementary enhancement information is written; and sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying the target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played. According to the technical scheme, interactive information can be inserted and displayed in real time in the process of rebroadcasting video playing, and interaction feeling and participation feeling of a user and video content are enhanced.

Description

Interactive information display method and device, electronic equipment and storage medium
Technical Field
The embodiment of the disclosure relates to the technical field of live broadcasting, in particular to an interactive information display method, an interactive information display device, electronic equipment and a storage medium.
Background
Currently, in a video playing application client, television programs of a television station can be synchronously retransmitted. Thus, a user can view video content synchronized with a television station through a video playback application client. However, the user can only express his own watching video experience and evaluation of video content through the message window of the video playing interface, and the user has poor experience of participation and interaction of the program. Meanwhile, the television station program producers cannot timely and effectively collect and count the after-watching feedback of the audience to the program. Thus, the interactivity of the user with the video content is to be enhanced.
Disclosure of Invention
The embodiment of the disclosure provides an interactive information display method, an interactive information display device, electronic equipment and a storage medium, which can insert and display interactive information in real time in the process of rebroadcast video playing, and enhance the interaction feeling and participation feeling of a user and video content.
In a first aspect, an embodiment of the present disclosure provides an interactive information display method, which is applied to a cloud multicast service end, where the method includes:
Writing supplementary enhancement information into target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be retransmitted, in which the supplementary enhancement information is written;
and sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played.
In a second aspect, an embodiment of the present disclosure provides an interactive information display method, applied to a client, where the method includes:
receiving and playing video data to be played forwarded by a cloud broadcasting guide server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud broadcasting guide server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate;
And displaying the target interaction information when the target video frame is played.
In a third aspect, an embodiment of the present disclosure further provides an interactive information display device configured at a cloud multicast service end, where the device includes:
the video data forwarding module is used for writing supplementary enhancement information into target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises the playing time of a first frame video image in the target video data to be retransmitted, in which the supplementary enhancement information is written;
and the interactive information display control module is used for sending an interactive information display instruction to the target client so that the client can determine a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and display the target interactive information when the target video frame is played.
In a fourth aspect, an embodiment of the present disclosure further provides an interactive information display device configured at a client, where the device includes:
the video data receiving module is used for receiving and playing the video data to be played forwarded by the cloud broadcasting guide server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
The interactive video frame determining module is used for determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate when receiving the interactive information display instruction issued by the cloud broadcasting server;
and the interactive information display module is used for displaying the target interactive information when the target video frame is played.
In a fifth aspect, embodiments of the present disclosure further provide an electronic device, including:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement an interactive information display method applied to a cloud multicast server or a client according to any one of the embodiments of the present disclosure.
In a sixth aspect, embodiments of the present disclosure further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform an interactive information presentation method applied to a cloud-director server or a client according to any one of the embodiments of the present disclosure.
According to the technical scheme, in the process of forwarding target video data to be retransmitted to the client side through the cloud broadcasting guiding server side, supplementary enhancement information is written in the target video data to be retransmitted according to a preset time interval, wherein the supplementary enhancement information comprises the playing time of a first frame video image in a group of video data packets written with the supplementary enhancement information, so that the target client side receives the target video data to be retransmitted to realize video retransmission, and meanwhile, in the process of forwarding the target video data to be retransmitted to the client side, an interactive information display instruction is sent to the target client side, so that the client side determines target video frames for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frames are played, so that a real-time interactive channel between a client side user and a retransmitted video is established. The technical scheme of the embodiment of the disclosure solves the problem that in the prior art, a program side cannot timely acquire feedback of program content from a viewer, and the interactivity of the viewer in the process of watching program video is poor, realizes real-time insertion and display of interactive information at an accurate time point in the process of broadcasting a rebroadcast video, and enhances interaction feeling and participation feeling of a user and the video content.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
Fig. 1 is a flow chart of an interactive information display method applied to a cloud broadcasting server according to an embodiment of the disclosure;
fig. 2 is a schematic diagram of video rebroadcasting according to a first embodiment of the disclosure;
fig. 3 is a flow chart of an interactive information display method applied to a client according to a second embodiment of the disclosure;
fig. 4 is a schematic diagram of an interactive information display provided in a second embodiment of the disclosure;
fig. 5 is a schematic structural diagram of an interactive information display device configured at a cloud multicast server according to a third embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of an interactive information display device configured at a client according to a fourth embodiment of the disclosure;
fig. 7 is a schematic structural diagram of an electronic device according to a fifth embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
Example 1
Fig. 1 is a schematic flow chart of an interactive information display method applied to a cloud broadcasting server according to an embodiment of the present disclosure, which is suitable for inserting and displaying real-time interactive information in a video rebroadcasting process of a television station program. The method can be executed by an interactive information display device configured at the cloud broadcasting guide server, the device can be realized in a form of software and/or hardware, and the device can be configured in electronic equipment, for example, in server equipment.
As shown in fig. 1, the method for displaying interactive information applied to a cloud multicast service end according to the present embodiment includes:
and S110, writing supplementary enhancement information into the target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing.
Specifically, in some video playing applications, program videos of a television station may be retransmitted, so that a user may watch the program videos played synchronously with the television station through a video playing application client. In this embodiment, the cloud broadcasting server broadcasts (distributes) the video data of the television station, that is, the target video data to be retransmitted, to the target client of the video playing application viewing the target video data to be retransmitted. After receiving the video data to be retransmitted, the target client can decode the video data to obtain a restored frame-by-frame image, and then play the video. Fig. 2 is a schematic diagram of video data retransmission, in which the image content received by the client and decoded by the client is identical to the original data content of the video data encoded and retransmitted by the cloud multicast server.
Wherein supplemental enhancement information (Supplemental Enhancement Information, SEI), information belonging to the category of the bitstream, provides a method of adding additional information to the encoded video bitstream. In this embodiment, the additional information provided by the supplemental enhancement information includes a play time of a first frame video image of a set of video data packets in which the supplemental enhancement information is written, i.e., the target video data to be retransmitted. The first frame of video image in the video data packet may be understood as the first frame of a multi-frame video image obtained after the client receives the video data packet and decodes the video data packet.
Further, before the target video data to be retransmitted is performed, the cloud broadcasting server first performs identification of the video data, and determines the video data received from the television station as the target video data to be retransmitted. In general, a manual switching manner may be adopted, where video data to be retransmitted is monitored by a special staff, and when target video data to be retransmitted arrives, the forwarded data content is switched from video data content such as platform advertisement of the client to target video data to be retransmitted. In order to avoid the time delay problem and the switching error problem of manual switching, an artificial intelligent image recognition algorithm is preferably adopted to recognize the target video data to be rebroadcast. Specifically, one or more frames of images of the target video to be rebroadcast are stored in advance at the cloud broadcasting guiding server. After receiving the video data of the program to be retransmitted, playing the video data at the cloud broadcasting guiding server, triggering the cloud broadcasting guiding server to call a preset image recognition algorithm, carrying out image recognition matching on one or more frames of pre-stored images of the target video to be retransmitted and the currently played images of the program to be retransmitted, and when the matching is successful, determining that the received video data to be retransmitted is the target video data to be retransmitted, and automatically distributing the received video data to be retransmitted to the target client as the target video data to be retransmitted. By the method, the video to be retransmitted can be ensured to be accurately forwarded from the beginning of the video data, and the target client plays the video to be retransmitted from the beginning, so that delay or mismatch of subsequent interactive display information can not be caused.
When the supplemental enhancement information is written in the forwarded target to-be-retransmitted video data packet, the first supplemental enhancement information is written in the forwarded first target to-be-retransmitted video data packet when the received to-be-retransmitted video data is determined to be the target to-be-retransmitted video data, and the first supplemental enhancement information is the initial moment of forwarding the target to-be-retransmitted video data. And then, after the first supplemental enhancement information is written, corresponding supplemental enhancement information is inserted into the continuously forwarded target video data to be retransmitted according to a preset time interval. The preset time interval can be set as long as required, the length of the time interval can be time data of millisecond, second or minute level, and personalized setting can be carried out according to the actual data transmission condition.
It will be appreciated that the playing time of the first frame of video image in the set of video data packets in which the supplemental enhancement information is written in the supplemental enhancement information is an absolute time, for example, when the playing of the target video data to be retransmitted starts at eight pm, the playing time in the first supplemental enhancement information is eight pm, the SEI is inserted in the retransmitted video stream at 2 second intervals, the playing time of the second SEI is eight pm, two seconds, and so on.
And S120, sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displaying the target interactive information when the target video frame is played.
According to the interaction requirement of the target video to be rebroadcast, the cloud broadcasting server side can send interaction information display instructions to the client side in advance. The interactive information display instruction comprises the content of the interactive information and the time for displaying the interactive information. In addition, new rendering scheme information for interactive information display can be included. For example, when the target video to be retransmitted is played to 20 minutes 06 seconds, a viewpoint is output in the played video content, and interactive information can be displayed at the position when the target video to be retransmitted is played to ask the audience whether to support the viewpoint output in the video content. Alternatively, when the video is played to the 10 th minute, 53 seconds, a climax of the episode of the television show may occur, and the viewer may be asked to score the actors playing the climax content.
After receiving the interactive information display instruction, the client determines the playing time of each frame of video image according to the SEI and the video playing frame rate in the target video data to be rebroadcast, then determines the target video frame for displaying the interactive information based on the time for displaying the interactive information appointed in the interactive information display instruction, and displays the content of the interactive information appointed in the interactive information display instruction when the target video frame is played.
Furthermore, if the audience participates in the interaction of the interaction information through the target client, and generates the interaction feedback information, the cloud broadcasting server can also receive the interaction feedback result of the target client and the interaction information, so that the feedback result is subjected to statistical analysis later.
According to the technical scheme, the target video to be retransmitted is identified through an image identification algorithm, then supplementary enhancement information is written into the target video to be retransmitted according to a preset time interval in the process of forwarding the target video to be retransmitted to the client, wherein the supplementary enhancement information comprises the playing time of a first frame video image in a group of video data packets written with the supplementary enhancement information, so that the target client receives the target video to be retransmitted to realize video retransmission, and meanwhile, in the process of forwarding the target video to be retransmitted to the client, an interactive information display instruction is sent to the target client, so that the client determines target video frames for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and when the target video frames are played, the target interactive information is displayed, so that a real-time interactive channel between a client user and the retransmitted video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program side cannot timely acquire feedback of program content from a viewer, and the interactivity of the viewer is poor in the process of watching program video, and realizes that the target video data to be retransmitted can be accurately forwarded in the process of retransmitting video playing, interactive information is inserted and displayed in real time at an accurate time point, and the interaction feeling and participation feeling of a user and the video content are enhanced.
Example two
The embodiment of the disclosure and the interactive information display method applied to the cloud guide server provided in the above embodiment belong to the same inventive concept. The interactive information display method applied to the client provided by the embodiment further describes the process of displaying interactive information in the process of playing the synchronous rebroadcast video of the television station by the video playing application client. The method can be performed by a client-side interactive information presentation device, which can be implemented in software and/or hardware, and which can be deployed in an electronic device or a server device.
Fig. 3 is a flowchart of an interactive information display method applied to a client according to a second embodiment of the present disclosure. As shown in fig. 3, the interactive information display method provided in this embodiment includes:
s210, receiving and playing the video data to be played forwarded by the cloud broadcasting guide server.
In this embodiment, the client may be an application platform for playing video, and the user may watch the program video synchronously with the television station through the client. When the user selects the program video to be watched at the client, the client requests the video data to be played from the cloud broadcasting server, namely, the target video data to be retransmitted forwarded by the cloud broadcasting server. After receiving the video data to be played, the client decodes and plays the video data.
Wherein, the part of the video data to be played is written with the supplementary enhancement information containing the playing time of the video frame. The supplementary enhancement information is additional information added in the coded video data packet when the cloud broadcasting guide server forwards the video data to be played. The video frame playing time refers to the playing time of the first frame video image in a group of video data packets to which the supplemental enhancement information is written. The first frame of video image may be understood as a first frame of a multi-frame video image obtained by decoding a video data packet after receiving the video data packet by a client.
And S220, when an interactive information display instruction issued by the cloud broadcasting guide server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate.
The interactive information display instruction comprises the content of the interactive information and the time for displaying the interactive information. After determining the time for displaying the interactive information, the client needs to determine the target video frame played at the time for displaying the interactive information, so as to render the interactive information to match with the content of the target video frame before displaying the interactive information.
Specifically, the process of determining the target video frame is to first determine the play time difference of the two corresponding video frames according to the play time of each adjacent two video frames of the supplemental enhancement information. Equivalently, the play time of two video frames and the play time difference between two video frames can be determined according to the two pieces of supplemental enhancement information. Further, in combination with the video play frame rate, a play time corresponding to each video frame between two video frames for which the determined play time is known may be determined. And the video frame with the same playing time as the target interactive information appointed in the interactive information display instruction is the target video frame.
And S230, displaying the target interaction information when the target video frame is played.
Specifically, the target interaction information may be an interaction component, and the user may perform interaction feedback by triggering the corresponding component. The interactive component includes a content selection button or scoring menu, etc. By way of example, a schematic diagram of an interactive information presentation is shown in fig. 4. In fig. 4, the area enclosed by the dashed line is an interactive information display area, and "XXXXXXXXXXX" in the area represents text content of the interactive information, for example, "whether to support the transaction manner of the character a in the video in the event B", and the user may trigger the corresponding "support" or "anti" button to express the view as the interactive feedback information. Correspondingly, the client side also uploads the feedback information to the cloud broadcasting guide server side. In addition, the five-pointed star shape is used for representing the rendering effect of the display information, and can be a feasible rendering mode of adding a sticker at the interaction information or dynamically displaying the interaction information.
According to the technical scheme, in the process of receiving and playing video data to be played, which is sent by a cloud broadcasting guide server, when an interactive information display instruction sent by the cloud broadcasting guide server is received, a target video frame for displaying target interactive information is determined according to the interactive information display instruction, supplementary enhancement information in the video data to be played and a video playing frame rate; and when the target video frame is played, the target interaction information is displayed, so that a real-time interaction channel between a client user and the rebroadcast video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program side cannot timely acquire feedback of program content from a viewer, and the interactivity of the viewer is poor in the process of watching program video, and realizes that the target video data to be retransmitted can be accurately forwarded in the process of retransmitting video playing, interactive information is inserted and displayed in real time at an accurate time point, and the interaction feeling and participation feeling of a user and the video content are enhanced.
Example III
Fig. 5 is a schematic structural diagram of an interactive information display device configured at a cloud multicast server according to a third embodiment of the present disclosure. The interactive information display device configured at the cloud broadcasting guide server provided by the embodiment is suitable for displaying real-time interactive information in the video rebroadcasting process of television programs.
As shown in fig. 5, the interactive information display device configured at the cloud broadcasting server includes: a video data forwarding module 310 and an interactive information presentation control module 320.
The video data forwarding module 310 is configured to write supplemental enhancement information into target video data to be retransmitted according to a preset time interval, and forward the target video data to be retransmitted to a target client for video playing, where the supplemental enhancement information includes a playing time of a first frame video image in the target video data to be retransmitted in which the supplemental enhancement information is written; the interactive information display control module 320 is configured to send an interactive information display instruction to the target client, so that the client determines a target video frame for displaying target interactive information according to the interactive information display instruction, the supplemental enhancement information and the video playing frame rate, and displays the target interactive information when playing the target video frame.
According to the technical scheme, in the process of forwarding target video data to be retransmitted to the client side through the cloud broadcasting guiding server side, supplementary enhancement information is written in the target video data to be retransmitted according to a preset time interval, wherein the supplementary enhancement information comprises the playing time of a first frame video image in a group of video data packets written with the supplementary enhancement information, so that the target client side receives the target video data to be retransmitted to realize video retransmission, and meanwhile, in the process of forwarding the target video data to be retransmitted to the client side, an interactive information display instruction is sent to the target client side, so that the client side determines target video frames for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frames are played, so that a real-time interactive channel between a client side user and a retransmitted video is established. The technical scheme of the embodiment of the disclosure solves the problem that in the prior art, a program side cannot timely acquire feedback of program content from a viewer, and the interactivity of the viewer in the process of watching program video is poor, realizes real-time insertion and display of interactive information at an accurate time point in the process of broadcasting a rebroadcast video, and enhances interaction feeling and participation feeling of a user and the video content.
In some optional implementation manners, the interactive information display device configured at the cloud broadcasting guiding server further comprises a video data identification module, which is used for performing image matching on a received first frame image of the video data to be retransmitted and a pre-stored image of the video data to be retransmitted before the supplementary enhancement information is written in the target video data to be retransmitted according to a preset time interval; and when the image matching is successful, determining the received video data to be retransmitted as target video data to be retransmitted.
In some alternative implementations, the video data forwarding module 310 is further configured to:
when the received video data to be retransmitted is determined to be target video data to be retransmitted, writing first supplementary enhancement information in a data packet of the forwarded first target video data to be retransmitted, wherein the first supplementary enhancement information is an initial moment for forwarding the target video data to be retransmitted;
after the first supplementary enhancement information is written, corresponding supplementary enhancement information is inserted into the target video data to be retransmitted, which is continuously forwarded, according to a preset time interval.
In some optional implementations, the interactive information display device configured at the cloud broadcasting server further includes an interactive feedback information collection module, configured to:
And receiving an interaction feedback result of the target client and the interaction information.
The interactive information display device configured at the cloud guide server provided by the embodiment of the disclosure can be used for executing the interactive information display method applied to the cloud guide server provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.
Example IV
Fig. 6 is a schematic structural diagram of an interactive information display device configured at a client according to a fourth embodiment of the disclosure. The interactive information display device configured at the client provided by the embodiment is suitable for displaying interactive information in the process of playing the synchronous rebroadcast video of the television station by the video playing application client.
As shown in fig. 6, the interactive information display device configured at the client includes: a video data receiving module 410, an interactive video frame determining module 420, and an interactive information presentation module 430.
The video data receiving module 410 is configured to receive and play video data to be played forwarded by the cloud broadcasting server, where part of the video data to be played is written with supplementary enhancement information including video frame playing time; the interactive video frame determining module 420 is configured to determine, when an interactive information display instruction issued by the cloud broadcasting server is received, a target video frame for displaying target interactive information according to the interactive information display instruction, the supplemental enhancement information and a video playing frame rate; the interactive information display module 430 is configured to display the target interactive information when the target video frame is played.
According to the technical scheme, in the process of receiving and playing video data to be played, which is sent by a cloud broadcasting guide server, when an interactive information display instruction sent by the cloud broadcasting guide server is received, a target video frame for displaying target interactive information is determined according to the interactive information display instruction, supplementary enhancement information in the video data to be played and a video playing frame rate; and when the target video frame is played, the target interaction information is displayed, so that a real-time interaction channel between a client user and the rebroadcast video is established. The technical scheme of the embodiment of the disclosure solves the problems that in the prior art, a program side cannot timely acquire feedback of program content from a viewer, and the interactivity of the viewer is poor in the process of watching program video, and realizes that the target video data to be retransmitted can be accurately forwarded in the process of retransmitting video playing, interactive information is inserted and displayed in real time at an accurate time point, and the interaction feeling and participation feeling of a user and the video content are enhanced.
In some alternative implementations, the interactive video frame determination module 420 is specifically configured to:
determining the playing time difference of the two corresponding video frames according to the playing time of each two adjacent video frames of the supplemental enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time identical to the displaying time of the target interactive information appointed in the interactive information displaying instruction as a target video frame.
In some alternative implementations, the target interaction information is an interaction component including a content selection button or a scoring menu.
The interactive information display device configured at the client provided by the embodiment of the disclosure can be used for executing the interactive information display method applied to the client provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.
Example five
Referring now to fig. 7, a schematic diagram of an electronic device (e.g., a terminal device or server in fig. 7) 500 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 7 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 7, the electronic apparatus 500 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 501 that may perform various appropriate actions and processes according to a program stored in a Read-Only Memory (ROM) 502 or a program loaded from a storage device 508 into a random access Memory (Random Access Memory, RAM) 503. In the RAM503, various programs and data required for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM503 are connected to each other via a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
In general, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 507 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 508 including, for example, magnetic tape, hard disk, etc.; and communication means 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 7 shows an electronic device 500 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or from the storage means 508, or from the ROM 502. When the computer program is executed by the processing device 501, the above-described functions defined in the interactive information presentation method applied to the cloud broadcasting server or the client according to the embodiments of the present disclosure are performed.
The electronic device provided by the embodiment of the present disclosure and the interactive information display method applied to the cloud broadcasting server or the client provided by the foregoing embodiments belong to the same disclosure concept, and technical details not described in detail in the present embodiment may refer to the foregoing embodiments, and the present embodiment has the same beneficial effects as the foregoing embodiments.
Example six
The embodiment of the disclosure provides a computer storage medium, on which a computer program is stored, which when executed by a processor, implements the interactive information display method applied to a client or a cloud director server provided in the above embodiment.
It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (EPROM) or FLASH Memory (FLASH), an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:
writing supplementary enhancement information into target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises playing time of the target video data to be retransmitted in a group of video data packets in which the supplementary enhancement information is written;
And sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played.
The computer readable medium carries one or more programs which, when executed by the electronic device, may further cause the electronic device to:
receiving and playing video data to be played forwarded by a cloud broadcasting guide server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud broadcasting guide server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate;
and displaying the target interaction information when the target video frame is played.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The names of the units and modules do not limit the units and modules themselves in some cases, and the data generation module may be described as a "video data generation module", for example.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a field programmable gate array (Field Programmable Gate Array, FPGA), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a special standard product (Application Specific Standard Parts, ASSP), a System On Chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, an interactive information display method applied to a cloud multicast service end is provided, where the method includes:
writing supplementary enhancement information into target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be retransmitted, in which the supplementary enhancement information is written;
and sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played.
According to one or more embodiments of the present disclosure, an interactive information display method applied to a cloud multicast service end is provided [ example two ], further including:
in some alternative embodiments, before writing the supplemental enhancement information in the target video data to be rebroadcast at preset time intervals, the method further comprises:
Performing image matching on the received first frame image of the video data to be rebroadcast and the pre-stored image of the target video data to be rebroadcast;
and when the image matching is successful, determining the received video data to be retransmitted as target video data to be retransmitted.
According to one or more embodiments of the present disclosure, an interactive information display method applied to a cloud multicast service end is provided [ example three ], and the method further includes:
in some optional implementations, writing the supplemental enhancement information in the target video data to be rebroadcast at preset time intervals includes:
when the received video data to be retransmitted is determined to be target video data to be retransmitted, writing first supplementary enhancement information in a data packet of the forwarded first target video data to be retransmitted, wherein the first supplementary enhancement information is an initial moment for forwarding the target video data to be retransmitted;
after the first supplementary enhancement information is written, corresponding supplementary enhancement information is inserted into the target video data to be retransmitted, which is continuously forwarded, according to a preset time interval.
According to one or more embodiments of the present disclosure, an interactive information display method applied to a cloud multicast service end is provided [ example four ], and the method further includes:
In some alternative implementations of the present invention,
and receiving an interaction feedback result of the target client and the interaction information.
According to one or more embodiments of the present disclosure, there is provided an interactive information presentation method applied to a client, including:
receiving and playing video data to be played forwarded by a cloud broadcasting guide server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud broadcasting guide server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate;
and displaying the target interaction information when the target video frame is played.
According to one or more embodiments of the present disclosure, an interactive information display method applied to a client is provided [ example six ], further including:
in some optional implementations, the determining, according to the interactive information display instruction, the supplemental enhancement information, and the video play frame rate, a target video frame for displaying target interactive information includes:
Determining the playing time difference of the two corresponding video frames according to the playing time of each two adjacent video frames of the supplemental enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time identical to the displaying time of the target interactive information appointed in the interactive information displaying instruction as a target video frame.
According to one or more embodiments of the present disclosure, an interactive information display method applied to a client is provided [ example seventh ], further including:
in some alternative implementations, the target interaction information is an interaction component including a content selection button or a scoring menu.
According to one or more embodiments of the present disclosure, an interactive information display device configured at a cloud broadcasting server is provided, including:
the video data forwarding module is used for writing supplementary enhancement information into target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises the playing time of a first frame video image in the target video data to be retransmitted, in which the supplementary enhancement information is written;
And the interactive information display control module is used for sending an interactive information display instruction to the target client so that the client can determine a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and display the target interactive information when the target video frame is played.
According to one or more embodiments of the present disclosure, an interactive information display device configured at a cloud multicast service end is provided [ example nine ] and further includes:
in some optional implementation manners, the interactive information display device configured at the cloud broadcasting guiding server further comprises a video data identification module, which is used for performing image matching on a received first frame image of the video data to be retransmitted and a pre-stored image of the video data to be retransmitted before the supplementary enhancement information is written in the target video data to be retransmitted according to a preset time interval; and when the image matching is successful, determining the received video data to be retransmitted as target video data to be retransmitted.
According to one or more embodiments of the present disclosure, an interactive information display device configured at a cloud multicast service end is provided [ exemplary ten ], and the interactive information display device further includes:
In some alternative implementations, the video data forwarding module is further configured to:
when the received video data to be retransmitted is determined to be target video data to be retransmitted, writing first supplementary enhancement information in a data packet of the forwarded first target video data to be retransmitted, wherein the first supplementary enhancement information is an initial moment for forwarding the target video data to be retransmitted;
after the first supplementary enhancement information is written, corresponding supplementary enhancement information is inserted into the target video data to be retransmitted, which is continuously forwarded, according to a preset time interval.
According to one or more embodiments of the present disclosure, an interactive information display device configured at a cloud multicast service end is provided [ example eleventh ], further including:
in some optional implementations, the interactive information display device configured at the cloud broadcasting server further includes an interactive feedback information collection module, configured to:
and receiving an interaction feedback result of the target client and the interaction information.
According to one or more embodiments of the present disclosure, there is provided an interactive information presentation apparatus configured at a client, including:
the video data receiving module is used for receiving and playing the video data to be played forwarded by the cloud broadcasting guide server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
The interactive video frame determining module is used for determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate when receiving the interactive information display instruction issued by the cloud broadcasting server;
and the interactive information display module is used for displaying the target interactive information when the target video frame is played.
According to one or more embodiments of the present disclosure, there is provided an interactive information display device configured at a client, further including:
in some alternative implementations, the interactive video frame determination module 420 is specifically configured to:
determining the playing time difference of the two corresponding video frames according to the playing time of each two adjacent video frames of the supplemental enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time identical to the displaying time of the target interactive information appointed in the interactive information displaying instruction as a target video frame.
According to one or more embodiments of the present disclosure, there is provided an interactive information display device configured at a client, further including:
In some alternative implementations, the target interaction information is an interaction component including a content selection button or a scoring menu.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims (11)

1. An interactive information display method applied to a cloud broadcasting guide server side is characterized by comprising the following steps:
writing supplementary enhancement information into target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises playing time of a first frame video image in the target video data to be retransmitted, in which the supplementary enhancement information is written;
and sending an interactive information display instruction to the target client so that the client determines a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and displays the target interactive information when the target video frame is played, wherein the interactive information display instruction comprises the content of the interactive information, a rendering scheme and the time for displaying the interactive information.
2. The method of claim 1, wherein before writing the supplemental enhancement information in the target video data to be rebroadcast at a preset time interval, the method further comprises:
performing image matching on the received first frame image of the video data to be rebroadcast and the pre-stored image of the target video data to be rebroadcast;
and when the image matching is successful, determining the received video data to be retransmitted as target video data to be retransmitted.
3. The method of claim 2, wherein writing supplemental enhancement information in the target video data to be retransmitted at preset time intervals comprises:
when the received video data to be retransmitted is determined to be target video data to be retransmitted, writing first supplementary enhancement information in a data packet of the forwarded first target video data to be retransmitted, wherein the first supplementary enhancement information is an initial moment for forwarding the target video data to be retransmitted;
after the first supplementary enhancement information is written, corresponding supplementary enhancement information is inserted into the target video data to be retransmitted, which is continuously forwarded, according to a preset time interval.
4. The method according to claim 1, wherein the method further comprises:
And receiving an interaction feedback result of the target client and the interaction information.
5. An interactive information display method applied to a client is characterized by comprising the following steps:
receiving and playing video data to be played forwarded by a cloud broadcasting guide server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
when an interactive information display instruction issued by the cloud broadcasting server is received, determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, wherein the interactive information display instruction comprises the content of the interactive information, a rendering scheme and the time for displaying the interactive information;
when the target video frame is played, according to the rendering scheme, the target interaction information is displayed by adding a sticker at the interaction information or dynamically displaying the rendering mode of the interaction information.
6. The method of claim 5, wherein determining a target video frame for displaying target interaction information based on the interaction information display instruction, the supplemental enhancement information, and a video play frame rate comprises:
Determining the playing time difference of the two corresponding video frames according to the playing time of each two adjacent video frames of the supplemental enhancement information;
determining the number of video frames in the playing time difference and the playing time corresponding to each video frame in the playing time difference based on the video playing frame rate;
and taking the video frame with the playing time identical to the displaying time of the target interactive information appointed in the interactive information displaying instruction as a target video frame.
7. The method of claim 5 or 6, wherein the target interaction information is an interaction component comprising a content selection button or a scoring menu.
8. The utility model provides an interactive information display device, disposes in cloud and leads broadcasting service end which characterized in that includes:
the video data forwarding module is used for writing supplementary enhancement information into target video data to be retransmitted according to a preset time interval, and forwarding the target video data to be retransmitted to a target client for video playing, wherein the supplementary enhancement information comprises the playing time of a first frame video image in the target video data to be retransmitted, in which the supplementary enhancement information is written;
the interactive information display control module is used for sending an interactive information display instruction to the target client so that the client can determine a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate, and display the target interactive information when playing the target video frame, wherein the interactive information display instruction comprises the content of the interactive information, a rendering scheme and the time for displaying the interactive information.
9. An interactive information display device, configured at a client, comprising:
the video data receiving module is used for receiving and playing the video data to be played forwarded by the cloud broadcasting guide server, wherein part of the video data to be played is written with supplementary enhancement information containing video frame playing time;
the interactive video frame determining module is used for determining a target video frame for displaying target interactive information according to the interactive information display instruction, the supplementary enhancement information and the video playing frame rate when receiving the interactive information display instruction issued by the cloud broadcasting server, wherein the interactive information display instruction comprises the content of the interactive information, a rendering scheme and the time for displaying the interactive information;
and the interactive information display module is used for displaying the target interactive information according to the rendering scheme by adding a sticker at the interactive information or dynamically displaying the rendering mode of the interactive information when the target video frame is played.
10. An electronic device, the electronic device comprising:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the interactive information presentation method applied to the cloud broadcasting server or the client according to any one of claims 1 to 7.
11. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing the interactive information presentation method applied to a cloud director server or client as claimed in any of claims 1-7.
CN202111211077.XA 2021-10-18 2021-10-18 Interactive information display method and device, electronic equipment and storage medium Active CN113923530B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111211077.XA CN113923530B (en) 2021-10-18 2021-10-18 Interactive information display method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111211077.XA CN113923530B (en) 2021-10-18 2021-10-18 Interactive information display method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113923530A CN113923530A (en) 2022-01-11
CN113923530B true CN113923530B (en) 2023-12-22

Family

ID=79241263

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111211077.XA Active CN113923530B (en) 2021-10-18 2021-10-18 Interactive information display method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113923530B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115243063B (en) * 2022-07-13 2024-04-19 广州博冠信息科技有限公司 Video stream processing method, processing device and processing system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104954879A (en) * 2015-06-17 2015-09-30 北京奇艺世纪科技有限公司 Video interaction content display method and device
WO2020103203A1 (en) * 2018-11-19 2020-05-28 网宿科技股份有限公司 Method and apparatus for synchronizing whiteboard with video, computing device, and storage medium
CN111711859A (en) * 2020-06-28 2020-09-25 北京奇艺世纪科技有限公司 Video image processing method, system and terminal equipment
CN111836114A (en) * 2020-07-08 2020-10-27 北京达佳互联信息技术有限公司 Video interaction method and device, electronic equipment and storage medium
CN111932322A (en) * 2020-09-24 2020-11-13 腾讯科技（深圳）有限公司 Advertisement display method, related device, equipment and storage medium
CN112468822A (en) * 2020-11-06 2021-03-09 上海钦文信息科技有限公司 Multimedia recording and broadcasting course interaction method based on video SEI message
WO2021047419A1 (en) * 2019-09-12 2021-03-18 广州华多网络科技有限公司 Live broadcast interaction method, live broadcast system, electronic device and storage medium
CN113163222A (en) * 2021-03-31 2021-07-23 杭州奥点科技股份有限公司 Video frame synchronization method, system, equipment and readable storage medium

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100008419A1 (en) * 2008-07-10 2010-01-14 Apple Inc. Hierarchical Bi-Directional P Frames
US8489774B2 (en) * 2009-05-27 2013-07-16 Spot411 Technologies, Inc. Synchronized delivery of interactive content
CN104168491B (en) * 2013-05-17 2018-11-23 腾讯科技（北京）有限公司 Information processing method and device in a kind of video playing
CN104135671A (en) * 2014-07-25 2014-11-05 宁波创视信息技术有限公司 Television video content interactive question and answer method
CN105451086A (en) * 2015-09-22 2016-03-30 合一网络技术(北京)有限公司 Method and apparatus for realizing video interaction
CN105245968A (en) * 2015-09-30 2016-01-13 天脉聚源（北京）科技有限公司 Method and device for dynamically displaying interactive entry information on video program
CN108234997B (en) * 2017-12-12 2019-11-26 北京百度网讯科技有限公司 Time-delay measuring method, equipment, system and the computer-readable medium of live video
CN110062270B (en) * 2019-04-24 2022-08-12 北京豆萌信息技术有限公司 Advertisement display method and device
CN112954251B (en) * 2019-12-10 2023-03-21 RealMe重庆移动通信有限公司 Video processing method, video processing device, storage medium and electronic equipment
CN112911343B (en) * 2021-01-18 2023-04-28 北京奇艺世纪科技有限公司 Multi-channel video playing method and device, electronic equipment and storage medium
CN113507617B (en) * 2021-06-24 2022-04-01 广州易方信息科技股份有限公司 SEI frame playback data synchronization method, system, device and medium based on live video stream

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104954879A (en) * 2015-06-17 2015-09-30 北京奇艺世纪科技有限公司 Video interaction content display method and device
WO2020103203A1 (en) * 2018-11-19 2020-05-28 网宿科技股份有限公司 Method and apparatus for synchronizing whiteboard with video, computing device, and storage medium
WO2021047419A1 (en) * 2019-09-12 2021-03-18 广州华多网络科技有限公司 Live broadcast interaction method, live broadcast system, electronic device and storage medium
CN111711859A (en) * 2020-06-28 2020-09-25 北京奇艺世纪科技有限公司 Video image processing method, system and terminal equipment
CN111836114A (en) * 2020-07-08 2020-10-27 北京达佳互联信息技术有限公司 Video interaction method and device, electronic equipment and storage medium
CN111932322A (en) * 2020-09-24 2020-11-13 腾讯科技（深圳）有限公司 Advertisement display method, related device, equipment and storage medium
CN112468822A (en) * 2020-11-06 2021-03-09 上海钦文信息科技有限公司 Multimedia recording and broadcasting course interaction method based on video SEI message
CN113163222A (en) * 2021-03-31 2021-07-23 杭州奥点科技股份有限公司 Video frame synchronization method, system, equipment and readable storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Guest Editorial Immersive Video Coding and Transmission;Mathias Wien;IEEE Journal on Emerging and Selected Topics in Circuits and Systems ( Volume: 9, Issue: 1, March 2019);1-4 *
基于H264的嵌入式平台实时视频通信系统的设计与实现;周玉宝;刘强;;微计算机信息(第14期);1-3 *

Also Published As

Publication number Publication date
CN113923530A (en) 2022-01-11

Similar Documents

Publication Publication Date Title
CN109547831B (en) Method and device for synchronizing white board and video, computing equipment and storage medium
CN106454407B (en) Video live broadcasting method and device
CN108924661B (en) Data interaction method, device, terminal and storage medium based on live broadcast room
US9319444B2 (en) Font data streaming
CN111970524B (en) Control method, device, system, equipment and medium for interactive live broadcast and microphone connection
CN111314720A (en) Live broadcast and microphone connection control method and device, electronic equipment and computer readable medium
CN109714622B (en) Video data processing method and device and electronic equipment
CN113225577B (en) Live stream processing method, device and system, electronic equipment and storage medium
CN106792230B (en) Advertisement interaction method and system based on live video
CN112291502B (en) Information interaction method, device and system and electronic equipment
CN114154012A (en) Video recommendation method and device, electronic equipment and storage medium
CN103428538A (en) Method, device and system for interaction of interactive broadcast televisions
CN112492357A (en) Method, device, medium and electronic equipment for processing multiple video streams
CN112291498B (en) Audio and video data transmission method and device and storage medium
KR20110082062A (en) Method, apparatus and system for providing supplemental audio/video content
CN112492347A (en) Method for processing information flow and displaying bullet screen information and information flow processing system
CN112601101A (en) Subtitle display method and device, electronic equipment and storage medium
CN112492324A (en) Data processing method and system
CN114679628A (en) Bullet screen adding method and device, electronic equipment and storage medium
CN115278275A (en) Information presentation method, device, equipment, storage medium and program product
CN113923530B (en) Interactive information display method and device, electronic equipment and storage medium
CN113891168A (en) Subtitle processing method, subtitle processing device, electronic equipment and storage medium
CN114095671A (en) Cloud conference live broadcast system, method, device, equipment and medium
CN106488295A (en) A kind of method for information display and device
CN107852523B (en) Method, terminal and equipment for synchronizing media rendering between terminals

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant