WO2023029924A1 - 评论信息的显示方法、装置、设备、存储介质及程序产品 - Google Patents

评论信息的显示方法、装置、设备、存储介质及程序产品 Download PDF

Info

Publication number
WO2023029924A1
WO2023029924A1 PCT/CN2022/111612 CN2022111612W WO2023029924A1 WO 2023029924 A1 WO2023029924 A1 WO 2023029924A1 CN 2022111612 W CN2022111612 W CN 2022111612W WO 2023029924 A1 WO2023029924 A1 WO 2023029924A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
video segment
comment
target
information
Prior art date
Application number
PCT/CN2022/111612
Other languages
English (en)
French (fr)
Inventor
陈晓丹
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2023029924A1 publication Critical patent/WO2023029924A1/zh
Priority to US18/196,868 priority Critical patent/US12120379B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4756End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4858End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders

Definitions

  • the embodiment of the present application relates to the field of multimedia technologies, and in particular to the display of comment information.
  • the comment information displayed on the video playback interface is information including at least one of text or pictures.
  • the dimension of the information provided by the comment information is relatively limited, and the interactive experience of the interactive object is poor, causing people to The machine interaction rate is low.
  • the embodiments of the present application provide a review information display method, device, device, storage medium, and program product, which can be used to expand the dimension of information provided by the review information and improve the human-computer interaction rate. Described technical scheme is as follows:
  • an embodiment of the present application provides a method for displaying comment information, the method comprising:
  • target comment information including a video clip playback control on the video playback interface, the video clip playback control being used to trigger the target video clip Playback of video clips.
  • displaying target comment information including video clip playback controls on the video playback interface includes:
  • Controlling the target comment information including the video clip playback control to move from the reference position of the video playback interface into the video playback interface, so that the target comment information including the video clip playback control is displayed on the video playback interface.
  • a display device for comment information comprising:
  • the first display module is used to display the video playback interface
  • the first obtaining module is used to obtain the video clip matching result of the comment content in the video playback interface
  • the second display module is used to respond to the video segment matching result including the target video segment matching the comment content, display the target comment information including the video segment playback control on the video playback interface, and the video segment playback The control is used to trigger the playing of the target video segment.
  • a computer device in another aspect, includes a processor and a memory, at least one computer program is stored in the memory, the at least one computer program is loaded and executed by the processor, so that all The computer device implements the method for displaying comment information described in the above aspects.
  • a computer-readable storage medium wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor, so that the computer implements the above aspects.
  • a computer program product in another aspect, includes a computer program or a computer instruction, and the computer program or the computer instruction is stored to be loaded and executed by a processor, so that the computer executes the computer program described in the above aspect.
  • the display method of comment information is also provided.
  • the technical solution provided by the embodiment of the present application can display comment information including a video clip playback control on the video playback interface, and the video clip playback control can trigger the playback of a target video clip matching the comment content. That is to say, the comment information displayed in the embodiment of the present application can provide information on the dimension of the video segment, which expands the dimension of the information provided by the comment information, and the interactive object can watch the target video segment by triggering the video segment playback control in the comment information.
  • the diversity of comment methods is increased, which is conducive to improving the interactive experience of interactive objects, thereby improving the rate of human-computer interaction.
  • FIG. 1 is a schematic diagram of an implementation environment of a method for displaying comment information provided by an embodiment of the present application
  • Fig. 2 is a flow chart of a method for displaying comment information provided by an embodiment of the present application
  • FIG. 3 is a schematic diagram of a video playback interface provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of a video playback interface provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a video playback interface provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a video playback interface provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a video playback interface provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a video playback interface provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of a display process of comment information provided by an embodiment of the present application.
  • Fig. 10 is a schematic diagram of a display device for comment information provided by an embodiment of the present application.
  • Fig. 11 is a schematic diagram of a display device for comment information provided by an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of a terminal provided by an embodiment of the present application.
  • FIG. 1 is a schematic diagram of an implementation environment of a method for displaying comment information provided by an embodiment of the present application, and the implementation environment includes a terminal 11 and a server 12 .
  • the terminal 11 installs and runs an application program or a webpage that supports video playback and displaying comment information.
  • the application program or webpage needs to display comment information on the video playback interface, the method provided by the embodiment of the present application can be used for display.
  • the application program or webpage is a video application program or webpage, a live broadcast application program or webpage, a browser application program or webpage, and the like.
  • the terminal 11 is a device used by any interactive object, and the account of any interactive object is logged in.
  • the server 12 is a background server of an application program or a webpage installed on the terminal that supports video playback and displaying comment information, and is used to provide background services for the application program or webpage.
  • the terminal 11 can be any electronic product that can interact with the user in one or more ways such as a keyboard, a touch pad, a touch screen, a remote control, voice interaction, or a handwriting device, such as a PC (Personal Computer , personal computer), mobile phone, smart phone, PDA (Personal Digital Assistant, personal digital assistant), wearable device, PPC (Pocket PC, handheld computer), tablet computer, smart car machine, smart TV, smart speaker or vehicle terminal, etc.
  • the server 12 may be one server, or a server cluster composed of multiple servers, or a cloud computing service center.
  • the terminal 11 establishes a communication connection with the server 12 through a wired or wireless network.
  • terminal 11 and server 12 are only examples, and other existing or future terminals or servers that may be applicable to this application should also be included in the scope of protection of this application, and are referred to herein as Citations are included here.
  • the embodiment of the present application provides a method for displaying comment information, and the method should be executed by the terminal 11 as an example.
  • the method for displaying comment information provided by the embodiment of the present application includes the following steps 201 to 203 .
  • step 201 a video playing interface is displayed.
  • the video playback interface is an interface for playing the video currently watched by the interactive object.
  • the video currently watched by the interactive object is referred to as the first video. That is to say, the first video is played on the video playing interface.
  • the embodiment of the present application does not limit the playback mode of the first video on the video playback interface.
  • the first video adopts a full-screen playback mode (such as horizontal screen playback), or uses a window playback mode (such as vertical screen playback), etc., This is related to the playback settings of the application or web page that provides the video playback interface.
  • the video playback interface is an interface in an application that supports video playback and display of comment information, or the video playback interface is an interface in a web page that supports video playback and display of comment information.
  • the first video may be a recorded video or a live video, which is not limited in this embodiment of the present application.
  • the terminal displays the video playback interface as follows: the terminal acquires the first video in response to a playback instruction of the first video, the terminal displays the video playback interface, and plays the first video on the video playback interface.
  • the terminal can also obtain historical comment information corresponding to the first video, which is the comment published by at least one interactive object when watching the first video.
  • This application does not limit the form of historical comment information, which can be displayed Comments in the video comment area can also display scrolling comments such as barrage comments in the playing first video area.
  • historical comment information corresponding to the current playback progress may be displayed on the video playback interface based on the playback progress of the first video.
  • the terminal when it plays the first video, it may not display the historical comment information corresponding to the first video.
  • the first video is a video stored on a server, and the terminal acquires the first video and historical comment information corresponding to the first video through interaction with the server.
  • the first video is a video locally stored in the terminal, and the terminal extracts the first video locally, and obtains historical comment information corresponding to the first video through interaction with a server.
  • At least one of a content editing box, a video clip matching control, and a comment posting control is displayed on the video playing interface.
  • the content edit box is used to display the comment content.
  • the content editing box is provided with a voice input interface, and the interactive object can input comment voices by triggering the voice input interface provided by the content editing box, and then the terminal displays in the content editing box the results obtained after voice recognition of the comment voices. comments.
  • the interactive object can directly edit comment content in the form of text, pictures, etc. in the content editing box.
  • the video segment matching control is used to trigger the acquisition of video segment matching results
  • the comment information publication control is used to trigger the publication of comment information.
  • the display positions and forms of the content editing box, the video segment matching control and the comment information posting control can be set according to experience, and can also be flexibly adjusted according to the application scenario, which is not limited in this embodiment of the present application.
  • the content editing box, the video segment matching control and the comment information posting control are all displayed in the lower right corner area of the video playback interface, the content editing box is in the form of an editable input box, and the video segment matching control is in the form of an editable input box.
  • the form of the comment posting control is a triggerable icon or a triggerable button.
  • first information may be displayed on the video segment matching control, so as to use the first information to prompt the interactive object that the control is used to trigger acquisition of the video segment matching result.
  • Second information may be displayed on the comment information publication control, so as to use the second information to prompt the control to trigger publication of comment information.
  • the first information and the second information are set according to experience, or flexibly adjusted according to application scenarios, which is not limited in this embodiment of the present application.
  • the video playback interface is as shown in FIG. 3 .
  • the video playback interface shown in FIG. 3 displays a content editing box 301 , a video clip matching control 302 and a comment information publishing control 303 .
  • the first information displayed on the video segment matching control 302 is "AI”
  • the second information displayed on the comment information publication control 303 is "published”.
  • the video playing interface shown in Figure 3 the video screen of the first video and a plurality of historical comment information corresponding to the first video (comment information A, comment information B, comment information C, comment information D and Comment information E).
  • the multiple pieces of historical comment information are suspended and displayed on the video screen of the first video.
  • the multiple historical comment information refers to the comment information matching the time point corresponding to the current video frame of the first video, and the multiple historical comment information may be generated by the current
  • the comment information published by the interactive object watching the first video may also be the comment information published by other interactive objects during watching the first video, which is not limited in this embodiment of the present application.
  • the multiple pieces of historical comment information can move on the video playback interface as the interactive object watches the first video.
  • the avatar of the interactive object who posted the historical comment information may be displayed on the plurality of historical comment information, and the interactive object may know the interactive object who posted the comment information through the avatar on the historical comment information.
  • the interactive object can interact with the publisher of the historical comment information by triggering the historical comment information.
  • a playback progress bar of the first video a playback progress bar of the first video
  • playback control controls of the first video include but are not limited to pause/play controls, next episode controls, loop playback controls, volume control controls, setting controls, playback screen ratio selection controls, full-screen playback controls, and the like.
  • the comment information switch control is used for the interactive object to select to enable or disable the comment information display function. As shown in Figure 3, the comment information switch control displays the text "bomb".
  • the comment information can also be called bullet chatting.
  • Bullet chatting is a kind of commentary subtitles, which can be superimposed and displayed on the video screen.
  • the interactive objects can express their viewing experience by posting bullet chatting. You can see the barrage posted by other interactive objects at the moment of the current video playback, and the interactive objects can communicate and interact through the barrage.
  • step 202 the video segment matching result of the comment content in the video playback interface is obtained.
  • the commentary content in the video playback interface is the commentary content provided by the interactive object currently watching the first video (called the target interactive object).
  • the comment content in the video playback interface refers to the comment content obtained by voice recognition of the comment voice input by the target interactive object.
  • the comment content in the video playing interface refers to the content displayed in the content editing box on the video playing interface.
  • the content displayed in the content editing box may refer to content in the form of text, pictures, etc. directly edited by the target interactive object in the content editing box, or may refer to the content obtained by the terminal performing speech recognition on the target comment voice.
  • the target comment voice refers to the comment voice input by the target interactive object by triggering the voice input interface provided by the content editing box.
  • the target interactive object wants to comment on the video content of the first video at a certain point in time, he can input the comment voice or edit the comment content in the content editing box.
  • the content that can be edited by the target interactive object in the content editing box includes but not limited to text, picture and so on.
  • the text refers to the text input or uploaded by the target interactive object
  • the picture may refer to a picture selected by the target interactive object from the alternative pictures (such as emoticon pictures, cartoon pictures) provided by the application program or web page that plays the first video, or Refers to the pictures, etc. that the target interaction object selects and uploads locally from the terminal.
  • the video segment matching result of the comment content in the video playback interface is further obtained.
  • the operation of acquiring the video segment matching result of the comment content in the video playback interface is directly performed.
  • a video clip matching control is displayed on the video playback interface. After obtaining the comment content in the video playback interface, respond to the trigger operation of the video clip matching control, and then perform the acquisition of comments in the video playback interface. The operation on the video clip matching result of the content.
  • the video clip matching control is used to trigger the acquisition of video clip matching results.
  • the trigger operation on the video clip matching control refers to the human-computer interaction operation triggered on the video clip matching control.
  • the embodiment of the present application does not limit the type of trigger operation of the video clip matching control.
  • the trigger operation of the video clip matching control includes but not limited to single-click operation, double-click operation, floating touch operation, and pressure touch operation , and at least one of sliding operations.
  • the state of the video clip matching control can also be changed from the disabled state to the enabled state, so as to use the enabled state to inform the target interactive object that the video has been successfully triggered.
  • Fragment matching controls That is, in response to the trigger operation of the video segment matching control, the state of the video segment matching control is changed from the disabled state to the enabled state.
  • the disabled state and the enabled state are two different control display states, and the embodiment of the present application does not limit the disabled state and the enabled state. Exemplarily, the video clip matching control in the disabled state is shown as 302 in FIG. 3 , and the video clip matching control in the enabled state is shown as 401 in FIG. 4 .
  • the video segment matching result of the comment content is used to indicate whether the comment content is successfully matched to the video segment.
  • the video segment to which the comment content is successfully matched is called the target video segment
  • the target video segment refers to the video segment that matches the comment content.
  • the duration of the target video segment is set according to experience, or flexibly adjusted according to the application scenario, which is not limited in this embodiment of the present application. For example, the duration of the target video segment is 60 seconds.
  • the video segment matching result of the review content there are two possibilities for the video segment matching result of the review content, one is to include the target video segment, and the other is not to include the target video segment. If the video segment matching result of the comment content includes the target video segment, it means that the comment content is successfully matched to the video segment. If the video segment matching result of the comment content does not include the target video segment, it means that the comment content has not been successfully matched to the video segment.
  • the video segment matching result that does not include the target video segment includes prompt information
  • the prompt information is used to prompt that the comment content is not successfully matched to the video segment.
  • the embodiment of the present application does not limit the form of the prompt information.
  • the prompt information may only include the information indicating the matching result of the matching failure, or may include both the information indicating the matching result of the matching failure and the information indicating the matching result. Information about why this match result failed.
  • the reasons for the matching result of matching failure include but are not limited to incorrect description of the comment content, absence of the video segment indicated by the comment content due to deletion, network failure, and the like.
  • the method for the terminal to obtain the video clip matching result of the comment content in the video playback interface may refer to the terminal locally obtaining the video clip matching result of the comment content in the video playback interface; it may also refer to the terminal interacting with the server , to obtain the video clip matching result of the comment content in the video playback interface, which is not limited in this embodiment of the present application.
  • the process for the terminal to locally obtain the matching result of the video segment includes the following steps A and B:
  • Step A Identify the text information corresponding to the comment content.
  • the terminal After obtaining the comment content in the video playback interface, the terminal recognizes the text information corresponding to the comment content, and the text information corresponding to the comment content can represent the meaning of the comment content to a certain extent.
  • the process of identifying the text information corresponding to the review content is a semantic recognition process.
  • Semantic recognition is a natural language processing technology that allows computers to understand and analyze text content and automatically process text content. Through semantic recognition, it is possible to understand the meaning of text content.
  • the process of identifying the text information corresponding to the comment content is a picture recognition process.
  • Image recognition can identify the relevant information of the image. For example, if the image is an actor's face image, the image recognition can identify which actor's face the face in the image belongs to.
  • the process of identifying the text information corresponding to the comment content is a comprehensive process of semantic recognition and picture recognition.
  • the embodiment of the present application does not limit the manners of semantic recognition and picture recognition.
  • a neural network model may be used to realize semantic recognition and picture recognition.
  • Step B Compare the text information with the label information of the candidate video clips, and obtain the video clip matching results of the commented content based on the comparison results.
  • the candidate video segment is a video segment associated with the first video.
  • the candidate video segments are video segments associated with the first video.
  • the candidate video segment is a segment intercepted from at least one of the first video and the extended video corresponding to the first video.
  • the extended video corresponding to the first video is a video associated with the first video and used to expand the video content of the first video.
  • the extended video corresponding to the first video includes but is not limited to a sideshow video corresponding to the first video , the paid video corresponding to the first video, etc.
  • the embodiment of the present application does not limit the way of intercepting candidate video segments.
  • intercepting a frame of video as a candidate video segment, or intercepting a video segment with a reference duration as a candidate video segment the reference duration is set according to experience, or It can be flexibly adjusted according to the application scenario, for example, the reference duration is 10 seconds.
  • the tag information of the candidate video segment is used to describe the content of the candidate video segment.
  • the tag information of the candidate video segment is composed of one or more tags, and different tags are used to describe different aspects of the content of the candidate video segment.
  • the tag information of the candidate video segment is used to identify one or more aspects of the candidate video segment's plot detail attribute, episode number, title, time point, person, event, object, scene, event, and development stage. to describe.
  • the terminal before the terminal compares the text information with the tag information of the candidate video segment, it needs to first obtain the tag information of the candidate video segment.
  • the candidate video clips are stored locally in the terminal, and the terminal locally acquires tag information of the candidate video clips.
  • the server pre-interprets and transcodes the candidate video segments associated with the first video to extract tag information and stores, for example, in a cloud storage space. That is to say, the candidate video clips are stored in the server, and the terminal obtains tag information of the candidate video clips through interaction with the server.
  • the terminal sends a request carrying the video identifier of the first video to the server, and the request is used to acquire tag information of a candidate video segment corresponding to the first video.
  • the server extracts the tag information of the candidate video segment according to the video identifier of the first video, and then returns the tag information of the candidate video to the terminal.
  • the text information is compared with the tag information of the candidate video segment.
  • the method of comparing the text information with the tag information of the candidate video segment is: obtain the similarity between the text information and the tag information of the candidate video segment, and judge whether the text information is consistent with the candidate video segment according to the similarity.
  • the tag information of is matched successfully.
  • the embodiment of the present application does not limit the manner of acquiring the similarity between the text information and the tag information of the candidate video segment.
  • the text information hits the ratio of the number of tags in the tag information of a candidate video segment to the total number of tags in the tag information of the candidate video segment as the similarity between the text information and the tag information of the candidate video segment Spend.
  • the feature extraction model is invoked to perform feature extraction on the text information and the label information of the candidate video clips respectively, to obtain the features of the text information and the features of the label information of the candidate video clips; the features of the text information and the label information of the candidate video clips
  • the similarity between the features of is taken as the similarity between the text information and the label information of the candidate video clips.
  • the features of the text information and the features of the tag information of the candidate video clips are both vectors, then the similarity between the features of the text information and the features of the tag information of the candidate video clips is obtained by calculating the similarity between the two vectors Spend.
  • the similarity between two vectors refers to cosine similarity, Jaccard similarity, etc. between two vectors.
  • the comparison result indicates that the text information matches the label information of the first candidate video segment successfully; the comparison result indicates that the text information and the label information of each candidate video segment match failure.
  • the embodiment of the present application does not limit the method of judging whether the text information matches the tag information of a candidate video segment successfully.
  • the similarity threshold is set according to experience, or flexibly adjusted according to actual application scenarios, which is not limited in this embodiment of the present application.
  • the one or more candidate video segments are called the first candidate video segment, and at this time, the text information and the first candidate video segment are obtained
  • the label information matches the successful comparison result. If the text information does not match the tag information of each candidate video segment successfully, a comparison result indicating that the text information does not match successfully with the tag information of each candidate video segment is obtained.
  • the comparison result used to indicate that the text information matches the label information of the first candidate video segment is a result including the identification of the first candidate video segment;
  • the comparison result indicating that none of the text information and the tag information of each candidate video segment is successfully matched is a result including empty information, or a result including a prompt message of matching failure.
  • the tag information of the candidate video segment can accurately identify the relevant information of the candidate video segment, and the text information can identify the subject matter involved in the comment content, by matching the text information and tag information, the matching candidate video segment and comment Content has a closer relevance, improving matching accuracy.
  • the matching step when the matching step is performed by a server with stronger processing capability, the matching efficiency can be further improved and the processing load of the terminal can be reduced.
  • the video clip matching result of the comment content is obtained based on the comparison result.
  • the method of obtaining the video segment matching result of the review content based on the comparison result is: in response to the comparison result indicating that the text information matches the label information of the first candidate video segment successfully, based on the first candidate video segment , obtain the target video segment matching the comment content, and use the result including the target video segment as the video segment matching result.
  • the method of obtaining the video segment matching result of the review content based on the comparison result is: in response to the comparison result indicating that the text information and the label information of each candidate video segment do not match successfully, no video will be included.
  • the result of the fragment is used as the video fragment matching result.
  • the result that does not include any video segment may include prompt information, or may not include prompt information, which is not limited in this embodiment of the present application.
  • first candidate video segments there may be one or more first candidate video segments, which is not limited in this embodiment of the present application.
  • the method of obtaining the target video segment matching the content of the comment is as follows: the first candidate video segment is used as the The target video segment whose content matches.
  • the method of obtaining the target video clip that matches the comment content is as follows: determine the first candidate video clip in the source The position in the video is centered on the central position of the position of the first candidate video segment in the source video, and each video segment of the first duration before and after editing is used to form the target video segment by the edited video segments.
  • the first duration is half of the specified duration
  • the specified duration is the duration that the specified target video segment should have.
  • the specified duration is set according to experience, or flexibly adjusted according to the application scenario, for example, the specified duration is 60 seconds.
  • the process of acquiring the target video segment based on the first candidate video segment may also be implemented in other manners, which will not be described one by one in this embodiment of the present application.
  • the method of obtaining a target video clip that matches the comment content is as follows: from multiple first candidate video clips Select a candidate video segment as the target candidate video segment, and obtain the target video segment matching the comment content based on the target candidate video segment.
  • the embodiment of the present application does not limit the method of selecting a candidate video segment from a plurality of first candidate video segments as a target candidate video segment.
  • a candidate video segment is randomly selected from a plurality of first candidate video segments as a target candidate video segment.
  • Target candidate video segments Exemplarily, a candidate video segment having the highest similarity between label information and text information among the plurality of first candidate video segments is used as a target candidate video segment.
  • the target video segment matching the comment content is acquired based on the target candidate video segment.
  • the method of obtaining the target video segment matching the comment content refers to the method of obtaining the target video segment matching the comment content based on the first candidate video segment when the number of the first candidate video segment is one, I won't repeat them here.
  • the target video clips for playing in conjunction with the comment content can be accurately determined, and the target video clips can be specifically determined based on the number of the first candidate video clips, which improves the target video clips.
  • the determination accuracy of the fragment and the degree of matching with the comment content can be accurately determined, and the target video clips can be specifically determined based on the number of the first candidate video clips, which improves the target video clips.
  • the above is a process for the terminal to locally obtain the video segment matching result of the review content.
  • the terminal may also obtain the video segment matching result of the review content through interaction with the server.
  • the terminal interacts with the server to obtain the video clip matching result of the comment content, including but not limited to the following two:
  • Method 1 The terminal identifies the text information corresponding to the comment content; the terminal sends the text information to the server, and the server compares the text information with the tag information of the candidate video clips, and obtains the video clip matching result of the comment content based on the comparison result. Return the matching result of the video segment; the terminal receives the matching result of the video segment returned by the server.
  • the terminal needs to perform the operation of identifying the text information corresponding to the comment content.
  • the operation of obtaining the video clip matching result based on the text information is performed by the server.
  • the server For the method of the server performing the operation of obtaining the video clip matching result based on the text information, see Relevant processes in the case where the terminal locally obtains the matching result of the video segment will not be repeated here.
  • Method 2 The terminal sends the comment content to the server, and the server is used to identify the text information corresponding to the comment content, compare the text information with the label information of the candidate video segment, obtain the video segment matching result of the comment content based on the comparison result, and return Video segment matching result; the terminal receives the video segment matching result returned by the server.
  • the whole process of obtaining the matching result of the video segment according to the comment content is executed by the server.
  • the execution method refer to the process of locally obtaining the matching result of the video segment at the terminal, which will not be repeated here.
  • the terminal After acquiring the comment content in the video playback interface, the terminal acquires the video segment matching result of the comment content in the video playback interface.
  • the video segment matching results may or may not include the target video segment matching the comment content.
  • step 203 in response to the video segment matching result including the target video segment matching the comment content, the target comment information including the video segment playback control is displayed on the video playback interface, and the video segment playback control is used to trigger the playback of the target video segment.
  • the video segment matching result After obtaining the video segment matching result, judge whether the video segment matching result includes the target video segment matching the comment content, and if the video segment matching result includes the target video segment matching the comment content, display the video segment playback on the video playback interface Target comment information for the control. That is to say, in response to the video segment matching result including the target video segment matching the comment content, the target comment information including the video segment playback control is displayed on the video playback interface.
  • the video segment matching result includes a target video segment matching the comment content
  • in response to the video segment matching result including a target video segment matching the comment content directly perform displaying on the video playback interface.
  • the operation of the target comment information of the video clip playback control in response to the trigger operation of the comment information posting control, and in response to the video segment matching result including a target video segment that matches the comment content, then execute the An operation for displaying target comment information including video clip playback controls on the video playback interface.
  • the comment information posting control is used to trigger the posting of comment information, and when the trigger operation of the comment information posting control is obtained, it indicates that the target interactive object wants to post comment information.
  • the trigger operation on the comment information publishing control refers to the human-computer interaction operation triggered on the comment information publishing control.
  • the embodiment of the present application does not limit the type of trigger operation of the comment information publication control.
  • the trigger operation of the comment information publication control includes but not limited to single-click operation, double-click operation, floating touch operation, and pressure touch operation , and at least one of sliding operations.
  • the interactive object can know the matching situation of the video segment before officially sending out the comment content, so that it can be modified in time, effectively improving the quality of the comment content .
  • the video segment playback control is used to trigger the playback of the target video segment, that is, the target video segment can be played by triggering the video segment playback control included in the target comment information.
  • the embodiment of the present application does not limit the form of the video clip playback control, which can be set according to experience, and can also be flexibly adjusted according to the application scenario.
  • the target comment information includes not only video clip playback controls but also comment content.
  • the comment content includes at least one of text and pictures.
  • the target comment information is comment information in the form of comment content + video clip playback control, which can provide multi-dimensional information such as text, pictures, and video clips.
  • the target interactive object and other interactive objects watching the first video can not only see the comment content in a piece of target comment information, but also can watch the target video segment matching the comment content by triggering the video clip playback control, thereby improving the interaction of the interactive object.
  • Interactive experience Exemplarily, the target comment information displayed on the video playback interface is shown as 501 in FIG. 5 , and the target comment information shown at 501 in FIG. 5 includes comment content 5011 and video clip playback control 5012 .
  • the target comment information may also include associated information of the comment content, which is information related to the comment content.
  • the associated information includes the account number of the interactive object who edited the comment content, and At least one of the avatar of the interactive object and the nickname of the interactive object who edits the comment content.
  • the implementation of displaying the target comment information including the video clip playback control on the video playback interface is: controlling the target comment information including the video clip playback control to move from the reference position of the video playback interface into the video playback interface , so that the target comment information including the video clip playback control is displayed on the video playback interface.
  • the reference orientation is set according to experience, or flexibly adjusted according to application scenarios, which is not limited in this embodiment of the present application. Exemplarily, the reference orientation refers to the right side of the video playback interface; or, the reference orientation refers to the left side of the video playback interface; or, the reference orientation refers to the upper side of the video playback interface, etc.
  • the manner of controlling the target comment information to move from the reference orientation of the video playback interface into the video playback interface is: to control the target comment information to move from the reference orientation of the video playback interface to the video playback interface at a first reference speed.
  • the first reference speed is set according to experience, or flexibly adjusted according to application scenarios, which is not limited in this embodiment of the present application.
  • the first reference speed is a relatively slow speed, so as to ensure that the target comment information can move smoothly into the video playback interface.
  • target comment information on the video playback interface is only an example, and the embodiment of the present application is not limited thereto.
  • the target comment information is directly displayed on the video playback interface; or, the target comment information is displayed on the video playback interface by displaying special effects.
  • the method further includes: controlling movement of the target comment information on the video playback interface.
  • the embodiment of the present application does not limit the manner in which the target comment information is controlled to move on the video playback interface.
  • the control target comment information moves from right to left on the video playback interface at a second reference speed.
  • the second reference speed is set according to experience, or flexibly adjusted according to application scenarios, which is not limited in this embodiment of the present application.
  • the operation of selecting the target comment information is an operation of placing the mouse in the display area of the target comment information.
  • the selection operation of the target comment information is an operation of touching the display area of the target comment information with a finger.
  • the embodiment of the present application does not limit the first display mode.
  • the first display mode is to adjust the display background color to the second color. Display method.
  • the first color is white and the second color is gray.
  • the target comment information displayed with a gray background color is shown as 601 in FIG. 6 .
  • the first display mode may display the interactive control in the surrounding area of the comment information.
  • Interactive controls include but are not limited to approval controls, negative controls, etc.
  • the surrounding area may refer to a lower area, a right area, or the like.
  • the first display manner may also be adjusting the background color and displaying interactive controls.
  • the target comment information in response to the unselecting operation of the target comment information, continues to be moved until the target comment information moves out of the video playback interface.
  • the method further includes: playing the target video clip on the video playback interface in response to a trigger operation of the video clip playback control. Since the video clip playback control is used to trigger the playback of the target video clip, the target video clip is played on the video playback interface after the trigger operation of the video clip playback control is acquired.
  • the process of playing the target video segment is the process of displaying the video frame of the target video segment in the area where the target video segment is played.
  • the interactive object can be selectively played on the target video clip, such as choosing to play or not playing, which reduces the impact of the target video clip directly played when the interactive object watches the first video in some cases. to interfere.
  • the embodiment of the present application does not limit the area where the target video segment is played on the video playback interface.
  • the target video segment is played in the upper right corner area on the video playback interface; or, the vicinity of the target comment information is displayed on the video playback interface region to play the target video segment.
  • the target video segment is played in the vicinity 602 of the target comment information 601 .
  • the playing area 602 of the target video clip in addition to displaying the video screen of the target video clip, there are also a close control 6021 , a full-screen play control 6022 and a progress bar 6023 .
  • the close control 6021 is used to cancel playing the target video clip
  • the full-screen play control 6022 is used to play the target video clip in full screen on the video playback interface
  • the progress bar 6023 is used to present the progress of the target video clip being played.
  • the region where the target video clip is played supports at least one function of size adjustment and position transformation.
  • the size adjustment of the area where the target video segment is played is realized by pulling one of the four corners of the area where the target video is played.
  • the size adjustment includes zooming in and out.
  • the position change of the playing target video segment area is achieved by dragging the playing target video segment area.
  • the first video may be played simultaneously, or the first video may be paused, which is not limited in this embodiment of the present application.
  • the audio of the first video and the audio of the target video clip can be mixed; Play the audio of the target video clip, not the audio of the first video.
  • the first video is paused while playing the target video segment on the video playing interface as an example.
  • the video playback interface when playing the target video segment is shown in FIG. 6
  • the first video is paused.
  • the target video segment for the situation where the target video segment is played on the video playback interface and the first video is paused, it also includes: in response to the resuming operation of the first video, canceling the playback of the target video segment, and resuming the playback of the first video . If the resuming playback operation of the first video is obtained, it means that the target interactive object does not need to watch the target video clip any more, but needs to continue watching the first video, thereby improving the fluency of playing the first video. At this time, cancel playing the target video segment, and resume playing the first video. For example, the video playback interface after the playback of the target video segment is canceled and the playback of the first video is resumed is shown in FIG. 7 .
  • the manner of obtaining the resuming playback operation of the first video is: in response to the trigger operation of the target area in the video playback interface, obtain the resumption playback operation of the first video, and the target area is the video playback interface except Any region other than the region where the target video clip is played. That is to say, if a trigger operation in any area other than the area where the target video segment is played in the video playback interface is detected, the operation of resuming playback of the first video is acquired.
  • the manner of acquiring the resuming playback operation of the first video is: in response to a trigger operation of the close control in the area where the target video clip is played, acquiring the resuming playback operation of the first video.
  • the video segment matching result may not include the target video segment matching the comment content.
  • a prompt message is displayed on the video playback interface, and the prompt message is used to prompt that the comment content is not successfully matched to the video segment.
  • the prompt information may be included in the video segment matching result, and the prompt information is acquired while the video segment matching result is acquired.
  • the prompt information is generated locally on the terminal.
  • the video segment matching result after determining that the video segment matching result does not include the target video segment matching the comment content, in response to the video segment matching result not including the target video segment matching the comment content, directly perform displaying on the video playback interface The operation of the prompt information.
  • a comment information publishing control is displayed on the video playback interface, in response to the trigger operation of the comment information publishing control, and in response to the video segment matching result not including the target video segment matching the comment content, then Execute the operation of displaying prompt information on the video playback interface.
  • video segment matching control and comment information publishing control as a control method to trigger acquisition of video segment matching results and display target comment information can effectively improve the use efficiency of system resources and improve the efficiency of human-computer interaction.
  • comment information including only comment content may also be displayed on the video playback interface.
  • the video playback interface after displaying the prompt information is as shown in FIG. 8 , and in FIG. 8 , a prompt message 801 of "failure to match the video segment" is displayed.
  • the display color of the comment content edited in the content editing box and the video segment matching control is adjusted to a lighter color, as shown in 802 and 803 in FIG. 8 .
  • the display duration of the prompt information is set according to experience, or flexibly adjusted according to the application scenario, for example, the display duration of the prompt information is 2 seconds.
  • the video clip matching control in response to the trigger operation of the video clip matching control, when the state of the video clip matching control is changed from the disabled state to the enabled state, when the state of the video clip matching control is changed from the disabled state After being in the enabled state, it also includes: restoring the state of the video segment matching control from the enabled state to the disabled state. Restoring the state of the video clip matching control to the inactive state can lay a foundation for the next time the interactive object publishes comment information including the video clip playback control. For example, the video segment matching control restored to the disabled state is shown as 502 in FIG. 5 .
  • the embodiment of the present application does not limit the timing of restoring the state of the video segment matching control from the enabled state to the disabled state, which can be flexibly set according to actual application scenarios.
  • the state of the video clip matching control is restored from the enabled state to the disabled state. That is to say, in response to the trigger operation of the comment posting control, the state of the video clip matching control is restored from the enabled state to the disabled state.
  • the operation of restoring the state of the video segment matching control from the enabled state to the disabled state is triggered according to the trigger operation of the comment posting control.
  • the state of the video segment matching control is restored from the enabled state to the disabled state. That is to say, in response to the video segment matching result not including the target video segment matching the comment content, the state of the video segment matching control is restored from the enabled state to the disabled state.
  • the video segment matching control when it is determined that the video segment matching result includes a target video segment matching the comment content, the video segment matching control may be kept in an enabled state first, and then when the trigger operation of the comment information publishing control is acquired, Then restore the state of the video clip matching control from the enabled state to the disabled state.
  • the state of the video segment matching control in response to the trigger operation of the video segment matching control, is changed from the disabled state to the enabled state, regardless of whether the trigger operation of the comment information publishing control is obtained And regardless of whether the video segment matching result includes the target video segment matching the comment content, the video segment matching control is kept in the enabled state until the trigger operation of the video segment matching control is obtained again, and then the state of the video segment matching control is changed from the enabled state Revert to disabled state.
  • the comment content in the video playback interface is cleared, so that the interactive object can provide the comment content to be published next time.
  • the embodiment of the present application uses the terminal that publishes the target comment information as an example for illustration.
  • the server After the terminal that publishes the target comment information successfully publishes the target comment information, the server will send the target comment information to other users watching the first video. terminal, so that other terminals display the target comment information on the video playback interface when the target comment information is published.
  • the other terminal displays the target comment information and the operation process after displaying the target comment information is the same as that of the terminal that publishes the target comment information, which will not be repeated in this embodiment of the present application.
  • the process of displaying comment information is shown in FIG. 9 .
  • the target interactive object edits the comment content in the content editing box, and the terminal recognizes the text information corresponding to the comment content in real time.
  • the target interactive object triggers the video segment matching control, and the terminal sends the text information to the server.
  • the server performs video segment matching calculation, and clips to generate a target video segment that matches the comment content.
  • the server returns the target video segment to the terminal.
  • the target interactive object triggers the comment information publication control, the terminal generates the target comment information including the comment information and the video clip playback control, and the terminal displays the target comment information on the video playback interface.
  • the first interactive object (which may be the target interactive object or other interactive objects) watches the target video clip by triggering the video clip playback control in the target comment information.
  • the first interactive object can drag, enlarge, reduce or close the area where the target video segment is played.
  • the embodiment of the present application provides a display method of target comment information capable of providing information of video segment dimensions.
  • the target video segment that can be played based on the target comment information is based on the comment content edited on the interactive object (for example, if there are some interactive objects that like spoilers, when the video is swiped twice and the video is swiped three times, the results will be directly spoiled in the intense or tragic stage of the early plot, Or increase the recognition of comment content such as tidbits, etc.), and quickly match and edit video clips.
  • Real-time generation and display of target comment information including video clip playback controls for triggering the playback of target video clips that match the comment content.
  • the display of such comment information can be for video spoiler types or funny tidbits and special paid content.
  • the expansion of the content form of comment information will diversify, so that interactive objects who like to watch spoilers, tidbits or even more behind-the-scenes stories can receive more dimensional interpretations in time during the process of watching videos, which will increase this type of interaction
  • the viewing experience of the object increases the space for discussion of the content.
  • it can also bring more business-payable opportunities, such as paid content such as member-exclusive or even advanced on-demand.
  • paid content such as member-exclusive or even advanced on-demand.
  • This ability is more suitable for interactive object groups who like to watch suspense dramas or detective dramas, and at the same time like to be decrypted. It strongly improves the viewing experience of such interactive objects, and can watch decryption in real time without pressure.
  • displaying target comment information including comment content and video clip playback controls can reduce video jumps, and more video clips can be viewed on the current interface, and the video clips are strongly related to the currently playing video. Increase business revenue by increasing the amount of time an interactive object spends on an application or web page.
  • the technical solution provided by the embodiment of the present application can display comment information including a video clip playback control on the video playback interface, and the video clip playback control can trigger the playback of a target video clip matching the comment content. That is to say, the comment information displayed in the embodiment of the present application can provide information on the dimension of the video segment, which expands the dimension of the information provided by the comment information, and the interactive object can watch the target video segment by triggering the video segment playback control in the comment information. It is conducive to improving the interactive experience of the interactive object, thereby improving the human-computer interaction rate.
  • an embodiment of the present application provides a display device for review information, which includes:
  • the first display module 1001 is configured to display a video playback interface
  • the first obtaining module 1002 is used to obtain the video clip matching result of the comment content in the video playback interface
  • the second display module 1003 is used to respond to the video clip matching result including the target video clip matching the comment content, and display the target comment information including the video clip playback control on the video playback interface, and the video clip playback control is used to trigger the target video clip play.
  • the first video is played on the video playback interface, and the first acquisition module 1002 is used to identify the text information corresponding to the comment content; compare the text information with the tag information of the candidate video segment, and based on the comparison A video segment matching result of the comment content is obtained for the result, and the candidate video segment is a video segment associated with the first video.
  • the first video is played on the video playback interface, and the first acquisition module 1002 is used to identify the text information corresponding to the comment content; the text information is sent to the server, and the server is used to combine the text information with the candidate video Compare the tag information of the segments, obtain the video segment matching results of the comment content based on the comparison results, and return the video segment matching results, the candidate video segments are video segments associated with the first video; receive the video segment matching results returned by the server.
  • the first obtaining module 1002 is further configured to, in response to the comparison result indicating that the text information matches the label information of the first candidate video clip successfully, and obtain the comments that match the comment content based on the first candidate video clip.
  • the target video segment including the result of the target video segment as a video segment matching result.
  • the second display module 1003 is further configured to display prompt information on the video playback interface in response to the video segment matching result not including the target video segment matching the comment content, and the prompt information is used to prompt the comment content No video clips were successfully matched.
  • a comment information publishing control is displayed on the video playing interface, and the second display module 1003 is further configured to display prompt information on the video playing interface in response to a trigger operation of the comment information publishing control.
  • the device further includes:
  • the playing module 1004 is configured to play the target video clip on the video playback interface in response to the trigger operation of the video clip playback control.
  • the first video is played on the video playing interface
  • the playing module 1004 is configured to play the target video segment on the video playing interface and pause playing the first video.
  • the playing module 1004 is further configured to cancel playing the target video segment and resume playing the first video in response to the resuming playback operation of the first video.
  • the device further includes:
  • the second acquisition module 1005 is configured to acquire the resume playback operation of the first video in response to the trigger operation of the target area in the video playback interface, where the target area is any area in the video playback interface except the area where the target video segment is played.
  • the region where the target video clip is played supports at least one function of size adjustment and position transformation.
  • a content editing box is displayed on the video playback interface, and the comment content is the content displayed in the content editing box.
  • the video playback interface displays a video segment matching control and a comment information publishing control
  • the first acquisition module 1002 is configured to acquire the comment content in the video playback interface in response to the trigger operation of the video segment matching control Video clip matching results
  • the second display module 1003 is configured to display the target comment information including the video clip playback control on the video playback interface in response to the trigger operation of the comment information publishing control.
  • the device further includes:
  • the state changing module 1006 is configured to change the state of the video clip matching control from the disabled state to the enabled state in response to the trigger operation of the video clip matching control.
  • the state change module 1006 is further configured to restore the state of the video clip matching control from an enabled state to a disabled state in response to the trigger operation of the comment information publishing control.
  • the state change module 1006 is further configured to restore the state of the video segment matching control from the enabled state to the disabled state in response to the video segment matching result not including the target video segment matching the comment content.
  • the second display module 1003 is configured to control the target comment information including the video clip playback control to move from the reference position of the video playback interface into the video playback interface, so that the target comment information including the video clip playback control is displayed On the video playback interface.
  • the technical solution provided by the embodiment of the present application can display comment information including a video clip playback control on the video playback interface, and the video clip playback control can trigger the playback of a target video clip matching the comment content. That is to say, the comment information displayed in the embodiment of the present application can provide information on the dimension of the video segment, which expands the dimension of the information provided by the comment information, and the interactive object can watch the target video segment by triggering the video segment playback control in the comment information. It is conducive to improving the interactive experience of the interactive object, thereby improving the human-computer interaction rate.
  • the device provided by the above-mentioned embodiments implements its functions, it only uses the division of the above-mentioned functional modules as an example. In practical applications, the above-mentioned function allocation can be completed by different functional modules according to needs. The internal structure of the system is divided into different functional modules to complete all or part of the functions described above.
  • the device and the method embodiment provided by the above embodiment belong to the same idea, and the specific implementation process thereof is detailed in the method embodiment, and will not be repeated here.
  • FIG. 12 is a schematic structural diagram of a terminal provided by an embodiment of the present application.
  • the terminal may be: a smart phone, a tablet computer, an MP3 (Moving Picture Experts Group Audio Layer III, moving picture experts compression standard audio layer 3) player, an MP4 (Moving Picture Experts Group Audio Layer IV, moving picture experts Compress standard audio level 4) player, notebook computer, desktop computer or vehicle terminal.
  • a terminal may also be called user equipment, portable terminal, laptop terminal, desktop terminal, etc. by other names.
  • a terminal includes: a processor 1201 and a memory 1202 .
  • the processor 1201 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like.
  • Processor 1201 can adopt at least one hardware form in DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, programmable logic array) accomplish.
  • Processor 1201 may also include a main processor and a coprocessor, the main processor is a processor for processing data in a wake-up state, and is also called a CPU (Central Processing Unit, central processing unit); the coprocessor is Low-power processor for processing data in standby state.
  • CPU Central Processing Unit
  • the processor 1201 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen.
  • the processor 1201 may also include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.
  • AI Artificial Intelligence, artificial intelligence
  • Memory 1202 may include one or more computer-readable storage media, which may be non-transitory.
  • the memory 1202 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices.
  • the non-transitory computer-readable storage medium in the memory 1202 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 1201, so that the terminal implements the method embodiment in this application Display method for provided comment information.
  • the terminal may optionally further include: a peripheral device interface 1203 and at least one peripheral device.
  • the processor 1201, the memory 1202, and the peripheral device interface 1203 may be connected through buses or signal lines.
  • Each peripheral device can be connected to the peripheral device interface 1203 through a bus, a signal line or a circuit board.
  • the peripheral device includes: at least one of a radio frequency circuit 1204 , a display screen 1205 , a camera component 1206 , an audio circuit 1207 , a positioning component 1208 and a power supply 1209 .
  • the peripheral device interface 1203 may be used to connect at least one peripheral device related to I/O (Input/Output, input/output) to the processor 1201 and the memory 1202 .
  • I/O Input/Output, input/output
  • the radio frequency circuit 1204 is used to receive and transmit RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals.
  • the radio frequency circuit 1204 communicates with the communication network and other communication devices through electromagnetic signals.
  • the display screen 1205 is used to display a UI (User Interface, user interface).
  • the UI can include graphics, text, icons, video, and any combination thereof.
  • the camera assembly 1206 is used to capture images or videos.
  • the camera component 1206 includes a front camera and a rear camera.
  • Audio circuitry 1207 may include a microphone and speakers.
  • the positioning component 1208 is used to locate the current geographic location of the terminal to implement navigation or LBS (Location Based Service, location-based service).
  • LBS Location Based Service, location-based service
  • the power supply 1209 is used to supply power to various components in the terminal.
  • the terminal further includes one or more sensors 1210 .
  • the one or more sensors 1210 include, but are not limited to: an acceleration sensor 1211 , a gyroscope sensor 1212 , a pressure sensor 1213 , a fingerprint sensor 1214 , an optical sensor 1215 and a proximity sensor 1216 .
  • FIG. 12 does not limit the terminal, and may include more or less components than shown in the figure, or combine certain components, or adopt different component arrangements.
  • a computer device comprising a processor and a memory in which at least one computer program is stored.
  • the at least one computer program is loaded and executed by one or more processors, so that the computer device can realize any one of the methods for displaying comment information mentioned above.
  • a computer-readable storage medium at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor of a computer device, so that the computer Realize the display method of any one of the comment information above.
  • the above-mentioned computer-readable storage medium may be a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a compact disc (Compact Disc Read-Only Memory) , CD-ROM), tapes, floppy disks and optical data storage devices, etc.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • CD-ROM Compact Disc Read-Only Memory
  • tapes floppy disks and optical data storage devices, etc.
  • a computer program product includes a computer program or a computer instruction, the computer program or computer instruction is loaded and executed by a processor, so that the computer implements any one of the above comment information display method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种评论信息的显示方法、装置、计算机设备及存储介质,属于多媒体技术领域。该方法包括:显示视频播放界面;获取视频播放界面中的评论内容的视频片段匹配结果;响应于视频片段匹配结果包括与评论内容匹配的目标视频片段,在视频播放界面上显示包括视频片段播放控件的目标评论信息,视频片段播放控件用于触发目标视频片段的播放。此种方式,显示的评论信息能够提供视频片段维度的信息,扩展了评论信息所提供的信息的维度,增加了评论方式的多样性,有利于提高交互对象的交互体验感,进而提高人机交互率。

Description

评论信息的显示方法、装置、设备、存储介质及程序产品
本申请要求于2021年08月31日提交中国专利局、申请号为202111016208.9、申请名称为“评论信息的显示方法、装置、计算机设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及多媒体技术领域,特别涉及评论信息的显示。
背景技术
随着多媒体技术的发展,越来越多的应用程序和网页支持播放视频,并且能够在视频播放界面中显示交互对象发表的评论信息,以给交互对象带来一种实时互动的体验。
相关技术中,视频播放界面中显示的评论信息为一种包括文本或图片中的至少一种内容的信息,评论信息所提供的信息的维度较局限,交互对象的交互体验感较差,导致人机交互率较低。
发明内容
有鉴于此,本申请实施例提供了一种评论信息的显示方法、装置、设备、存储介质及程序产品,可用于扩展评论信息所提供的信息的维度,提高人机交互率。所述技术方案如下:
一方面,本申请实施例提供了一种评论信息的显示方法,所述方法包括:
显示视频播放界面;
获取所述视频播放界面中的评论内容的视频片段匹配结果;
响应于所述视频片段匹配结果包括与所述评论内容匹配的目标视频片段,在所述视频播放界面上显示包括视频片段播放控件的目标评论信息,所述视频片段播放控件用于触发所述目标视频片段的播放。
在一种可能实现方式中,在所述视频播放界面上显示包括视频片段播放控件的目标评论信息,包括:
控制所述包括视频片段播放控件的目标评论信息从所述视频播放界面的参考方位移动进入所述视频播放界面,使所述包括视频片段播放控件的目标评论信息显示在所述视频播放界面上。
另一方面,提供了一种评论信息的显示装置,所述装置包括:
第一显示模块,用于显示视频播放界面;
第一获取模块,用于获取所述视频播放界面中的评论内容的视频片段匹配结果;
第二显示模块,用于响应于所述视频片段匹配结果包括与所述评论内容匹配的目标视频片段,在所述视频播放界面上显示包括视频片段播放控件的目标评论信息,所述视频片段播放控件用于触发所述目标视频片段的播放。
另一方面,提供了一种计算机设备,所述计算机设备包括处理器和存储器,所述存储器中存储有至少一条计算机程序,所述至少一条计算机程序由所述处理器加载并执行,以使所述计算机设备实现上述方面所述的评论信息的显示方法。
另一方面,还提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有至 少一条计算机程序,所述至少一条计算机程序由处理器加载并执行,以使计算机实现上述方面所述的评论信息的显示方法。
另一方面,还提供了一种计算机程序产品,所述计算机程序产品包括计算机程序或计算机指令,所述计算机程序或所述计算机指令存储由处理器加载并执行,以使计算机执行上述方面所述的评论信息的显示方法。
本申请实施例提供的技术方案至少带来如下有益效果:
本申请实施例提供的技术方案能够在视频播放界面上显示一种包括视频片段播放控件的评论信息,该视频片段播放控件能够触发与评论内容匹配的目标视频片段的播放。也就是说,本申请实施例显示的评论信息能够提供视频片段维度的信息,扩展了评论信息所提供的信息的维度,交互对象能够通过触发评论信息中的视频片段播放控件实现观看目标视频片段,增加了评论方式的多样性,有利于提高交互对象的交互体验感,进而提高人机交互率。
附图说明
图1是本申请实施例提供的一种评论信息的显示方法的实施环境的示意图;
图2是本申请实施例提供的一种评论信息的显示方法的流程图;
图3是本申请实施例提供的一种视频播放界面的示意图;
图4是本申请实施例提供的一种视频播放界面的示意图;
图5是本申请实施例提供的一种视频播放界面的示意图;
图6是本申请实施例提供的一种视频播放界面的示意图;
图7是本申请实施例提供的一种视频播放界面的示意图;
图8是本申请实施例提供的一种视频播放界面的示意图;
图9是本申请实施例提供的一种评论信息的显示过程的示意图;
图10是本申请实施例提供的一种评论信息的显示装置的示意图;
图11是本申请实施例提供的一种评论信息的显示装置的示意图;
图12是本申请实施例提供的一种终端的结构示意图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。
需要说明的是,本申请中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。
图1是本申请实施例提供的一种评论信息的显示方法的实施环境的示意图,该实施环境包括终端11和服务器12。
其中,终端11安装和运行有支持视频播放以及显示评论信息的应用程序或网页,当该应用程序或网页需要在视频播放界面上显示评论信息时,可应用本申请实施例提供的方法 进行显示。示例性地,该应用程序或网页是视频类应用程序或网页、直播类应用程序或网页、浏览器类应用程序或网页等。示例性地,该终端11是任一交互对象所使用的设备,登录有该任一交互对象的账号。
服务器12是终端安装的支持视频播放以及显示评论信息的应用程序或网页的后台服务器,用于为该应用程序或网页提供后台服务。
可选地,终端11可以是任何一种可与用户通过键盘、触摸板、触摸屏、遥控器、语音交互或手写设备等一种或多种方式进行人机交互的电子产品,例如PC(Personal Computer,个人计算机)、手机、智能手机、PDA(Personal Digital Assistant,个人数字助手)、可穿戴设备、PPC(Pocket PC,掌上电脑)、平板电脑、智能车机、智能电视、智能音箱或车载终端等。服务器12可以是一台服务器,也可以是由多台服务器组成的服务器集群,或者是一个云计算服务中心。终端11与服务器12通过有线或无线网络建立通信连接。
本领域技术人员应能理解上述终端11和服务器12仅为举例,其他现有的或今后可能出现的终端或服务器如可适用于本申请,也应包含在本申请保护范围以内,并在此以引用方式包含于此。
基于上述图1所示的实施环境,本申请实施例提供一种评论信息的显示方法,以该方法应由终端11执行为例。如图2所示,本申请实施例提供的评论信息的显示方法包括如下步骤201至步骤203。
在步骤201中,显示视频播放界面。
视频播放界面为播放交互对象当前观看视频的界面,本申请实施例将交互对象当前观看的视频称为第一视频。也就是说,视频播放界面上播放有第一视频。本申请实施例对第一视频在视频播放界面的播放方式不加以限定,示例性地,第一视频采用全屏播放方式(例如横屏播放),或者用窗口播放方式(例如竖屏播放)等,这与提供视频播放界面的应用程序或网页的播放设置有关。
在一些实施例中,视频播放界面为支持视频播放和显示评论信息的应用程序中的界面,或者,视频播放界面为支持视频播放和显示评论信息的网页中的界面,本申请实施例对此不加以限定。示例性地,第一视频可以是已录制完成的视频,也可以是直播视频,本申请实施例对此不加以限定。
在一种可能实现方式中,终端显示视频播放界面的方式为:终端响应于第一视频的播放指令,获取该第一视频,终端显示视频播放界面,在视频播放界面播放该第一视频。示例性地,终端还可以获取第一视频对应的历史评论信息,历史评论信息是至少一个交互对象在观看该第一视频时所发表的评论,本申请不限定历史评论信息的形式,可以是展示在视频评论区的评论,也可以展示在播放第一视频区域中滚动评论例如弹幕评论。
以弹幕评论为例,可以基于该第一视频的播放进度,在视频播放界面展示与当前播放进度相对应的历史评论信息。当然,在一些实施例中,终端在播放该第一视频时,也可以不显示该第一视频所对应的历史评论信息。
在示例性实施例中,第一视频为服务器上存储的视频,终端通过与服务器交互获取第一视频和第一视频对应的历史评论信息。在示例性实施例中,第一视频为终端本地存储的 视频,终端从本地提取第一视频,通过与服务器交互获取第一视频对应的历史评论信息。
在一种可能实现方式中,在视频播放界面上,显示有内容编辑框、视频片段匹配控件和评论信息发表控件中的至少一个。内容编辑框用于显示评论内容。在示例性实施例中,内容编辑框提供有语音输入接口,交互对象能够通过触发内容编辑框提供的语音输入接口输入评论语音,然后终端在内容编辑框中显示对评论语音进行语音识别后得到的评论内容。在示例性实施例中,交互对象能够直接在内容编辑框中编辑文本、图片等形式的评论内容。视频片段匹配控件用于触发获取视频片段匹配结果,评论信息发表控件用于触发评论信息的发表。
内容编辑框、视频片段匹配控件和评论信息发表控件的显示位置以及形式可以根据经验设置,也可以根据应用场景灵活调整,本申请实施例对此不加以限定。示例性地,内容编辑框、视频片段匹配控件和评论信息发表控件均显示在视频播放界面的右下角区域中,内容编辑框的形式为一种可编辑输入框,视频片段匹配控件的形式为可触发图标或者可触发按钮等,评论信息发表控件的形式为可触发图标或者可触发按钮等。
示例性地,视频片段匹配控件上可以显示第一信息,以利用第一信息提示交互对象该控件用于触发获取视频片段匹配结果。评论信息发表控件上可以显示第二信息,以利用第二信息提示该控件用于触发评论信息的发表。第一信息和第二信息根据经验设置,或者根据应用场景灵活调整,本申请实施例对此不加以限定。
示例性地,视频播放界面如图3所示。图3所示的视频播放界面中显示有内容编辑框301、视频片段匹配控件302和评论信息发表控件303。其中,视频片段匹配控件302上显示的第一信息为“AI”,评论信息发表控件303上显示的第二信息为“发表”。示例性地,图3所示的视频播放界面中还显示有第一视频的视频画面以及第一视频对应的多个历史评论信息(评论信息A、评论信息B、评论信息C、评论信息D和评论信息E)。
该多个历史评论信息悬浮显示在第一视频的视频画面上。示例性地,以历史评论信息为弹幕信息为例,该多个历史评论信息是指与第一视频的当前视频画面对应的时间点匹配的评论信息,该多个历史评论信息可以是由当前观看第一视频的交互对象发表的评论信息,也可以是由其他交互对象在观看第一视频的过程中发表的评论信息,本申请实施例对此不加以限定。该多个历史评论信息可以随着交互对象观看第一视频,在视频播放界面上进行移动。示例性地,该多个历史评论信息上可以显示发表历史评论信息的交互对象的头像,交互对象可以通过历史评论信息上的头像得知发表评论信息的交互对象。交互对象可以通过触发历史评论信息来与历史评论信息的发布者进行互动。
示例性地,在图3所示的视频播放界面中,还显示有第一视频的播放进度条、第一视频的播放控制控件、播放时长信息、播放清晰度、播放倍率、历史播放统计信息、分享控件、评论信息开关控件等。其中,第一视频的播放控制控件包括但不限于暂停/播放控件、下一集控件、循环播放控件、音量控制控件、设置控件、播放画面比例选择控件、全屏播放控件等。评论信息开关控件用于由交互对象选择开启或关闭评论信息显示功能,如图3所示,评论信息开关控件上显示有文字“弹”。
示例性地,评论信息还可以称为弹幕,弹幕是一种评论性字幕,能够叠加显示在视频 画面上,交互对象在观看视频时,可以通过发表弹幕来表达自己的观看感受,也可以看到其他交互对象在当前视频播放时刻所发表的弹幕,交互对象之间可以通过弹幕进行交流、互动。
在步骤202中,获取视频播放界面中评论内容的视频片段匹配结果。
视频播放界面中的评论内容是由当前观看第一视频的交互对象(称为目标交互对象)提供的评论内容。示例性地,视频播放界面中的评论内容是指对目标交互对象语音输入的评论语音进行语音识别得到的评论内容。示例性地,视频播放界面中的评论内容是指视频播放界面上的内容编辑框中显示的内容。在示例性实施例中,内容编辑框中显示的内容可以是指目标交互对象在内容编辑框中直接编辑的文本、图片等形式的内容,也可以是指终端对目标评论语音进行语音识别得到的内容,其中,目标评论语音是指目标交互对象通过触发内容编辑框提供的语音输入接口输入的评论语音。
目标交互对象在观看第一视频的过程中,如果在某个时间点想要对第一视频的视频内容进行评论,可以语音输入评论语音或者在内容编辑框中编辑评论内容。示例性地,目标交互对象能够在内容编辑框中编辑的内容包括但不限于文本、图片等。文本是指目标交互对象输入或上传的文字,图片可以是指目标交互对象从播放第一视频的应用程序或网页提供的备选图片(如,表情图片、卡通图片)中选取的图片,也可以是指目标交互对象从终端本地选取并上传的图片等。例如,如图3所示,目标交互对象在剧情紧张阶段,男女主产生情感纠葛的关键部分,直接剧透结果实锤的片段,从而目标交互对象在内容编辑框中编辑的评论内容为文本“16集5分10秒,实锤”。
在获取视频播放界面中的评论内容后,进一步获取视频播放界面中的评论内容的视频片段匹配结果。在一种可能实现方式中,在获取视频播放界面中的评论内容后,直接执行获取视频播放界面中的评论内容的视频片段匹配结果的操作。在另一种可能实现方式中,视频播放界面上显示有视频片段匹配控件,在获取视频播放界面中的评论内容后,响应于视频片段匹配控件的触发操作,再执行获取视频播放界面中的评论内容的视频片段匹配结果的操作。
视频片段匹配控件用于触发获取视频片段匹配结果。对视频片段匹配控件的触发操作是指在视频片段匹配控件上触发的人机交互操作。本申请实施例对视频片段匹配控件的触发操作的类型不加以限定,示例性地,对视频片段匹配控件的触发操作包括但不限于单击操作、双击操作、悬浮触控操作、压力触控操作、滑动操作中的至少一种。
在一种可能实现方式中,在获取到视频片段匹配控件的触发操作后,还可以将视频片段匹配控件的状态由未启用状态转变为启用状态,以利用启用状态告知目标交互对象已成功触发视频片段匹配控件。也就是说,响应于视频片段匹配控件的触发操作,将视频片段匹配控件的状态由未启用状态转变为启用状态。未启用状态和启用状态为两种不同的控件显示状态,本申请实施例对未启用状态和启用状态不加以限定。示例性地,未启用状态的视频片段匹配控件如图3中的302所示,启用状态的视频片段匹配控件如图4中的401所示。
评论内容的视频片段匹配结果用于指示评论内容是否成功匹配到视频片段,本申请实施例将评论内容成功匹配到的视频片段称为目标视频片段,目标视频片段是指与评论内容 匹配的视频片段,能够以视频的形式呈现评论内容的含义。目标视频片段的时长根据经验设置,或者根据应用场景灵活调整,本申请实施例对此不加以限定,示例性地,目标视频片段的时长为60秒。
在示例性实施例中,评论内容的视频片段匹配结果有两种可能,一种为包括目标视频片段,另一种为不包括目标视频片段。若评论内容的视频片段匹配结果包括目标视频片段,则说明评论内容成功匹配到了视频片段。若评论内容的视频片段匹配结果不包括目标视频片段,则说明评论内容未成功匹配到视频片段。
在示例性实施例中,不包括目标视频片段的视频片段匹配结果中包括提示信息,该提示信息用于提示评论内容未成功匹配到视频片段。本申请实施例对提示信息的形式不加以限定,示例性地,提示信息可以仅包括指示匹配失败这一匹配结果的信息,也可以既包括指示匹配失败这一匹配结果的信息又包括指示导致匹配失败这一匹配结果的原因的信息。示例性地,导致匹配失败这一匹配结果的原因包括但不限于评论内容描述有误、评论内容指示的视频片段因删减而不存在、网络故障等。
在一种可能实现方式中,终端获取视频播放界面中评论内容的视频片段匹配结果的方式可能是指终端本地获取视频播放界面中评论内容的视频片段匹配结果;也可能是指终端通过与服务器交互,获取视频播放界面中评论内容的视频片段匹配结果,本申请实施例对此不加以限定。
在一种可能实现方式中,终端本地获取视频片段匹配结果的过程包括以下步骤A和步骤B:
步骤A:识别评论内容对应的文本信息。
终端在获取视频播放界面中的评论内容后,识别评论内容对应的文本信息,评论内容对应的文本信息能够一定程度上表示评论内容的含义。
示例性地,对于评论内容仅包括文本内容的情况,识别评论内容对应的文本信息的过程为语义识别过程。语义识别是一种自然语言处理技术,让计算机对文本内容进行理解分析,自动化处理文本内容。通过语义识别,能够理解文本内容的含义。示例性地,对于评论内容仅包括图片的情况,识别评论内容对应的文本信息的过程为图片识别过程。图片识别能够识别出图片的相关信息,如,若图片为一张演员的人脸图像,则通过图片识别能够识别出图片中的人脸为哪位演员的人脸。示例性地,对于评论内容包括文本内容和图片的情况,识别评论内容对应的文本信息的过程为语义识别和图片识别的综合过程。本申请实施例对语义识别和图片识别的方式不加以限定,示例性地,可以利用神经网络模型实现语义识别和图片识别。
步骤B:将文本信息与候选视频片段的标签信息进行比对,基于比对结果获取评论内容的视频片段匹配结果。其中,候选视频片段为与第一视频关联的视频片段。
在识别得到评论内容对应的文本信息之后,将文本信息与候选视频片段的标签信息进行比对,进而基于比对结果获取评论内容的视频片段匹配结果。候选视频片段是与第一视频关联的视频片段。示例性地,候选视频片段是从第一视频、第一视频对应的扩展视频中的至少一种视频中截取的片段。第一视频对应的扩展视频是与第一视频关联的用于对第一 视频的视频内容进行扩展的视频,示例性地,第一视频对应的扩展视频包括但不限于第一视频对应的花絮视频、第一视频对应的付费型视频等。
本申请实施例对截取候选视频片段的方式不加以限定,示例性地,截取一帧视频作为一个候选视频片段,或者,截取参考时长的视频片段作为一个候选视频片段,参考时长根据经验设置,或者根据应用场景灵活调整,例如,参考时长为10秒。示例性地,可以根据经验设置,确定从第一视频以及第一视频对应的扩展视频中截取哪些视频片段作为候选视频片段,或者根据实际的视频内容灵活调整截取方式,本申请实施例对此不加以限定。
候选视频片段的标签信息用于对候选视频片段的内容进行描述,候选视频片段的标签信息由一个或多个标签构成,不同的标签用于对候选视频片段不同方面的内容进行描述。示例性地,候选视频片段的标签信息用于对候选视频片段的剧情细节属性、集数、标题、时间点、人、事、物、场景、事件、发展阶段中的一方面或多方面的内容进行描述。示例性地,候选视频片段的数量为多个,每个候选视频片段均具有各自的标签信息,不同的候选视频片段的标签信息可能相同,也可能不同,本申请实施例对此不加以限定。
示例性地,终端在将文本信息与候选视频片段的标签信息进行比对之前,需要先获取候选视频片段的标签信息。示例性地,候选视频片段存储在终端本地,则终端在本地获取候选视频片段的标签信息。
示例性地,服务器预先将与第一视频关联的候选视频片段解读转码提取标签信息并存储,如,存储在云存储空间中。也就是说,候选视频片段存储在服务器中,则终端通过与服务器交互获取候选视频片段的标签信息。示例性地,终端向服务器发送携带第一视频的视频标识的请求,该请求用于获取第一视频对应的候选视频片段的标签信息。服务器在接收到终端发送的请求后,根据第一视频的视频标识提取候选视频片段的标签信息,然后将候选视频的标签信息返回终端。
在获取文本信息和候选视频片段的标签信息之后,将文本信息与候选视频片段的标签信息进行比对。在一种可能实现方式中,将文本信息与候选视频片段的标签信息进行比对的方式为:获取文本信息与候选视频片段的标签信息的相似度,根据相似度判断文本信息是否与候选视频片段的标签信息匹配成功。本申请实施例对获取文本信息与候选视频片段的标签信息的相似度的方式不加以限定。示例性地,将文本信息命中某一候选视频片段的标签信息中的标签的数量与该候选视频片段的标签信息中的标签的总数量的比值作为文本信息与该候选视频片段的标签信息的相似度。
示例性地,调用特征提取模型对文本信息和候选视频片段的标签信息分别进行特征提取,得到文本信息的特征和候选视频片段的标签信息的特征;将文本信息的特征和候选视频片段的标签信息的特征之间的相似度作为文本信息与候选视频片段的标签信息的相似度。示例性地,文本信息的特征和候选视频片段的标签信息的特征均为向量,则通过计算两个向量之间的相似度得到文本信息的特征和候选视频片段的标签信息的特征之间的相似度。例如,两个向量之间的相似度是指两个向量之间的余弦相似度、杰卡德相似度等。
将文本信息与候选视频片段的标签信息进行比对之后,得到比对结果。对比结果有两种可能:比对结果指示文本信息与第一候选视频片段的标签信息匹配成功;比对结果指示 文本信息与各个候选视频片段的标签信息均为匹配失败。本申请实施例对文本信息与某一候选视频片段的标签信息是否匹配成功的判断方式不加以限定。示例性地,若文本信息与某一候选视频片段的标签信息的相似度不小于相似度阈值,则确定文本信息与该候选视频片段的标签信息匹配成功;若文本信息与某一候选视频片段的标签信息的相似度小于相似度阈值,则确定文本信息与该候选视频片段的标签信息未匹配成功。相似度阈值根据经验设置,或者根据实际的应用场景灵活调整,本申请实施例对此不加以限定。
若文本信息与一个或多个候选视频片段的标签信息匹配成功,则将该一个或多个候选视频片段称为第一候选视频片段,此时,得到用于指示文本信息与第一候选视频片段的标签信息匹配成功的比对结果。若文本信息与各个候选视频片段的标签信息均未匹配成功,则得到用于指示文本信息与各个候选视频片段的标签信息均未匹配成功的比对结果。
本申请实施例对比对结果的形式不加以限定,示例性地,用于指示文本信息与第一候选视频片段的标签信息匹配成功的比对结果为包括第一候选视频片段的标识的结果;用于指示文本信息与各个候选视频片段的标签信息均未匹配成功的比对结果为包括空信息的结果,或者为包括匹配失败这一提示信息的结果。
由于候选视频片段的标签信息可以准确的标识该候选视频片段的相关信息,而文本信息又能够标识出评论内容所涉及的主旨,从而通过匹配文本信息和标签信息,匹配得到的候选视频片段与评论内容具有更贴合的相关性,提高了匹配精度。
而且,通过在一些场景下(例如通信网络较稳定时)将匹配步骤交由处理能力更强的服务器执行时,还可以进一步提高匹配效率,并降低终端的处理负担。
在获取比对结果后,基于比对结果获取评论内容的视频片段匹配结果。在一种可能实现方式中,基于比对结果获取评论内容的视频片段匹配结果的方式为:响应于比对结果指示文本信息与第一候选视频片段的标签信息匹配成功,基于第一候选视频片段,获取与评论内容匹配的目标视频片段,将包括目标视频片段的结果作为视频片段匹配结果。
在一种可能实现方式中,基于比对结果获取评论内容的视频片段匹配结果的方式为:响应于比对结果指示文本信息与各个候选视频片段的标签信息均未匹配成功,将不包括任何视频片段的结果作为视频片段匹配结果。示例性地,不包括任何视频片段的结果中可能包括提示信息,也可能不包括提示信息,本申请实施例对此不加以限定。
通过显示提示信息,可以有效的提示交互对象所输入的评论内容未匹配到视频片段,避免让交互对象误认为基于评论内容播放目标视频片段的功能无效。
在一种可能实现方式中,第一候选视频片段的数量可能为一个或多个,本申请实施例对此不加以限定。在一种可能实现方式中,对于第一候选视频片段的数量为一个的情况,基于第一候选视频片段,获取与评论内容匹配的目标视频片段的方式为:将第一候选视频片段作为与评论内容匹配的目标视频片段。
在另一种可能实现方式中,对于第一候选视频片段的数量为一个的情况,基于第一候选视频片段,获取与评论内容匹配的目标视频片段的方式为:确定第一候选视频片段在来源的视频中所处的位置,以第一候选视频片段在来源的视频中所处的位置的中心位置为中心,剪辑前后各第一时长的视频片段,由剪辑的视频片段构成目标视频片段。第一时长为 指定时长的一半时长,指定时长为指定的目标视频片段应该具有的时长,指定时长根据经验设置,或者根据应用场景灵活调整,例如,指定时长为60秒。当然,还可以根据其他方式实现基于第一候选视频片段获取目标视频片段的过程,本申请实施例不再一一展开说明。
在一种可能实现方式中,对于第一候选视频片段的数量为多个的情况,基于第一候选视频片段,获取与评论内容匹配的目标视频片段的方式为:从多个第一候选视频片段中选取一个候选视频片段作为目标候选视频片段,基于目标候选视频片段,获取与评论内容匹配的目标视频片段。本申请实施例对从多个第一候选视频片段中选取一个候选视频片段作为目标候选视频片段的方式不加以限定,示例性地,从多个第一候选视频片段中随机选取一个候选视频片段作为目标候选视频片段。示例性地,将多个第一候选视频片段中标签信息与文本信息的相似度最高的一个候选视频片段作为目标候选视频片段。在确定出目标候选视频片段后,基于目标候选视频片段,获取与评论内容匹配的目标视频片段。基于目标候选视频片段,获取与评论内容匹配的目标视频片段的方式参见第一候选视频片段的数量为一个的情况下,基于第一候选视频片段,获取与评论内容匹配的目标视频片段的方式,此处不再赘述。
通过基于匹配得到的第一候选视频片段,可以准确的确定出用于结合评论内容播放的目标视频片段,并且可以基于第一候选视频片段的数量针对性的确定出目标视频片段,提高了目标视频片段的确定精度以及和评论内容的匹配度。
以上所述为终端本地获取评论内容的视频片段匹配结果的过程,示例性地,终端还可能通过与服务器交互获取评论内容的视频片段匹配结果。在一种可能实现方式中,终端通过与服务器交互获取评论内容的视频片段匹配结果的方式包括但不限于以下两种:
方式一:终端识别评论内容对应的文本信息;终端将文本信息发送至服务器,服务器用于将文本信息与候选视频片段的标签信息进行比对,基于比对结果获取评论内容的视频片段匹配结果,返回视频片段匹配结果;终端接收服务器返回的视频片段匹配结果。
在此种方式一下,终端需要执行的为识别评论内容对应的文本信息的操作,根据文本信息获取视频片段匹配结果的操作由服务器执行,服务器执行根据文本信息获取视频片段匹配结果的操作的方式参见终端本地获取视频片段匹配结果的情况下的相关过程,此处不再赘述。
方式二:终端将评论内容发送至服务器,服务器用于识别评论内容对应的文本信息,将文本信息与候选视频片段的标签信息进行比对,基于比对结果获取评论内容的视频片段匹配结果,返回视频片段匹配结果;终端接收服务器返回的视频片段匹配结果。
在此种方式二下,根据评论内容获取视频片段匹配结果的整个过程均由服务器执行,执行方式参见终端本地获取视频片段匹配结果的过程,此处不再赘述。
根据该步骤202介绍的内容可知,在获取视频播放界面中的评论内容后,终端获取视频播放界面中的评论内容的视频片段匹配结果。视频片段匹配结果可能包括与评论内容匹配的目标视频片段,也可能不包括与评论内容匹配的目标视频片段。
在步骤203中,响应于视频片段匹配结果包括与评论内容匹配的目标视频片段,在视频播放界面上显示包括视频片段播放控件的目标评论信息,视频片段播放控件用于触发目标 视频片段的播放。
在获取视频片段匹配结果后,判断视频片段匹配结果是否包括与评论内容匹配的目标视频片段,若视频片段匹配结果包括与评论内容匹配的目标视频片段,则在视频播放界面上显示包括视频片段播放控件的目标评论信息。也就是说,响应于视频片段匹配结果包括与评论内容匹配的目标视频片段,在视频播放界面上显示包括视频片段播放控件的目标评论信息。
在一种可能实现方式中,在确定视频片段匹配结果包括与评论内容匹配的目标视频片段后,响应于视频片段匹配结果包括与评论内容匹配的目标视频片段,直接执行在视频播放界面上显示包括视频片段播放控件的目标评论信息的操作。在另一种可能实现方式中,视频播放界面上显示有评论信息发表控件,响应于评论信息发表控件的触发操作,且响应于视频片段匹配结果包括与评论内容匹配的目标视频片段,再执行在视频播放界面上显示包括视频片段播放控件的目标评论信息的操作。
评论信息发表控件用于触发评论信息的发表,在获取评论信息发表控件的触发操作时,说明目标交互对象想要发表评论信息。对评论信息发表控件的触发操作是指在评论信息发表控件上触发的人机交互操作。本申请实施例对评论信息发表控件的触发操作的类型不加以限定,示例性地,对评论信息发表控件的触发操作包括但不限于单击操作、双击操作、悬浮触控操作、压力触控操作、滑动操作中的至少一种。
由此,通过在评论信息发表控件被触发时显示提示信息,可以让交互对象在正式发出评论内容前了解到对视频片段的匹配情况,从而可以及时做出修改,有效的提高了评论内容的质量。
视频片段播放控件用于触发目标视频片段的播放,也就是说,通过触发目标评论信息中包括的视频片段播放控件,能够实现对目标视频片段的播放。本申请实施例对视频片段播放控件的形式不加以限定,可以根据经验设置,也可以根据应用场景灵活调整。
在示例性实施例中,目标评论信息中除包括视频片段播放控件外,还包括评论内容。评论内容包括文本和图片中的至少一种内容,基于此种方式,目标评论信息为一种评论内容+视频片段播放控件形式的评论信息,能够提供文本、图片、视频片段等多维度的信息,从而使得目标交互对象以及其他观看第一视频的交互对象在一条目标评论信息中,既能够看到评论内容,又能够通过触发视频片段播放控件观看与评论内容匹配的目标视频片段,提高交互对象的交互体验感。示例性地,在视频播放界面上显示的目标评论信息如图5中的501所示,在图5中的501所示的目标评论信息中,包括评论内容5011和视频片段播放控件5012。
在示例性实施例中,目标评论信息中还可以包括评论内容的关联信息,该关联信息是与评论内容相关的信息,示例性地,关联信息包括编辑评论内容的交互对象的账号、编辑评论内容的交互对象的头像、编辑评论内容的交互对象的昵称中的至少一种。
在一种可能实现方式中,在视频播放界面上显示包括视频片段播放控件的目标评论信息的实现方式为:控制包括视频片段播放控件的目标评论信息从视频播放界面的参考方位移动进入视频播放界面,使包括视频片段播放控件的目标评论信息显示在视频播放界面上。 参考方位根据经验设置,或者根据应用场景灵活调整,本申请实施例对此不加以限定。示例性地,参考方位是指视频播放界面的右侧;或者,参考方位是指视频播放界面的左侧;再或者,参考方位是指视频播放界面的上侧等。
示例性地,控制目标评论信息从视频播放界面的参考方位移动进入视频播放界面的方式为:控制目标评论信息从视频播放界面的参考方位以第一参考速度移动进入视频播放界面。第一参考速度根据经验设置,或者根据应用场景灵活调整,本申请实施例对此不加以限定。示例性地,第一参考速度为较慢的速度,以保证目标评论信息能够较为平缓地移动进入视频播放界面。
以上所述在视频播放界面上显示目标评论信息的实现方式仅为示例性举例,本申请实施例并不局限于此。示例性地,直接在视频播放界面上显示目标评论信息;或者,通过显示特效在视频播放界面上显示目标评论信息。
在一种可能实现方式中,在视频播放界面上显示包括视频片段播放控件的目标评论信息之后,还包括:控制目标评论信息在视频播放界面上移动。本申请实施例对控制目标评论信息在视频播放界面上移动的方式不加以限定,示例性地,控制目标评论信息在视频播放界面上从右到左以第二参考速度移动。第二参考速度根据经验设置,或者根据应用场景灵活调整,本申请实施例对此不加以限定。
在控制目标评论信息在视频播放界面上移动的过程中,响应于目标评论信息的选中操作,暂停移动目标评论信息,将目标评论信息利用第一显示方式进行显示,第一显示方式与未被选中的评论信息的显示方式不同。示例性地,目标评论信息的选中操作是将鼠标置于目标评论信息的显示区域中的操作。示例性地,目标评论信息的选中操作是将利用手指触摸目标评论信息的显示区域的操作。
本申请实施例对第一显示方式不加以限定,示例性地,对于未被选中的评论信息的显示背景色为第一颜色的情况,第一显示方式为将显示背景色调整为第二颜色的显示方式。例如,第一颜色为白色,第二颜色为灰色。例如,利用灰色的背景色显示的目标评论信息如图6中的601所示。
在示例性实施例中,对于未被选中的评论信息的显示方式为默认不显示互动控件的情况,第一显示方式可以在评论信息的周围区域显示互动控件。互动控件包括但不限于赞同控件、反对控件等。周围区域可以是指下方区域、右侧区域等。在示例性实施例中,第一显示方式还可以为既调整背景颜色,又显示互动控件。
在示例性实施例中,响应于目标评论信息的取消选中操作,继续移动目标评论信息,直至目标评论信息移动出视频播放界面。
在一种可能实现方式中,在视频播放界面上显示包括视频片段播放控件的目标评论信息之后,还包括:响应于视频片段播放控件的触发操作,在视频播放界面上播放目标视频片段。由于视频片段播放控件用于触发目标视频片段的播放,所以在获取视频片段播放控件的触发操作后,在视频播放界面上播放该目标视频片段。示例性地,播放目标视频片段的过程即为在播放目标视频片段的区域中显示目标视频片段的视频画面的过程。通过视频片段播放控件,可以让交互对象对目标视频片段的播放具有选择性,例如选择播放或选择 不播放,降低了一些情况下,对交互对象观看第一视频时直接播放的目标视频片段所带来的干扰。
本申请实施例对视频播放界面上播放目标视频片段的区域不加以限定,示例性地,在视频播放界面上的右上角区域播放目标视频片段;或者,在视频播放界面上显示目标评论信息的附近区域播放目标视频片段。例如,如图6所示,在目标评论信息601的附近区域602中播放目标视频片段。
示例性地,如图6所示,在播放目标视频片段的区域602中,除显示有目标视频片段的视频画面外,还显示有关闭控件6021、全屏播放控件6022和进度条6023。关闭控件6021用于取消播放目标视频片段,全屏播放控件6022用于在视频播放界面上全屏播放目标视频片段,进度条6023用于呈现目标视频片段已播放的进度。
在一种可能实现方式中,播放目标视频片段的区域支持尺寸调整和位置变换中的至少一种功能。示例性地,通过拉动播放目标视频的区域的四个角中的某个角实现对播放目标视频片段的区域的尺寸调整,示例性地,尺寸调整包括放大和缩小。示例性地,通过拖动播放目标视频片段的区域实现对播放目标视频片段的区域的位置变换。通过尺寸调整和位置变换可以适应不同交互对象对第一视频的查看需求和播放喜好。
在一种可能实现方式中,在视频播放界面上播放目标视频片段的过程中,可以同时播放第一视频,也可以暂停播放第一视频,本申请实施例对此不加以限定。对于同时播放第一视频和目标视频片段的情况,可以将第一视频的音频和目标视频片段的音频混合播放;也可以仅播放第一视频的音频,不播放目标视频片段的音频;还可以仅播放目标视频片段的音频,不播放第一视频的音频。
通过在播放目标视频片段时暂停播放第一视频,可以提高目标视频片段所提供的信息被错过,也可以避免在目标视频片段播放期间,第一视频的信息被错过。
本申请实施例以在视频播放界面上播放目标视频片段的同时暂停播放第一视频为例。例如,播放目标视频片段时的视频播放界面如图6所示,在图6所示的视频播放界面中,第一视频是暂停播放的。
在示例性实施例中,对于在视频播放界面上播放目标视频片段且暂停播放第一视频的情况,还包括:响应于第一视频的恢复播放操作,取消播放目标视频片段,恢复播放第一视频。若获取到第一视频的恢复播放操作,则说明目标交互对象不需要再观看目标视频片段,需要继续观看第一视频,从而提高第一视频播放的流畅度。此时,取消播放目标视频片段,恢复播放第一视频。例如,取消播放目标视频片段,恢复播放第一视频后的视频播放界面如图7所示。
在一种可能实现方式中,获取第一视频的恢复播放操作的方式为:响应于视频播放界面中的目标区域的触发操作,获取第一视频的恢复播放操作,目标区域为视频播放界面中除播放目标视频片段的区域外的任一区域。也就是说,若检测到视频播放界面中的除播放目标视频片段的区域外的任一区域的触发操作,则获取第一视频的恢复播放操作。
通过触发目标区域生成恢复播放操作的方式,可以为交互对象提供便利的继续观看第一视频的方式。
在另一种可能实现方式中,获取第一视频的恢复播放操作的方式为:响应于播放目标视频片段的区域中的关闭控件的触发操作,获取第一视频的恢复播放操作。
在一种可能实现方式中,视频片段匹配结果还可能不包括与评论内容匹配的目标视频片段。此种情况下,响应于视频片段匹配结果不包括与评论内容匹配的目标视频片段,在视频播放界面上显示提示信息,提示信息用于提示评论内容未成功匹配到视频片段。示例性地,提示信息可以包括在视频片段匹配结果中,在获取视频片段匹配结果的同时即获取到提示信息。示例性地,提示信息在终端本地生成。
在示例性实施例中,在确定视频片段匹配结果不包括与评论内容匹配的目标视频片段后,响应于视频片段匹配结果不包括与评论内容匹配的目标视频片段,直接执行在视频播放界面上显示提示信息的操作。在示例性实施例中,对于视频播放界面上显示有评论信息发表控件的情况,响应于评论信息发表控件的触发操作,且响应于视频片段匹配结果不包括与评论内容匹配的目标视频片段,再执行在视频播放界面上显示提示信息的操作。
由此,通过视频片段匹配控件和评论信息发表控件作为触发获取视频片段匹配结果和显示目标评论信息的控制方式,可以有效提高系统资源的使用效率,并提高人机交互效率。
示例性地,在显示提示信息的同时,还可以在视频播放界面上显示仅包括评论内容的评论信息。
示例性地,显示提示信息后的视频播放界面如图8所示,在图8中,显示有“视频片段匹配失败”的提示信息801。在示例性实施例中,对于显示提示信息的情况,将内容编辑框中编辑的评论内容和视频片段匹配控件的显示颜色调整为较浅的颜色,如图8中的802和803所示。待提示信息显示结束后,将内容编辑框中编辑的评论内容和视频片段匹配控件的显示颜色恢复正常。示例性地,提示信息的显示时长根据经验设置,或者根据应用场景灵活调整,如,提示信息的显示时长为2秒。
在一种可能实现方式中,对于响应于视频片段匹配控件的触发操作,将视频片段匹配控件的状态由未启用状态转变为启用状态的情况,在将视频片段匹配控件的状态由未启用状态转变为启用状态之后,还包括:将视频片段匹配控件的状态由启用状态恢复为未启用状态。将视频片段匹配控件的状态恢复为未启用状态,能够为交互对象下一次发表包括视频片段播放控件的评论信息奠定基础。例如,恢复为未启用状态的视频片段匹配控件如图5中的502所示。本申请实施例对将视频片段匹配控件的状态由启用状态恢复为未启用状态的时机不加以限定,可以根据实际的应用场景灵活设置。
在示例性实施例中,对于视频播放界面上显示有评论信息发表控件的情况,在获取评论信息发表控件的触发操作后,将视频片段匹配控件的状态由启用状态恢复为未启用状态。也就是说,响应于评论信息发表控件的触发操作,将视频片段匹配控件的状态由启用状态恢复为未启用状态。此种情况下,不论视频片段匹配结果是否包括与评论内容匹配的目标视频片段,均根据评论信息发表控件的触发操作来触发将视频片段匹配控件的状态由启用状态恢复为未启用状态的操作。
在示例性实施例中,在确定视频片段匹配结果不包括与评论内容匹配的目标视频片段的情况下,将视频片段匹配控件的状态由启用状态恢复为未启用状态。也就是说,响应于 视频片段匹配结果不包括与评论内容匹配的目标视频片段,将视频片段匹配控件的状态由启用状态恢复为未启用状态。
在示例性实施例中,在确定视频片段匹配结果包括与评论内容匹配的目标视频片段的情况下,可以先将视频片段匹配控件保持为启用状态,然后在获取评论信息发表控件的触发操作时,再将视频片段匹配控件的状态由启动状态恢复为未启用状态。
当然,在示例性实施例中,对于响应于视频片段匹配控件的触发操作,将视频片段匹配控件的状态由未启用状态转变为启用状态的情况,还可以不论是否获取评论信息发表控件的触发操作以及不论视频片段匹配结果是否包括与评论内容匹配的目标视频片段,均将视频片段匹配控件保持为启用状态,直至再次获取视频片段匹配控件的触发操作,再将视频片段匹配控件的状态由启用状态恢复为未启用状态。
通过为视频片段匹配控件设置启用状态和未启用状态,可以直观的提示交互对象目前待发表的评论内容是否会进行目标视频片段的匹配,从而可以准确的选择以何种方式发表评论内容,避免使用错误方式,提高了交互效率。
在示例性实施例中,响应于评论信息发表控件的触发操作,将视频播放界面中的评论内容清空,以便于交互对象提供下一次想要发表的评论内容。
需要说明的是,本申请实施例以发表目标评论信息的终端为例进行说明,在发表目标评论信息的终端成功发表目标评论信息之后,服务器会将目标评论信息下发到观看第一视频的其他终端,以便于其他终端在播放到目标评论信息的发表时刻时,在视频播放界面上显示目标评论信息。其他终端显示目标评论信息以及在显示目标评论信息之后的操作过程与发表目标评论信息的终端相同,本申请实施例不再加以赘述。
在示例性实施例中,评论信息的显示过程如图9所示。目标交互对象在内容编辑框中编辑评论内容,终端实时识别评论内容对应的文本信息。目标交互对象触发视频片段匹配控件,终端将文本信息发送至服务器。服务器进行视频片段匹配计算,剪辑生成与评论内容匹配的目标视频片段。服务器将目标视频片段返回终端。目标交互对象触发评论信息发表控件,终端生成包括评论信息和视频片段播放控件的目标评论信息,终端在视频播放界面显示目标评论信息。第一交互对象(可以是目标交互对象,也可以是其他交互对象)通过触发目标评论信息中的视频片段播放控件,观看目标视频片段。第一交互对象在观看目标视频片段的过程中,可以拖动、放大、缩小或关闭播放目标视频片段的区域。
本申请实施例提供了一种能够提供视频片段维度的信息的目标评论信息的显示方式。基于目标评论信息能够播放的目标视频片段是基于对交互对象编辑的评论内容(如有一些喜欢剧透的交互对象,二刷三刷视频时,在前期剧情激烈或惨烈阶段,直接剧透结果,或者增加花絮等的评论内容)的识别,进行视频片段快速匹配剪辑得到的。实时生成并显示包括用于触发与评论内容匹配的目标视频片段的播放的视频片段播放控件的目标评论信息,此种评论信息的显示方式可针对视频剧透类型或者搞笑花絮以及特殊付费型进行内容的扩充,将评论信息的内容形式多元化,让喜欢看剧透或花絮甚至更多背后等故事的交互对象在观看视频的过程中可以及时接收到更多维度的视角解读,会增加这类交互对象的观看体验,增加对内容的探讨空间。同时也能够带来更多商业可付费的机会点,如会员独家甚至 超前点播等付费内容。这种能力更多适用于喜欢看悬疑剧或探案剧类目,又同时喜欢被解密的交互对象群体,强烈提升了这类交互对象的观看体验,可实时观看解密,毫无压力。
此外,显示包括评论内容和视频片段播放控件的目标评论信息,能够减少视频跳转,当前界面就可以进行更多视频片段的查看,且视频片段是跟当前播放的视频有强关联度的,能够增加交互对象对应用程序或网页的使用时长,从而提升商业营收。
本申请实施例提供的技术方案能够在视频播放界面上显示一种包括视频片段播放控件的评论信息,该视频片段播放控件能够触发与评论内容匹配的目标视频片段的播放。也就是说,本申请实施例显示的评论信息能够提供视频片段维度的信息,扩展了评论信息所提供的信息的维度,交互对象能够通过触发评论信息中的视频片段播放控件实现观看目标视频片段,有利于提高交互对象的交互体验感,进而提高人机交互率。
参见图10,本申请实施例提供了一种评论信息的显示装置,该装置包括:
第一显示模块1001,用于显示视频播放界面;
第一获取模块1002,用于获取视频播放界面中评论内容的视频片段匹配结果;
第二显示模块1003,用于响应于视频片段匹配结果包括与评论内容匹配的目标视频片段,在视频播放界面上显示包括视频片段播放控件的目标评论信息,视频片段播放控件用于触发目标视频片段的播放。
在一种可能实现方式中,视频播放界面上播放有第一视频,第一获取模块1002,用于识别评论内容对应的文本信息;将文本信息与候选视频片段的标签信息进行比对,基于比对结果获取评论内容的视频片段匹配结果,候选视频片段为与第一视频关联的视频片段。
在一种可能实现方式中,视频播放界面上播放有第一视频,第一获取模块1002,用于识别评论内容对应的文本信息;将文本信息发送至服务器,服务器用于将文本信息与候选视频片段的标签信息进行比对,基于比对结果获取评论内容的视频片段匹配结果,返回视频片段匹配结果,候选视频片段为与第一视频关联的视频片段;接收服务器返回的视频片段匹配结果。
在一种可能实现方式中,第一获取模块1002,还用于响应于比对结果指示文本信息与第一候选视频片段的标签信息匹配成功,基于第一候选视频片段,获取与评论内容匹配的目标视频片段,将包括目标视频片段的结果作为视频片段匹配结果。
在一种可能实现方式中,第二显示模块1003,还用于响应于视频片段匹配结果不包括与评论内容匹配的目标视频片段,在视频播放界面上显示提示信息,提示信息用于提示评论内容未成功匹配到视频片段。
在一种可能实现方式中,视频播放界面上显示有评论信息发表控件,第二显示模块1003,还用于响应于评论信息发表控件的触发操作,在视频播放界面上显示提示信息。
在一种可能实现方式中,参见图11,该装置还包括:
播放模块1004,用于响应于视频片段播放控件的触发操作,在视频播放界面上播放目标视频片段。
在一种可能实现方式中,视频播放界面上播放有第一视频,播放模块1004,用于在视频播放界面上播放目标视频片段且暂停播放第一视频。
在一种可能实现方式中,播放模块1004,还用于响应于第一视频的恢复播放操作,取消播放目标视频片段,恢复播放第一视频。
在一种可能实现方式中,参见图11,该装置还包括:
第二获取模块1005,用于响应于视频播放界面中的目标区域的触发操作,获取第一视频的恢复播放操作,目标区域为视频播放界面中除播放目标视频片段的区域外的任一区域。
在一种可能实现方式中,播放目标视频片段的区域支持尺寸调整和位置变换中的至少一种功能。
在一种可能实现方式中,视频播放界面上显示有内容编辑框,评论内容为内容编辑框中显示的内容。
在一种可能实现方式中,视频播放界面上显示有视频片段匹配控件和评论信息发表控件,第一获取模块1002,用于响应于视频片段匹配控件的触发操作,获取视频播放界面中的评论内容的视频片段匹配结果;
第二显示模块1003,用于响应于评论信息发表控件的触发操作,在视频播放界面上显示包括视频片段播放控件的目标评论信息。
在一种可能实现方式中,参见图11,该装置还包括:
状态变换模块1006,用于响应于视频片段匹配控件的触发操作,将视频片段匹配控件的状态由未启用状态转变为启用状态。
在一种可能实现方式中,状态变换模块1006,还用于响应于评论信息发表控件的触发操作,将视频片段匹配控件的状态由启用状态恢复为未启用状态。
在一种可能实现方式中,状态变换模块1006,还用于响应于视频片段匹配结果不包括与评论内容匹配的目标视频片段,将视频片段匹配控件的状态由启用状态恢复为未启用状态。
在一种可能实现方式中,第二显示模块1003,用于控制包括视频片段播放控件的目标评论信息从视频播放界面的参考方位移动进入视频播放界面,使包括视频片段播放控件的目标评论信息显示在视频播放界面上。
本申请实施例提供的技术方案能够在视频播放界面上显示一种包括视频片段播放控件的评论信息,该视频片段播放控件能够触发与评论内容匹配的目标视频片段的播放。也就是说,本申请实施例显示的评论信息能够提供视频片段维度的信息,扩展了评论信息所提供的信息的维度,交互对象能够通过触发评论信息中的视频片段播放控件实现观看目标视频片段,有利于提高交互对象的交互体验感,进而提高人机交互率。
需要说明的是,上述实施例提供的装置在实现其功能时,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的装置与方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。
图12是本申请实施例提供的一种终端的结构示意图。示例性地,该终端可以是:智能手机、平板电脑、MP3(Moving Picture Experts Group Audio Layer III,动态影像专家压缩 标准音频层面3)播放器、MP4(Moving Picture Experts Group Audio Layer IV,动态影像专家压缩标准音频层面4)播放器、笔记本电脑、台式电脑或车载终端。终端还可能被称为用户设备、便携式终端、膝上型终端、台式终端等其他名称。
通常,终端包括有:处理器1201和存储器1202。
处理器1201可以包括一个或多个处理核心,比如4核心处理器、8核心处理器等。处理器1201可以采用DSP(Digital Signal Processing,数字信号处理)、FPGA(Field-Programmable Gate Array,现场可编程门阵列)、PLA(Programmable Logic Array,可编程逻辑阵列)中的至少一种硬件形式来实现。处理器1201也可以包括主处理器和协处理器,主处理器是用于对在唤醒状态下的数据进行处理的处理器,也称CPU(Central Processing Unit,中央处理器);协处理器是用于对在待机状态下的数据进行处理的低功耗处理器。在一些实施例中,处理器1201可以集成有GPU(Graphics Processing Unit,图像处理器),GPU用于负责显示屏所需要显示的内容的渲染和绘制。一些实施例中,处理器1201还可以包括AI(Artificial Intelligence,人工智能)处理器,该AI处理器用于处理有关机器学习的计算操作。
存储器1202可以包括一个或多个计算机可读存储介质,该计算机可读存储介质可以是非暂态的。存储器1202还可包括高速随机存取存储器,以及非易失性存储器,比如一个或多个磁盘存储设备、闪存存储设备。在一些实施例中,存储器1202中的非暂态的计算机可读存储介质用于存储至少一个指令,该至少一个指令用于被处理器1201所执行,以使该终端实现本申请中方法实施例提供的评论信息的显示方法。
在一些实施例中,终端还可选包括有:外围设备接口1203和至少一个外围设备。处理器1201、存储器1202和外围设备接口1203之间可以通过总线或信号线相连。各个外围设备可以通过总线、信号线或电路板与外围设备接口1203相连。具体地,外围设备包括:射频电路1204、显示屏1205、摄像头组件1206、音频电路1207、定位组件1208和电源1209中的至少一种。
外围设备接口1203可被用于将I/O(Input/Output,输入/输出)相关的至少一个外围设备连接到处理器1201和存储器1202。
射频电路1204用于接收和发射RF(Radio Frequency,射频)信号,也称电磁信号。射频电路1204通过电磁信号与通信网络以及其他通信设备进行通信。
显示屏1205用于显示UI(User Interface,用户界面)。该UI可以包括图形、文本、图标、视频及其它们的任意组合。
摄像头组件1206用于采集图像或视频。可选地,摄像头组件1206包括前置摄像头和后置摄像头。
音频电路1207可以包括麦克风和扬声器。
定位组件1208用于定位终端的当前地理位置,以实现导航或LBS(Location Based Service,基于位置的服务)。
电源1209用于为终端中的各个组件进行供电。
在一些实施例中,终端还包括有一个或多个传感器1210。该一个或多个传感器1210包括但不限于:加速度传感器1211、陀螺仪传感器1212、压力传感器1213、指纹传感器1214、 光学传感器1215以及接近传感器1216。
本领域技术人员可以理解,图12中示出的结构并不构成对终端的限定,可以包括比图示更多或更少的组件,或者组合某些组件,或者采用不同的组件布置。
在示例性实施例中,还提供了一种计算机设备,该计算机设备包括处理器和存储器,该存储器中存储有至少一条计算机程序。该至少一条计算机程序由一个或者一个以上处理器加载并执行,以使该计算机设备实现上述任一种评论信息的显示方法。
在示例性实施例中,还提供了一种计算机可读存储介质,该计算机可读存储介质中存储有至少一条计算机程序,该至少一条计算机程序由计算机设备的处理器加载并执行,以使计算机实现上述任一种评论信息的显示方法。
在一种可能实现方式中,上述计算机可读存储介质可以是只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、只读光盘(Compact Disc Read-Only Memory,CD-ROM)、磁带、软盘和光数据存储设备等。
在示例性实施例中,还提供了一种计算机程序产品,该计算机程序产品包括计算机程序或计算机指令,该计算机程序或计算机指令由处理器加载并执行,以使计算机实现上述任一种评论信息的显示方法。
应当理解的是,在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
以上所述仅为本申请的示例性实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。

Claims (20)

  1. 一种评论信息的显示方法,所述方法由终端执行,所述方法包括:
    显示视频播放界面;
    获取所述视频播放界面中评论内容的视频片段匹配结果;
    响应于所述视频片段匹配结果包括与所述评论内容匹配的目标视频片段,在所述视频播放界面上显示包括视频片段播放控件的目标评论信息,所述视频片段播放控件用于触发所述目标视频片段的播放。
  2. 根据权利要求1所述的方法,所述视频播放界面上播放有第一视频,所述获取所述视频播放界面中评论内容的视频片段匹配结果,包括:
    识别所述评论内容对应的文本信息;
    将所述文本信息与候选视频片段的标签信息进行比对,基于比对结果获取所述评论内容的视频片段匹配结果,所述候选视频片段为与所述第一视频关联的视频片段。
  3. 根据权利要求1所述的方法,所述视频播放界面上播放有第一视频,所述获取所述视频播放界面中评论内容的视频片段匹配结果,包括:
    识别所述评论内容对应的文本信息;
    将所述文本信息发送至服务器,所述服务器用于将所述文本信息与候选视频片段的标签信息进行比对,基于比对结果获取所述评论内容的视频片段匹配结果,返回所述视频片段匹配结果,所述候选视频片段为与所述第一视频关联的视频片段;
    接收所述服务器返回的所述视频片段匹配结果。
  4. 根据权利要求2所述的方法,所述基于比对结果获取所述评论内容的视频片段匹配结果,包括:
    响应于所述比对结果指示所述文本信息与第一候选视频片段的标签信息匹配成功,基于所述第一候选视频片段,获取与所述评论内容匹配的目标视频片段,将包括所述目标视频片段的结果作为所述视频片段匹配结果。
  5. 根据权利要求1所述的方法,所述方法还包括:
    响应于所述视频片段匹配结果不包括与所述评论内容匹配的目标视频片段,在所述视频播放界面上显示提示信息,所述提示信息用于提示所述评论内容未成功匹配到视频片段。
  6. 根据权利要求5所述的方法,所述视频播放界面上显示有评论信息发表控件,所述在所述视频播放界面上显示提示信息,包括:
    响应于所述评论信息发表控件的触发操作,在所述视频播放界面上显示所述提示信息。
  7. 根据权利要求1所述的方法,所述在所述视频播放界面上显示包括视频片段播放控件的目标评论信息之后,所述方法还包括:
    响应于所述视频片段播放控件的触发操作,在所述视频播放界面上播放所述目标视频片段。
  8. 根据权利要求7所述的方法,所述视频播放界面上播放有第一视频,所述在所述视频播放界面上播放所述目标视频片段,包括:
    在所述视频播放界面上播放所述目标视频片段且暂停播放所述第一视频。
  9. 根据权利要求8所述的方法,所述在所述视频播放界面上播放所述目标视频片段且暂停播放所述第一视频之后,所述方法还包括:
    响应于所述第一视频的恢复播放操作,取消播放所述目标视频片段,恢复播放所述第一视频。
  10. 根据权利要求9所述的方法,所述响应于所述第一视频的恢复播放操作,取消播放所述目标视频片段,恢复播放所述第一视频之前,所述方法还包括:
    响应于所述视频播放界面中的目标区域的触发操作,获取所述第一视频的恢复播放操作,所述目标区域为所述视频播放界面中除播放所述目标视频片段的区域外的任一区域。
  11. 根据权利要求1-10任一所述的方法,播放所述目标视频片段的区域支持尺寸调整和位置变换中的至少一种功能。
  12. 根据权利要求1-10任一所述的方法,所述视频播放界面上显示有内容编辑框,所述评论内容为所述内容编辑框中显示的内容。
  13. 根据权利要求1-10任一所述的方法,所述视频播放界面上显示有视频片段匹配控件和评论信息发表控件,所述获取所述视频播放界面中的评论内容的视频片段匹配结果,包括:
    响应于所述视频片段匹配控件的触发操作,获取所述视频播放界面中的评论内容的视频片段匹配结果;
    所述在所述视频播放界面上显示包括视频片段播放控件的目标评论信息,包括:
    响应于所述评论信息发表控件的触发操作,在所述视频播放界面上显示包括视频片段播放控件的目标评论信息。
  14. 根据权利要求13所述的方法,所述方法还包括:
    响应于所述视频片段匹配控件的触发操作,将所述视频片段匹配控件的状态由未启用状态转变为启用状态。
  15. 根据权利要求14所述的方法,所述将所述视频片段匹配控件的状态由未启用状态转变为启用状态之后,所述方法还包括:
    响应于所述评论信息发表控件的触发操作,将所述视频片段匹配控件的状态由所述启用状态恢复为所述未启用状态。
  16. 根据权利要求14所述的方法,所述将所述视频片段匹配控件的状态由未启用状态转变为启用状态之后,所述方法还包括:
    响应于所述视频片段匹配结果不包括与所述评论内容匹配的目标视频片段,将所述视频片段匹配控件的状态由所述启用状态恢复为所述未启用状态。
  17. 一种评论信息的显示装置,所述装置包括:
    第一显示模块,用于显示视频播放界面;
    第一获取模块,用于获取所述视频播放界面中评论内容的视频片段匹配结果;
    第二显示模块,用于响应于所述视频片段匹配结果包括与所述评论内容匹配的目标视频片段,在所述视频播放界面上显示包括视频片段播放控件的目标评论信息,所述视频片段播放控件用于触发所述目标视频片段的播放。
  18. 一种计算机设备,所述计算机设备包括处理器和存储器,所述存储器中存储有至少一条计算机程序,所述至少一条计算机程序由所述处理器加载并执行,以使所述计算机设备实现如权利要求1至16任一所述的评论信息的显示方法。
  19. 一种计算机可读存储介质,所述计算机可读存储介质中存储有至少一条计算机程序,所述至少一条计算机程序由处理器加载并执行,以使计算机实现如权利要求1至16任一所述的评论信息的显示方法。
  20. 一种计算机程序产品,所述计算机程序产品包括计算机程序或计算机指令,所述计算机程序或所述计算机指令由处理器加载并执行,以使计算机实现如权利要求1至16任一所述的评论信息的显示方法。
PCT/CN2022/111612 2021-08-31 2022-08-11 评论信息的显示方法、装置、设备、存储介质及程序产品 WO2023029924A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/196,868 US12120379B2 (en) 2021-08-31 2023-05-12 Comment information display

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111016208.9A CN115734016A (zh) 2021-08-31 2021-08-31 评论信息的显示方法、装置、计算机设备及存储介质
CN202111016208.9 2021-08-31

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/196,868 Continuation US12120379B2 (en) 2021-08-31 2023-05-12 Comment information display

Publications (1)

Publication Number Publication Date
WO2023029924A1 true WO2023029924A1 (zh) 2023-03-09

Family

ID=85291783

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/111612 WO2023029924A1 (zh) 2021-08-31 2022-08-11 评论信息的显示方法、装置、设备、存储介质及程序产品

Country Status (3)

Country Link
US (1) US12120379B2 (zh)
CN (1) CN115734016A (zh)
WO (1) WO2023029924A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180253765A1 (en) * 2012-04-18 2018-09-06 Scorpcast, Llc System and methods for providing user generated video reviews
CN109286850A (zh) * 2017-07-21 2019-01-29 Tcl集团股份有限公司 一种基于弹幕的视频标注方法及终端
CN110958493A (zh) * 2019-12-17 2020-04-03 腾讯科技(深圳)有限公司 一种弹幕调整方法、装置、电子设备和存储介质
CN112328816A (zh) * 2020-11-03 2021-02-05 北京百度网讯科技有限公司 媒体信息展示方法、装置、电子设备及存储介质
CN112866783A (zh) * 2020-12-31 2021-05-28 北京达佳互联信息技术有限公司 评论交互方法和装置、电子设备

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0712877D0 (en) * 2007-07-03 2007-08-08 Skype Ltd Multimedia mood messages
CN108900771B (zh) * 2018-07-19 2020-02-07 北京微播视界科技有限公司 一种视频处理方法、装置、终端设备及存储介质
US11785194B2 (en) * 2019-04-19 2023-10-10 Microsoft Technology Licensing, Llc Contextually-aware control of a user interface displaying a video and related user text
CN111866607B (zh) * 2020-07-30 2022-03-11 腾讯科技(深圳)有限公司 视频片段定位方法、装置、计算机设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180253765A1 (en) * 2012-04-18 2018-09-06 Scorpcast, Llc System and methods for providing user generated video reviews
CN109286850A (zh) * 2017-07-21 2019-01-29 Tcl集团股份有限公司 一种基于弹幕的视频标注方法及终端
CN110958493A (zh) * 2019-12-17 2020-04-03 腾讯科技(深圳)有限公司 一种弹幕调整方法、装置、电子设备和存储介质
CN112328816A (zh) * 2020-11-03 2021-02-05 北京百度网讯科技有限公司 媒体信息展示方法、装置、电子设备及存储介质
CN112866783A (zh) * 2020-12-31 2021-05-28 北京达佳互联信息技术有限公司 评论交互方法和装置、电子设备

Also Published As

Publication number Publication date
CN115734016A (zh) 2023-03-03
US20230291959A1 (en) 2023-09-14
US12120379B2 (en) 2024-10-15

Similar Documents

Publication Publication Date Title
US11722753B2 (en) Synchronizing out-of-band content with a media stream
CN107801096B (zh) 视频播放的控制方法、装置、终端设备及存储介质
US10684754B2 (en) Method of providing visual sound image and electronic device implementing the same
US20190324634A1 (en) Display and Processing Methods and Related Apparatus
WO2017124116A1 (en) Searching, supplementing and navigating media
KR20140091236A (ko) 전자 기기 및 전자 기기의 제어 방법
CN112752121B (zh) 一种视频封面生成方法及装置
CN112261481B (zh) 互动视频的创建方法、装置、设备及可读存储介质
US20230013652A1 (en) Integrating overlaid digital content into displayed data via graphics processing circuitry
CN112188221B (zh) 播放控制方法、装置、计算机设备及存储介质
CN114095793A (zh) 一种视频播放方法、装置、计算机设备及存储介质
WO2023029924A1 (zh) 评论信息的显示方法、装置、设备、存储介质及程序产品
US20230368338A1 (en) Image display method and apparatus, and electronic device
CN112115341A (zh) 内容展示方法、装置、终端、服务器、系统及存储介质
US20230043683A1 (en) Determining a change in position of displayed digital content in subsequent frames via graphics processing circuitry
US12099711B2 (en) Video picture display adjustment method and apparatus, device, medium, and program product
KR20230120668A (ko) 영상통화 방법 및 장치
WO2022231703A1 (en) Integrating overlaid digital content into displayed data via processing circuitry using a computing memory and an operating system memory
CN113542257A (zh) 视频处理方法、视频处理装置、电子设备和存储介质
WO2024113679A1 (zh) 多媒体资源处理方法、装置和设备
CN114584824A (zh) 数据处理方法、系统、电子设备、服务端及客户端设备
US20230326094A1 (en) Integrating overlaid content into displayed data via graphics processing circuitry and processing circuitry using a computing memory and an operating system memory
US20240212240A1 (en) Integrating overlaid content into displayed data via processing circuitry by detecting the presence of a reference patch in a file
CN113905280B (zh) 弹幕信息显示方法、装置、设备以及存储介质
US20240098213A1 (en) Modifying digital content transmitted to devices in real time via processing circuitry

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22863065

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE