WO2019148719A1 - 直播互动装置、方法及计算机可读存储介质 - Google Patents

直播互动装置、方法及计算机可读存储介质 Download PDF

Info

Publication number
WO2019148719A1
WO2019148719A1 PCT/CN2018/089341 CN2018089341W WO2019148719A1 WO 2019148719 A1 WO2019148719 A1 WO 2019148719A1 CN 2018089341 W CN2018089341 W CN 2018089341W WO 2019148719 A1 WO2019148719 A1 WO 2019148719A1
Authority
WO
WIPO (PCT)
Prior art keywords
keyword
video segment
live
question
video
Prior art date
Application number
PCT/CN2018/089341
Other languages
English (en)
French (fr)
Inventor
张国梁
Original Assignee
平安科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技（深圳）有限公司 filed Critical 平安科技（深圳）有限公司
Publication of WO2019148719A1 publication Critical patent/WO2019148719A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H04N21/4828—End-user interface for program selection for searching program descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H04N21/8405—Generation or processing of descriptive data, e.g. content descriptors represented by keywords

Definitions

  • the present application relates to the field of live broadcast technologies, and in particular, to a live interactive device, method, and computer readable storage medium.
  • the existing webcasting platforms provide entertainment services such as live entertainment, live sports, live games, etc., while providing professional consulting services.
  • the live broadcast service has not appeared yet.
  • the existing live broadcast platform provides consulting services, due to the real-time nature of the live broadcast, the interaction between the viewer and the anchor is required to be immediacy, and the viewers who join during the live broadcast will miss the live broadcast of the previous part.
  • Content, in the subsequent live broadcast process may repeatedly ask questions that have already been answered, resulting in the need for the anchor to reply repeatedly to the same question, or the anchor does not reply to the duplicate question, which makes it difficult for the user to get the reply in time. The response to the question is answered, which in turn results in a poor user experience.
  • the present application provides a live interactive device, method and computer readable storage medium, the main purpose of which is to avoid the need for the anchor to repeatedly answer the same question, and enable the viewer to timely obtain a reply to the answered question that has been answered, and improve the user. Experience.
  • the present application provides a live interactive device, which includes a memory and a processor, wherein the memory stores a live interactive program executable on the processor, and the live interactive program is processed. The following steps are implemented when the device is executed:
  • the keyword in the consultation question is extracted according to the keyword extraction algorithm
  • the found video segment is sent to the viewer client, and the video segment is played on the viewer client according to a preset play mode.
  • the present application further provides a live interaction method, the method includes:
  • the keyword in the consultation question is extracted according to the keyword extraction algorithm
  • the found video segment is sent to the viewer client, and the video segment is played on the viewer client according to a preset play mode.
  • the present application further provides a computer readable storage medium, where the live interactive program is stored, and the live interactive program can be executed by one or more processors to implement The steps of the live interactive method as described above.
  • the live interactive device, method and computer readable storage medium provided by the present application, when receiving a consultation question sent by the viewer client during the live broadcast process, extract keywords in the consultation question according to the keyword extraction algorithm, according to the stored video An association between the segment and the keyword, to find whether there is a video segment associated with the obtained keyword, wherein the video segment is generated by a streaming media file recorded by the push streaming client during the live broadcast process, if If yes, the found video segment is sent to the viewer client, and according to the preset play mode, on the viewer client, through the above scheme, if the viewer client repeats the question, the recorded event will be recorded during the live broadcast.
  • the video clip associated with the problem is sent to the viewer client, and the anchor does not need to repeatedly answer the question, and the user can also get the reply of the reply question in time, which not only improves the user experience, but also improves the efficiency of the live broadcast-based consulting service. .
  • FIG. 1 is a schematic diagram of a preferred embodiment of a live interactive device of the present application
  • FIG. 2 is a schematic diagram of a program module of a live interactive program in an embodiment of a live interactive device of the present application
  • FIG. 3 is a flow chart of a preferred embodiment of a live interaction method of the present application.
  • the application provides a live interactive device.
  • FIG. 1 it is a schematic diagram of a preferred embodiment of a live interactive device of the present application.
  • the live interaction device may be a server that establishes a communication connection with the push stream client used by the anchor and the viewer client used by the viewer.
  • the live interactive device includes at least a memory 11, a processor 12, a communication bus 13, and a network interface 14.
  • the memory 11 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (for example, an SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like.
  • the memory 11 may be an internal storage unit of a live interactive device, such as a hard disk of the live interactive device, in some embodiments.
  • the memory 11 may also be an external storage device of a live interactive device, such as a plug-in hard disk equipped with a live interactive device, a smart memory card (SMC), and a secure digital (SD). Card, flash card, etc.
  • the memory 11 may also include both an internal storage unit of the live interactive device and an external storage device.
  • the memory 11 can be used not only for storing application software installed in a live interactive device and various types of data, such as code of a live interactive program, but also for temporarily storing data that has been output or will be output.
  • the processor 12 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor or other data processing chip for running program code or processing stored in the memory 11. Data, such as performing live interactive programs.
  • CPU Central Processing Unit
  • controller microcontroller
  • microprocessor or other data processing chip for running program code or processing stored in the memory 11.
  • Data such as performing live interactive programs.
  • Communication bus 13 is used to implement connection communication between these components.
  • the network interface 14 can optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), and is typically used to establish a communication connection between the device and other electronic devices.
  • a standard wired interface such as a WI-FI interface
  • Figure 1 shows only live interactive devices with components 11-14 and live interactive programs, but it should be understood that not all illustrated components may be implemented and that more or fewer components may be implemented instead.
  • the device may further include a user interface
  • the user interface may include a display
  • an input unit such as a keyboard
  • the optional user interface may further include a standard wired interface and a wireless interface.
  • the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch sensor, or the like.
  • the display may also be appropriately referred to as a display screen or display unit for displaying information processed in the live interactive device and a user interface for displaying the visualization.
  • a live interactive program is stored in the memory 11; when the processor 12 executes the live interactive program stored in the memory 11, the following steps are implemented:
  • the keyword in the consultation question is extracted according to the keyword extraction algorithm.
  • the live interactive device is a server that establishes a communication connection with the push streaming client used by the anchor and the viewer client used by the viewer, and the live interactive device receives the streaming media file sent by the push streaming client in real time, and these After the streaming media file is transcoded, it is sent to the viewer client for playback.
  • the anchor provides a consultative live broadcast service through the push streaming client.
  • the viewer can watch the live broadcast through the audience client and ask questions. For example, the viewer can send a consultation question by sending a text message, and the live interactive device sends the consultation question to the viewer client.
  • the display is displayed on the interface of the push flow client, and the anchor directly answers the consultation question raised by the user in real time in the live video.
  • the live interactive device receives the consultation question sent by the viewer client, and extracts keywords in the consultation question according to the keyword extraction algorithm, wherein the keyword extraction algorithm may be various, for example, TF-IDF (Term Frequency-Inverse Document Frequency) , term frequency-reverse text frequency) algorithm, LSA (Latent Semantic Analysis) algorithm or PLSA (Probabilisitic Latent Semantic Analysis) algorithm.
  • the word segmentation tool is used to perform segmentation processing on the text of the consultation question, for example, using a word segmentation tool such as Stanford Chinese word segmentation tool and jieba word segmentation. The word segmentation process obtains the word segmentation result.
  • keywords are extracted from the word segmentation results according to the above keyword extraction algorithm.
  • the live video is recorded and acquired mainly during the live broadcast, and the recorded video clip is associated with the question answered by the anchor in the video clip and stored in the memory 11.
  • the live interactive device sends the consultation question sent by the viewer client to the push streaming client of the anchor for display, and the anchor can select the question to be answered to reply.
  • the anchor answers the questions to be answered in the consultation question list displayed on the interface, so as to trigger the push flow client to send a recording request to the live interactive device.
  • the recording end request can be sent to the live interactive device by clicking the recording end control on the interface to trigger the push streaming client.
  • the playback position of the current live video is recorded as the starting position of the video recording; the recording end sent by the receiving streaming client is ended.
  • the playback position of the current live video is recorded as the termination position of the video recording; then, the streaming media file between the start position and the end position of the record is obtained and converted into a video frame file, and then a pre-generated according to the video frame file is generated.
  • the formatted video segment is finally analyzed.
  • the keyword extraction algorithm is used to analyze the consulting question selected by the anchor, extract the keywords in the consulting question, and store the keyword and the video segment in association.
  • the push streaming client triggers the recording request after receiving the keyword input by the anchor based on the preset keyword input interface. Specifically, the push streaming client displays a keyword input interface when detecting the recording instruction, and acquires a keyword input by the anchor based on the interface when receiving the confirmation instruction triggered by the keyword input interface, A recording request is initiated based on the acquired keywords.
  • the keywords extracted in the above steps may be one or more, that is, one video segment may have one or more associated keywords.
  • the live interactive device records the recording start position corresponding to the current recording request as the recording termination position corresponding to the previous recording request, and does not require the user to manually trigger the recording termination instruction, and only needs to select the answer. Consultation questions can be.
  • the push streaming client uploads the streaming media file by continuously sending the data packet
  • the live interactive device continuously receives the data packet, and after the recording start position and the recording termination position are acquired, the recording start position and the recording are terminated.
  • the data packet between the locations converts the video frame file and generates a video clip in a preset format.
  • the anchor can manually add an associated keyword to the video segment according to the answering question when the recording request is sent, or the live interactive device extracts the keyword from the consulting question according to the keyword extraction algorithm according to the consulting question corresponding to the recording request.
  • the keyword transmitted by the anchor or the keyword extracted from the consultation question is associated with the video segment and stored. In the above manner, a plurality of video clips are recorded during the live broadcast, and each video clip has one or more associated keywords.
  • the found video segment is sent to the viewer client, and the video segment is played on the viewer client according to a preset play mode.
  • the associated video clip If the associated video clip is found, it indicates that the consulting question already has a relevant answer, and the found video clip is sent to the viewer client, and the viewer client plays according to the preset play mode, for example, to float small.
  • the form of the window plays the video clip on the play interface, or directly switches the play screen from the live broadcast screen to the play screen of the video clip.
  • the step of sending the found video segment to the audience client includes:
  • the live interactive device may find multiple video segments associated with the extracted keywords, and the name of the multiple video segments may be sent to the audience client. It is up to the user to decide which play to play, wherein the video clip can be named after the consultation question selected by the anchor at the time of recording. Further, if there is no video clip required by the user in the plurality of video clips, the control of the non-related video clip on the prompt interface may be clicked, and the live interactive device may send the consultation question to the push streaming client for display.
  • the consulting question is sent to the streaming client of the streaming media file, and Displayed on the push stream client.
  • the consulting question is sent to the streaming media.
  • the steps for pushing the client of the file include:
  • the number of times the keyword is mentioned during the live broadcast is counted; the number of times of the statistics and the A consultation question is sent to the push stream client of the streaming media file.
  • the number of times the inquiry question that has not been answered is repeatedly asked is counted, and the number of times the question is asked is sent while the consultation question is sent to the push flow client, so that the anchor will consult the question.
  • the number of times that are repeatedly asked is used as a reference for question or question.
  • the live interactive device when receiving the consultation question sent by the viewer client during the live broadcast process, extracts keywords in the consultation question according to the keyword extraction algorithm, according to the stored video segment and the keyword Correlation relationship, searching whether there is a video segment associated with the obtained keyword, wherein the video segment is generated by a streaming media file recorded by the push streaming client during the live broadcast, and if so, the searched
  • the video clip is sent to the viewer client, and is displayed on the viewer client according to a preset play mode.
  • the anchor does not need to repeatedly answer the question, and the user can get the reply of the reply question in time, which not only improves the user experience, but also improves the efficiency of the live broadcast-based consulting service.
  • the live interactive program may also be divided into one or more modules, one or more modules being stored in the memory 11 and being processed by one or more processors (this embodiment is The processor 12) is executed to complete the application, and the module referred to in the present application refers to a series of computer program instruction segments capable of performing a specific function for describing the execution process of the live interactive program in the live interactive device.
  • FIG. 2 it is a schematic diagram of a program module of a live interactive program in an embodiment of a live interactive device of the present application.
  • the live interactive program can be divided into a keyword extraction module 10, a video search module 20, and Video sending module 30, illustratively:
  • the keyword extraction module 10 is configured to: when receiving a consultation question sent by the audience client during the live broadcast, extract the keyword in the consultation question according to the keyword extraction algorithm
  • the video search module 20 is configured to: according to the association relationship between the stored video segment and the keyword, whether there is a video segment associated with the acquired keyword, wherein the video segment is sent by the push streaming client in the live broadcast The streaming media file recorded during the process is generated;
  • the video sending module 30 is configured to: if there is a video segment associated with the acquired keyword, send the found video segment to the viewer client, and play the video on the viewer client according to a preset play mode. Fragment.
  • the present application also provides a live interaction method.
  • FIG. 3 it is a flowchart of a preferred embodiment of the live interaction method of the present application.
  • the method may be performed by a device, which may be implemented by software and/or hardware.
  • the device may be a server that is in communication with the viewer client and the push stream client.
  • the live interaction is performed.
  • the apparatus is described as an execution subject for the method of the present application.
  • the live interaction method includes:
  • Step S10 When receiving the consultation question sent by the viewer client during the live broadcast, the keyword in the consultation question is extracted according to the keyword extraction algorithm.
  • the live interactive device receives the streaming media files sent by the push streaming client in real time, and performs transcoding processing on the streaming media files, and then sends the streaming media files to the audience client for playing.
  • the anchor provides a consultative live broadcast service through the push streaming client.
  • the viewer can watch the live broadcast through the audience client and ask questions.
  • the viewer can send a consultation question by sending a text message, and the live interactive device sends the consultation question to the viewer client.
  • the display is displayed on the interface of the push flow client, and the anchor directly answers the consultation question raised by the user in real time in the live video.
  • the live interactive device receives the consultation question sent by the viewer client, and extracts keywords in the consultation question according to the keyword extraction algorithm, wherein the keyword extraction algorithm may be various, for example, TF-IDF (Term Frequency-Inverse Document Frequency) , term frequency-reverse text frequency) algorithm, LSA (Latent Semantic Analysis) algorithm or PLSA (Probabilisitic Latent Semantic Analysis) algorithm.
  • the word segmentation tool is used to perform segmentation processing on the text of the consultation question, for example, using a word segmentation tool such as Stanford Chinese word segmentation tool and jieba word segmentation. The word segmentation process obtains the word segmentation result.
  • keywords are extracted from the word segmentation results according to the above keyword extraction algorithm.
  • Step S20 Searching for a video segment associated with the acquired keyword according to the association relationship between the stored video segment and the keyword, where the video segment is recorded by the push streaming client during the live broadcast process.
  • the stream file is generated.
  • the live video is recorded and acquired during the live broadcast, and the recorded video clip is associated with the question answered by the anchor in the video clip and stored.
  • the live interactive device sends the consultation question sent by the viewer client to the push streaming client of the anchor for display, and the anchor can select the question to be answered to reply.
  • the anchor answers the questions to be answered in the consultation question list displayed on the interface, so as to trigger the push flow client to send a recording request to the live interactive device.
  • the recording end request can be sent to the live interactive device by clicking the recording end control on the interface to trigger the push streaming client.
  • the playback position of the current live video is recorded as the starting position of the video recording; the recording end sent by the receiving streaming client is ended.
  • the playback position of the current live video is recorded as the termination position of the video recording; then, the streaming media file between the start position and the end position of the record is obtained and converted into a video frame file, and then a pre-generated according to the video frame file is generated.
  • the formatted video segment is finally analyzed.
  • the keyword extraction algorithm is used to analyze the consulting question selected by the anchor, extract the keywords in the consulting question, and store the keyword and the video segment in association.
  • the push streaming client triggers the recording request after receiving the keyword input by the anchor based on the preset keyword input interface. Specifically, the push streaming client displays a keyword input interface when detecting the recording instruction, and acquires a keyword input by the anchor based on the interface when receiving the confirmation instruction triggered by the keyword input interface, A recording request is initiated based on the acquired keywords.
  • the keywords extracted in the above steps may be one or more, that is, one video segment may have one or more associated keywords.
  • the live interactive device records the recording start position corresponding to the current recording request as the recording termination position corresponding to the previous recording request, and does not require the user to manually trigger the recording termination instruction, and only needs to select the answer. Consultation questions can be.
  • the push streaming client uploads the streaming media file by continuously sending the data packet
  • the live interactive device continuously receives the data packet, and after the recording start position and the recording termination position are acquired, the recording start position and the recording are terminated.
  • the data packet between the locations converts the video frame file and generates a video clip in a preset format.
  • the anchor can manually add an associated keyword to the video segment according to the answering question when the recording request is sent, or the live interactive device extracts the keyword from the consulting question according to the keyword extraction algorithm according to the consulting question corresponding to the recording request.
  • the keyword transmitted by the anchor or the keyword extracted from the consultation question is associated with the video segment and stored. In the above manner, a plurality of video clips are recorded during the live broadcast, and each video clip has one or more associated keywords. Based on the keywords extracted from the consultation questions received this time, it is searched whether there is a video segment associated with the keyword in the stored video segment.
  • Step S30 if yes, sending the found video segment to the viewer client, and playing the video segment on the viewer client according to a preset play mode.
  • the associated video clip If the associated video clip is found, it indicates that the consulting question already has a relevant answer, and the found video clip is sent to the viewer client, and the viewer client plays according to the preset play mode, for example, to float small.
  • the form of the window plays the video clip on the play interface, or directly switches the play screen from the live broadcast screen to the play screen of the video clip.
  • the step of sending the found video segment to the audience client includes:
  • the live interactive device may find multiple video segments associated with the extracted keywords, and the name of the multiple video segments may be sent to the audience client. It is up to the user to decide which play to play, wherein the video clip can be named after the consultation question selected by the anchor at the time of recording. Further, if there is no video clip required by the user in the plurality of video clips, the control of the non-related video clip on the prompt interface may be clicked, and the live interactive device may send the consultation question to the push streaming client for display.
  • the consulting question is sent to the streaming client of the streaming media file, and Displayed on the push stream client.
  • the consulting question is sent to the streaming media.
  • the steps for pushing the client of the file include:
  • the number of times the keyword is mentioned during the live broadcast is counted; the number of times of the statistics and the A consultation question is sent to the push stream client of the streaming media file.
  • the number of times the inquiry question that has not been answered is repeatedly asked is counted, and the number of times the question is asked is sent while the consultation question is sent to the push flow client, so that the anchor will consult the question.
  • the number of times that are repeatedly asked is used as a reference for question or question.
  • the live interaction method when receiving the consultation question sent by the viewer client during the live broadcast process, extracting keywords in the consultation question according to the keyword extraction algorithm, according to the stored video segment and the keyword Correlation relationship, searching whether there is a video segment associated with the obtained keyword, wherein the video segment is generated by a streaming media file recorded by the push streaming client during the live broadcast, and if so, the searched
  • the video clip is sent to the viewer client, and is displayed on the viewer client according to a preset play mode.
  • the anchor does not need to repeatedly answer the question, and the user can get the reply of the reply question in time, which not only improves the user experience, but also improves the efficiency of the live broadcast-based consulting service.
  • the embodiment of the present application further provides a computer readable storage medium, where the live readable program is stored on the computer readable storage medium, and the live interactive program can be executed by one or more processors to implement the following operations:
  • the keyword in the consultation question is extracted according to the keyword extraction algorithm
  • the found video segment is sent to the viewer client, and the video segment is played on the viewer client according to a preset play mode.
  • the technical solution of the present application which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM as described above). , a disk, an optical disk, including a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the various embodiments of the present application.
  • a terminal device which may be a mobile phone, a computer, a server, or a network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Library & Information Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种直播互动装置，包括存储器和处理器，存储器上存储有可在处理器上运行的直播互动程序，该程序被处理器执行时实现如下步骤：在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取咨询问题中的关键词；根据存储的视频片段与关键词之间的关联关系，查找存储器中是否有与获取的关键词关联的视频片段，若有，则将查找到的视频片段发送至观众客户端，并按照预设的播放模式在观众客户端播放该视频片段。本申请还提出一种直播互动方法以及一种计算机可读存储介质。本申请避免需要主播对相同的问题重复回复，并且使观众及时地获取到对咨询问题的解答，提升了用户体验。

Description

直播互动装置、方法及计算机可读存储介质
本申请基于巴黎公约申明享有2018年02月05日递交的申请号为201810109477.1、名称为“直播互动装置、方法及计算机可读存储介质”的中国专利申请的优先权，该中国专利申请的整体内容以参考的方式结合在本申请中。
技术领域
本申请涉及直播技术领域，尤其涉及一种直播互动装置、方法及计算机可读存储介质。
背景技术
随着互联网技术的不断发展，网络直播逐渐兴起，现有的网络直播平台多是提供一些诸如娱乐类直播、体育类直播、游戏类直播等带有娱乐性质的直播服务，而提供专业咨询式的直播服务尚未出现。而且，即使以现有的直播平台提供咨询服务，由于直播的实时性强等特点，要求观众与主播之间的互动具有即时性，而在直播过程中才加入的观众，会错过前期部分的直播内容，在后续的直播过程中，可能会重复提问已经回答过的问题，导致需要主播对相同的问题重复回复，或者，主播不回复重复问题，则导致用户难以及时地得到对这些已回复过的咨询问题的回复，进而造成用户体验差。
发明内容
本申请提供一种直播互动装置、方法及计算机可读存储介质，其主要目的在于避免需要主播对相同的问题重复回答，并且使观众及时地获取到对已解答过的咨询问题的回复，提升用户体验。
为实现上述目的，本申请提供一种直播互动装置，该装置包括存储器和处理器，所述存储器中存储有可在所述处理器上运行的直播互动程序，所述直播互动程序被所述处理器执行时实现如下步骤：
在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词；
根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成；
若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
此外，为实现上述目的，本申请还提供一种直播互动方法，该方法包括：
在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词；
根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成；
若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
此外，为实现上述目的，本申请还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有直播互动程序，所述直播互动程序可被一个或者多个处理器执行，以实现如上所述的直播互动方法的步骤。
本申请提出的直播互动装置、方法及计算机可读存储介质，在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词，根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成，若有，则将查找到的视频片段发送到该观众客户端，并按照预设的播放模式在该观众客户端上，通过上述方案，如果观众客户端重复提问，则将在直播过程中录制的与该问题关联的视频片段发送给观众客户端，不需要主播重复回答问题，并且用户也能够及时地得到回复过的咨询问题的回复，不仅能够提升用户体验，而且提高了基于直播的咨询服务的效率。
附图说明
图1为本申请直播互动装置较佳实施例的示意图；
图2为本申请直播互动装置一实施例中直播互动程序的程序模块示意图；
图3为本申请直播互动方法较佳实施例的流程图。
本申请目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
本申请提供一种直播互动装置。参照图1所示，为本申请直播互动装置较佳实施例的示意图。
在本实施例中，直播互动装置可以是与主播使用的推流客户端以及观众使用的观众客户端建立通讯连接的服务器。
该直播互动装置至少包括存储器11、处理器12，通信总线13，以及网络接口14。
其中，存储器11至少包括一种类型的可读存储介质，所述可读存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如，SD或DX存储器等)、磁性存储器、磁盘、光盘等。存储器11在一些实施例中可以是直播互动装置的内部存储单元，例如该直播互动装置的硬盘。存储器11在另一些实施例中也可以是直播互动装置的外部存储设备，例如直播互动装置上配备的插接式硬盘，智能存储卡(Smart Media Card,SMC)，安全数字(Secure Digital,SD)卡，闪存卡(Flash Card)等。进一步地，存储器11还可以既包括直播互动装置的内部存储单元也包括外部存储设备。存储器11不仅可以用于存储安装于直播互动装置的应用软件及各类数据，例如直播互动程序的代码等，还可以用于暂时地存储已经输出或者将要输出的数据。
处理器12在一些实施例中可以是一中央处理器(Central Processing Unit,CPU)、控制器、微控制器、微处理器或其他数据处理芯片，用于运行存储器11中存储的程序代码或处理数据，例如执行直播互动程序等。
通信总线13用于实现这些组件之间的连接通信。
网络接口14可选的可以包括标准的有线接口、无线接口(如WI-FI接口)，通常用于在该装置与其他电子设备之间建立通信连接。
图1仅示出了具有组件11-14以及直播互动程序的直播互动装置，但是应 理解的是，并不要求实施所有示出的组件，可以替代的实施更多或者更少的组件。
可选地，该装置还可以包括用户接口，用户接口可以包括显示器(Display)、输入单元比如键盘(Keyboard)，可选的用户接口还可以包括标准的有线接口、无线接口。可选地，在一些实施例中，显示器可以是LED显示器、液晶显示器、触控式液晶显示器以及OLED(Organic Light-Emitting Diode，有机发光二极管)触摸器等。其中，显示器也可以适当的称为显示屏或显示单元，用于显示在直播互动装置中处理的信息以及用于显示可视化的用户界面。
在图1所示的装置实施例中，存储器11中存储有直播互动程序；处理器12执行存储器11中存储的直播互动程序时实现如下步骤：
在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词。
本实施例的方案中，直播互动装置为与主播使用的推流客户端以及观众使用的观众客户端建立通讯连接的服务器，直播互动装置接收推流客户端实时发送的流媒体文件，并对这些流媒体文件进行转码处理后，发送至观众客户端进行播放。主播通过推流客户端提供咨询式的直播服务，观众通过观众客户端观看直播并提出咨询问题，例如，观众可以通过发送文字信息的方式发送咨询问题，直播互动装置将观众客户端发送的咨询问题显示在推流客户端的界面上进行显示，主播直接在直播视频中对用户提出的咨询问题进行实时的解答。
具体地，直播互动装置接收观众客户端发送咨询问题，按照关键词提取算法提取咨询问题中的关键词，其中，关键词提取算法可以有多种，例如，TF-IDF(Term Frequency-Inverse Document Frequency，词项频率-逆向文本频率)算法、LSA(Latent Semantic Analysis，隐性语义分析)算法或者PLSA(Probabilisitic Latent Semantic Analysis，概率隐性语义分析)算法等。或者，在其他实施例中，在使用关键词提取算法提取咨询问题中的关键词之前，先使用分词工具对咨询问题的文本进行分词处理，例如，使用Stanford汉语分词工具、jieba分词等分词工具进行分词处理，获取分词结果，进一步地，为了进一步提高关键词的有效性，只保留分词结果中的动词和/或名词，去掉副词、形容词等不具有实际意义的词语。然后按照上述关键词提取算法从分词 结果中提取关键词。
根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成。
关于存储的视频片段的来源，主要是在直播过程中对直播视频进行录制获取，并且将录制的视频片段与该视频片段中主播回答的问题关联后存储至存储器11中。其中，关于视频片段的录制可以有多种实现方式，例如，直播互动装置将观众客户端发送的咨询问题发送到主播的推流客户端进行显示，主播可以选择想要回答的问题进行回复。具体地，在一实施例中，主播点击界面上显示的咨询问题列表中要回答的问题，以触发推流客户端向直播互动装置发送录制请求，当主播在对当前的咨询问题回答完毕后，可通过点击界面上的录制结束的控件以触发推流客户端向直播互动装置发送录制结束请求。对于直播互动装置来说，首先，在接收到推流客户端发送的录制请求时，记录当前的直播视频的播放位置，作为视频录制的起始位置；在接收到推流客户端发送的录制结束请求时，记录当前的直播视频的播放位置，作为视频录制的终止位置；然后，获取记录的起始位置和终止位置之间的流媒体文件并转换为视频帧文件，进而根据视频帧文件生成预设格式的视频片段；最后，利用关键词提取算法对主播所选取的咨询问题进行分析，提取该咨询问题中的关键词，并关联存储所述关键词与所述视频片段。
或者，在其他实施例中，所述推流客户端在接收到主播基于预设关键词输入界面所输入的关键词后，触发所述录制请求。具体地，所述推流客户端在检测到录制指令时，显示关键词输入界面，并在接收到基于所述关键词输入界面触发的确认指令时，获取主播基于所述界面输入的关键词，基于获取的关键词发起录制请求。上述步骤中提取的关键词可以是一个或者多个，也就是说，一个视频片段可以有一个或者多个关联的关键词。或者，在其他实施例中，直播互动装置将本次的录制请求对应的录制起始位置记录为上一次录制请求对应的录制终止位置，不需要用户手动的触发录制终止指令，只需要选择要回答的咨询问题即可。
在直播过程中，推流客户端以持续发送数据包的方式上传流媒体文件，直播互动装置不断地接收数据包，在获取录制起始位置和录制终止位置之后， 将录制起始位置和录制终止位置之间的数据包转换视频帧文件，并生成预设格式的视频片段。主播可以在发送录制请求时，根据回答的咨询问题手动为该视频片段添加关联的关键词，或者直播互动装置根据录制请求对应的咨询问题，按照关键词提取算法从该咨询问题中提取关键词，将主播发送的关键词或者从咨询问题中提取的关键词与视频片段关联后存储。按照上述方式，在直播的过程中录制得到多个视频片段，并且每个视频片段有一个或者多个关联的关键词。
根据从本次接收到的咨询问题中提取出的关键词，查找存储的视频片段中是否有与该关键词关联的视频片段。
若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
如果查找到关联的视频片段，则说明该咨询问题已经有相关的解答，则将查找到的视频片段发送至观众客户端，并在观众客户端按照预设的播放模式播放，例如，以浮动小窗口的形式在播放界面上播放该视频片段，或者，直接将播放画面由直播画面切换至该视频片段的播放画面。
可选地，作为一种实施方式，所述将查找到的视频片段发送至所述观众客户端的步骤包括：
若根据存储的视频片段与关键词之间的关联关系，获取到多个与关键词关联的视频片段，则向所述观众客户端发送包含有所述多个视频片段的名称的提示界面；当接收到所述观众客户端基于所述提示界面触发的选择指令时，获取所述选择指令对应的视频片段的名称；将该名称对应的视频片段发送至所述观众客户端。
当不同的视频片段与同一个关键词有关联关系时，直播互动装置会查找到多个与提取到的关键词关联的视频片段，此时可以将多个视频片段的名称发送到观众客户端，由用户决定选择哪一个播放，其中，视频片段可以以录制时主播选择的咨询问题命名。进一步地，如果上述多个视频片段中没有用户需要的视频片段，可以点击提示界面上的无相关视频片段的控件，直播互动装置可以将该咨询问题发送到推流客户端上显示。
此外，若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推 流客户端，并在推流客户端上显示。
可选地，作为一种实施方式，若根据存储的视频片段与咨询问题之间的关联关系，查找不到与获取的咨询问题关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端的步骤包括：
若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则统计在直播过程中该关键词被提及的次数；将统计的次数和所述咨询问题发送至所述流媒体文件的推流客户端。
在该实施方式中，对没有被回答过的咨询问题被重复问到的次数进行统计，并在向推流客户端发送咨询问题的同时发送该问题被问到的次数，以供主播将咨询问题被重复问到的次数作为是否问答问题的参考信息。
本实施例提出的直播互动装置，在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词，根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成，若有，则将查找到的视频片段发送到该观众客户端，并按照预设的播放模式在该观众客户端上，通过上述方案，如果观众客户端重复提问，则将在直播过程中录制的与该问题关联的视频片段发送给观众客户端，不需要主播重复回答问题，并且用户也能够及时地得到回复过的咨询问题的回复，不仅能够提升用户体验，而且提高了基于直播的咨询服务的效率。
可选地，在其他的实施例中，直播互动程序还可以被分割为一个或者多个模块，一个或者多个模块被存储于存储器11中，并由一个或多个处理器(本实施例为处理器12)所执行以完成本申请，本申请所称的模块是指能够完成特定功能的一系列计算机程序指令段，用于描述直播互动程序在直播互动装置中的执行过程。
例如，参照图2所示，为本申请直播互动装置一实施例中的直播互动程序的程序模块示意图，该实施例中，直播互动程序可以被分割为关键词提取模块10、视频查找模块20和视频发送模块30，示例性地：
关键词提取模块10用于：在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词
视频查找模块20用于：根据存储的视频片段与关键词之间的关联关系， 查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成；
视频发送模块30用于：若有与获取的关键词关联的视频片段，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
上述关键词提取模块10、视频查找模块20和视频发送模块30等程序模块被执行时所实现的功能或操作步骤与上述实施例大体相同，在此不再赘述。
此外，本申请还提供一种直播互动方法。参照图3所示，为本申请直播互动方法较佳实施例的流程图。该方法可以由一个装置执行，该装置可以由软件和/或硬件实现，在下述实施例中，该装置可以是与观众客户端和推流客户端通讯连接的服务器，以下实施例中以直播互动装置作为执行主体对本申请的方法进行说明。
在本实施例中，直播互动方法包括：
步骤S10，在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词。
本实施例的方案中，直播互动装置接收推流客户端实时发送的流媒体文件，并对这些流媒体文件进行转码处理后，发送至观众客户端进行播放。主播通过推流客户端提供咨询式的直播服务，观众通过观众客户端观看直播并提出咨询问题，例如，观众可以通过发送文字信息的方式发送咨询问题，直播互动装置将观众客户端发送的咨询问题显示在推流客户端的界面上进行显示，主播直接在直播视频中对用户提出的咨询问题进行实时的解答。
具体地，直播互动装置接收观众客户端发送咨询问题，按照关键词提取算法提取咨询问题中的关键词，其中，关键词提取算法可以有多种，例如，TF-IDF(Term Frequency-Inverse Document Frequency，词项频率-逆向文本频率)算法、LSA(Latent Semantic Analysis，隐性语义分析)算法或者PLSA(Probabilisitic Latent Semantic Analysis，概率隐性语义分析)算法等。或者，在其他实施例中，在使用关键词提取算法提取咨询问题中的关键词之前，先使用分词工具对咨询问题的文本进行分词处理，例如，使用Stanford汉语分词工具、jieba分词等分词工具进行分词处理，获取分词结果，进一步地，为了进一步提高关键词的有效性，只保留分词结果中的动词和/或名词，去掉副 词、形容词等不具有实际意义的词语。然后按照上述关键词提取算法从分词结果中提取关键词。
步骤S20，根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成。
关于存储的视频片段的来源，主要是在直播过程中对直播视频进行录制获取，并且将录制的视频片段与该视频片段中主播回答的问题关联后存储。其中，关于视频片段的录制可以有多种实现方式，例如，直播互动装置将观众客户端发送的咨询问题发送到主播的推流客户端进行显示，主播可以选择想要回答的问题进行回复。具体地，在一实施例中，主播点击界面上显示的咨询问题列表中要回答的问题，以触发推流客户端向直播互动装置发送录制请求，当主播在对当前的咨询问题回答完毕后，可通过点击界面上的录制结束的控件以触发推流客户端向直播互动装置发送录制结束请求。对于直播互动装置来说，首先，在接收到推流客户端发送的录制请求时，记录当前的直播视频的播放位置，作为视频录制的起始位置；在接收到推流客户端发送的录制结束请求时，记录当前的直播视频的播放位置，作为视频录制的终止位置；然后，获取记录的起始位置和终止位置之间的流媒体文件并转换为视频帧文件，进而根据视频帧文件生成预设格式的视频片段；最后，利用关键词提取算法对主播所选取的咨询问题进行分析，提取该咨询问题中的关键词，并关联存储所述关键词与所述视频片段。
或者，在其他实施例中，所述推流客户端在接收到主播基于预设关键词输入界面所输入的关键词后，触发所述录制请求。具体地，所述推流客户端在检测到录制指令时，显示关键词输入界面，并在接收到基于所述关键词输入界面触发的确认指令时，获取主播基于所述界面输入的关键词，基于获取的关键词发起录制请求。上述步骤中提取的关键词可以是一个或者多个，也就是说，一个视频片段可以有一个或者多个关联的关键词。或者，在其他实施例中，直播互动装置将本次的录制请求对应的录制起始位置记录为上一次录制请求对应的录制终止位置，不需要用户手动的触发录制终止指令，只需要选择要回答的咨询问题即可。
在直播过程中，推流客户端以持续发送数据包的方式上传流媒体文件， 直播互动装置不断地接收数据包，在获取录制起始位置和录制终止位置之后，将录制起始位置和录制终止位置之间的数据包转换视频帧文件，并生成预设格式的视频片段。主播可以在发送录制请求时，根据回答的咨询问题手动为该视频片段添加关联的关键词，或者直播互动装置根据录制请求对应的咨询问题，按照关键词提取算法从该咨询问题中提取关键词，将主播发送的关键词或者从咨询问题中提取的关键词与视频片段关联后存储。按照上述方式，在直播的过程中录制得到多个视频片段，并且每个视频片段有一个或者多个关联的关键词。根据从本次接收到的咨询问题中提取出的关键词，查找存储的视频片段中是否有与该关键词关联的视频片段。
步骤S30，若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
如果查找到关联的视频片段，则说明该咨询问题已经有相关的解答，则将查找到的视频片段发送至观众客户端，并在观众客户端按照预设的播放模式播放，例如，以浮动小窗口的形式在播放界面上播放该视频片段，或者，直接将播放画面由直播画面切换至该视频片段的播放画面。
可选地，作为一种实施方式，所述将查找到的视频片段发送至所述观众客户端的步骤包括：
若根据存储的视频片段与关键词之间的关联关系，获取到多个与关键词关联的视频片段，则向所述观众客户端发送包含有所述多个视频片段的名称的提示界面；当接收到所述观众客户端基于所述提示界面触发的选择指令时，获取所述选择指令对应的视频片段的名称；将该名称对应的视频片段发送至所述观众客户端。
当不同的视频片段与同一个关键词有关联关系时，直播互动装置会查找到多个与提取到的关键词关联的视频片段，此时可以将多个视频片段的名称发送到观众客户端，由用户决定选择哪一个播放，其中，视频片段可以以录制时主播选择的咨询问题命名。进一步地，如果上述多个视频片段中没有用户需要的视频片段，可以点击提示界面上的无相关视频片段的控件，直播互动装置可以将该咨询问题发送到推流客户端上显示。
此外，若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推 流客户端，并在推流客户端上显示。
可选地，作为一种实施方式，若根据存储的视频片段与咨询问题之间的关联关系，查找不到与获取的咨询问题关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端的步骤包括：
若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则统计在直播过程中该关键词被提及的次数；将统计的次数和所述咨询问题发送至所述流媒体文件的推流客户端。
在该实施方式中，对没有被回答过的咨询问题被重复问到的次数进行统计，并在向推流客户端发送咨询问题的同时发送该问题被问到的次数，以供主播将咨询问题被重复问到的次数作为是否问答问题的参考信息。
本实施例提出的直播互动方法，在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词，根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成，若有，则将查找到的视频片段发送到该观众客户端，并按照预设的播放模式在该观众客户端上，通过上述方案，如果观众客户端重复提问，则将在直播过程中录制的与该问题关联的视频片段发送给观众客户端，不需要主播重复回答问题，并且用户也能够及时地得到回复过的咨询问题的回复，不仅能够提升用户体验，而且提高了基于直播的咨询服务的效率。
此外，本申请实施例还提出一种计算机可读存储介质，所述计算机可读存储介质上存储有直播互动程序，所述直播互动程序可被一个或多个处理器执行，以实现如下操作：
在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词；
根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成；
若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
本申请计算机可读存储介质具体实施方式与上述直播互动装置和方法各 实施例基本相同，在此不作累述。
需要说明的是，上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。并且本文中的术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、装置、物品或者方法不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、装置、物品或者方法所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、装置、物品或者方法中还存在另外的相同要素。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。
以上仅为本申请的优选实施例，并非因此限制本申请的专利范围，凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本申请的专利保护范围内。

Claims (20)

  1. 一种直播互动装置，其特征在于，所述装置包括存储器和处理器，所述存储器上存储有可在所述处理器上运行的直播互动程序，所述直播互动程序被所述处理器执行时实现如下步骤：
    在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词；
    根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成；
    若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
  2. 如权利要求1所述的直播互动装置，其特征在于，所述直播互动程序还可被所述处理器执行，以在所述在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词的步骤之前，还实现如下步骤：
    在接收到推流客户端发送的录制请求时，记录当前的直播视频的播放位置，作为视频录制的起始位置，并获取触发所述录制请求的咨询问题；
    在接收到推流客户端发送的录制结束请求时，记录当前的直播视频的播放位置，作为视频录制的终止位置；
    将记录的起始位置和终止位置之间的流媒体文件转换为视频帧文件，并根据视频帧文件生成预设格式的视频片段；
    按照关键词提取算法提取所述咨询问题的关键词，并将该关键词与所述视频片段关联后存储。
  3. 如权利要求2所述的直播互动装置，其特征在于，所述推流客户端在检测到所述咨询问题被选定时，触发基于该咨询问题的录制请求；
    或者，所述推流客户端在接收到主播基于预设关键词输入界面所输入的关键词后，触发所述录制请求。
  4. 如权利要求1所述的直播互动装置，其特征在于，所述直播互动程序还可被所述处理器执行，以在根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段的步骤之后，还实 现如下步骤：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端。
  5. 如权利要求2所述的直播互动装置，其特征在于，所述直播互动程序还可被所述处理器执行，以在根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段的步骤之后，还实现如下步骤：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端。
  6. 如权利要求3所述的直播互动装置，其特征在于，所述直播互动程序还可被所述处理器执行，以在根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段的步骤之后，还实现如下步骤：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端。
  7. 如权利要求4所述的直播互动装置，其特征在于，所述若根据存储的视频片段与咨询问题之间的关联关系，查找不到与获取的咨询问题关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端的步骤包括：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则统计在直播过程中该关键词被提及的次数；
    将统计的次数和所述咨询问题发送至所述流媒体文件的推流客户端。
  8. 一种直播互动方法，其特征在于，所述方法包括：
    在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词；
    根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成；
    若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
  9. 如权利要求8所述的直播互动方法，其特征在于，所述在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词的步骤之前，所述方法还包括：
    在接收到推流客户端发送的录制请求时，记录当前的直播视频的播放位置，作为视频录制的起始位置，并获取触发所述录制请求的咨询问题；
    在接收到推流客户端发送的录制结束请求时，记录当前的直播视频的播放位置，作为视频录制的终止位置；
    将记录的起始位置和终止位置之间的流媒体文件转换为视频帧文件，并根据视频帧文件生成预设格式的视频片段；
    按照关键词提取算法提取所述咨询问题的关键词，并将该关键词与所述视频片段关联后存储。
  10. 如权利要求9所述的直播互动方法，其特征在于，所述推流客户端在检测到所述咨询问题被选定时，触发基于该咨询问题的录制请求；
    或者，所述推流客户端在接收到主播基于预设关键词输入界面所输入的关键词后，触发所述录制请求。
  11. 如权利要求8所述的直播互动方法，其特征在于，所述根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段的步骤之后，所述方法还包括：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则统计在直播过程中该关键词被提及的次数；
    将统计的次数和所述咨询问题发送至所述流媒体文件的推流客户端。
  12. 如权利要求8所述的直播互动方法，其特征在于，所述根据存储的视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段的步骤之后，所述方法还包括：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则统计在直播过程中该关键词被提及的次数；
    将统计的次数和所述咨询问题发送至所述流媒体文件的推流客户端。
  13. 如权利要求9所述的直播互动方法，其特征在于，所述根据存储的 视频片段与关键词之间的关联关系，查找是否有与获取的关键词关联的视频片段的步骤之后，所述方法还包括：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则统计在直播过程中该关键词被提及的次数；
    将统计的次数和所述咨询问题发送至所述流媒体文件的推流客户端。
  14. 如权利要求11所述的直播互动方法，其特征在于，所述若根据存储的视频片段与咨询问题之间的关联关系，查找不到与获取的咨询问题关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端的步骤包括：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则统计在直播过程中该关键词被提及的次数；
    将统计的次数和所述咨询问题发送至所述流媒体文件的推流客户端。
  15. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质上存储有直播互动程序，所述直播互动程序可被一个或者多个处理器执行，以实现如下步骤：
    在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词；
    根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段，其中，所述视频片段是由推流客户端在所述直播过程中录制的流媒体文件所生成；
    若有，则将查找到的视频片段发送至所述观众客户端，并按照预设的播放模式在所述观众客户端播放该视频片段。
  16. 如权利要求15所述的计算机可读存储介质，其特征在于，所述直播互动程序还可被所述处理器执行，以在所述在直播过程中接收到观众客户端发送的咨询问题时，按照关键词提取算法提取所述咨询问题中的关键词的步骤之前，还实现如下步骤：
    在接收到推流客户端发送的录制请求时，记录当前的直播视频的播放位置，作为视频录制的起始位置，并获取触发所述录制请求的咨询问题；
    在接收到推流客户端发送的录制结束请求时，记录当前的直播视频的播放位置，作为视频录制的终止位置；
    将记录的起始位置和终止位置之间的流媒体文件转换为视频帧文件，并根据视频帧文件生成预设格式的视频片段；
    按照关键词提取算法提取所述咨询问题的关键词，并将该关键词与所述视频片段关联后存储。
  17. 如权利要求16所述的计算机可读存储介质，其特征在于，所述推流客户端在检测到所述咨询问题被选定时，触发基于该咨询问题的录制请求；
    或者，所述推流客户端在接收到主播基于预设关键词输入界面所输入的关键词后，触发所述录制请求。
  18. 如权利要求15所述的计算机可读存储介质，其特征在于，所述直播互动程序还可被所述处理器执行，以在根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段的步骤之后，还实现如下步骤：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端。
  19. 如权利要求16所述的计算机可读存储介质，其特征在于，所述直播互动程序还可被所述处理器执行，以在根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段的步骤之后，还实现如下步骤：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端。
  20. 如权利要求17所述的计算机可读存储介质，其特征在于，所述直播互动程序还可被所述处理器执行，以在根据存储的视频片段与关键词之间的关联关系，查找所述存储器中是否有与获取的关键词关联的视频片段的步骤之后，还实现如下步骤：
    若根据存储的视频片段与关键词之间的关联关系，查找不到与获取的关键词关联的视频片段，则将所述咨询问题发送至所述流媒体文件的推流客户端。
PCT/CN2018/089341 2018-02-05 2018-05-31 直播互动装置、方法及计算机可读存储介质 WO2019148719A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810109477.1A CN108419138B (zh) 2018-02-05 2018-02-05 直播互动装置、方法及计算机可读存储介质
CN201810109477.1 2018-02-05

Publications (1)

Publication Number Publication Date
WO2019148719A1 true WO2019148719A1 (zh) 2019-08-08

Family

ID=63126779

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/089341 WO2019148719A1 (zh) 2018-02-05 2018-05-31 直播互动装置、方法及计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN108419138B (zh)
WO (1) WO2019148719A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4093031A4 (en) * 2020-09-27 2023-05-24 Beijing Dajia Internet Information Technology Co., Ltd. LIVE STREAMING ROOM DATA EXCHANGE METHOD AND APPARATUS

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110971983B (zh) * 2018-09-30 2022-04-22 上海掌门科技有限公司 一种视频答疑方法、设备和存储介质
CN111753134A (zh) * 2019-03-26 2020-10-09 深圳Tcl新技术有限公司 一种直播学习方法、存储介质及终端设备
CN110177284A (zh) * 2019-05-23 2019-08-27 北京达佳互联信息技术有限公司 信息展示方法、装置、电子设备及存储介质
CN112351288B (zh) * 2019-08-07 2023-04-28 阿里巴巴集团控股有限公司 直播信息处理方法、装置、服务器、终端以及存储介质
CN111669608B (zh) * 2020-05-12 2022-07-12 广东茉莉数字科技集团股份有限公司 支持用户多媒体反馈的化妆品展示装置及方法
CN111709232A (zh) * 2020-05-22 2020-09-25 湖南映客互娱网络信息有限公司 一种直播客服队列式咨询处理方法与系统
CN114095738A (zh) * 2020-07-30 2022-02-25 京东方科技集团股份有限公司 视频及直播处理方法、直播系统、电子设备、终端、介质
CN112218103B (zh) * 2020-09-02 2022-12-09 北京达佳互联信息技术有限公司 直播间互动方法、装置、电子设备和存储介质
CN113301369B (zh) * 2021-05-20 2022-11-25 读书郎教育科技有限公司 一种智慧课堂录播视频的交互系统及方法
CN113596489B (zh) * 2021-07-05 2023-07-04 咪咕互动娱乐有限公司 直播教学方法、装置、设备及计算机可读存储介质
CN113766338A (zh) * 2021-08-04 2021-12-07 阿里健康科技(中国)有限公司 一种直播数据处理方法、直播系统、终端设备
CN113381927B (zh) * 2021-08-12 2021-11-02 环球数科集团有限公司 基于旅游信息的社交媒体交互方法、系统及存储介质
CN114071174A (zh) * 2021-11-15 2022-02-18 咪咕文化科技有限公司 直播内容的处理方法、电子设备及可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080046406A1 (en) * 2006-08-15 2008-02-21 Microsoft Corporation Audio and video thumbnails
CN106488253A (zh) * 2016-11-04 2017-03-08 合网络技术（北京）有限公司 直播视频互动数据处理方法及装置
CN106663099A (zh) * 2014-04-10 2017-05-10 谷歌公司 用于搜索视频内容的方法、系统和介质
CN107343221A (zh) * 2017-08-14 2017-11-10 彭君毅 一种在线多媒体互动系统及方法
CN107580235A (zh) * 2017-09-01 2018-01-12 网宿科技股份有限公司 一种直播视频的重播方法、重播服务器及系统
CN107659825A (zh) * 2017-09-12 2018-02-02 武汉斗鱼网络科技有限公司 一种直播视频留存的方法、装置、服务器、主播端及介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MX2017014501A (es) * 2015-05-14 2018-08-01 Mathurin Trevor Sistema multi-interface, multimedia, integrado de audio/video y activado de voz/manual.
CN105979348B (zh) * 2016-06-28 2019-09-10 武汉斗鱼网络科技有限公司 一种基于视频剪切与弹幕的匹配方法及装置
CN106341695B (zh) * 2016-08-31 2020-08-11 腾讯数码（天津）有限公司 直播间互动方法、装置及系统
CN106878819B (zh) * 2017-01-20 2019-07-26 合一网络技术(北京)有限公司 一种网络直播中信息交互的方法、系统及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080046406A1 (en) * 2006-08-15 2008-02-21 Microsoft Corporation Audio and video thumbnails
CN106663099A (zh) * 2014-04-10 2017-05-10 谷歌公司 用于搜索视频内容的方法、系统和介质
CN106488253A (zh) * 2016-11-04 2017-03-08 合网络技术（北京）有限公司 直播视频互动数据处理方法及装置
CN107343221A (zh) * 2017-08-14 2017-11-10 彭君毅 一种在线多媒体互动系统及方法
CN107580235A (zh) * 2017-09-01 2018-01-12 网宿科技股份有限公司 一种直播视频的重播方法、重播服务器及系统
CN107659825A (zh) * 2017-09-12 2018-02-02 武汉斗鱼网络科技有限公司 一种直播视频留存的方法、装置、服务器、主播端及介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4093031A4 (en) * 2020-09-27 2023-05-24 Beijing Dajia Internet Information Technology Co., Ltd. LIVE STREAMING ROOM DATA EXCHANGE METHOD AND APPARATUS

Also Published As

Publication number Publication date
CN108419138A (zh) 2018-08-17
CN108419138B (zh) 2021-06-22

Similar Documents

Publication Publication Date Title
WO2019148719A1 (zh) 直播互动装置、方法及计算机可读存储介质
US20200329275A1 (en) Identification and Presentation of Content Associated with Currently Playing Television Programs
US11288303B2 (en) Information search method and apparatus
US11743557B2 (en) Methods, systems, and media for presenting supplemental content relating to media content based on state information that indicates a subsequent visit to the content interface
US8473845B2 (en) Video manager and organizer
US9015189B2 (en) Method and system for providing information using a supplementary device
WO2019090653A1 (zh) 一种视频直播的方法、装置和系统
US10530509B2 (en) Identification of concurrently broadcast time-based media
US20140096162A1 (en) Automated Social Media and Event Driven Multimedia Channels
JP2011243204A (ja) 番組コンテキストに基づくモバイルコンテンツの提示
US11893013B2 (en) Method and apparatus for determining and presenting answers to content-related questions
RU2583764C1 (ru) Способ обработки запроса пользователя на доступ к веб-ресурсу и сервер
WO2020042375A1 (zh) 用于输出信息的方法和装置
JP2011180729A (ja) 情報処理装置、キーワード登録方法及びプログラム
CN112492329B (zh) 直播方法和装置
WO2021036617A1 (zh) 一种短视频制作方法、存储介质及终端
CN111416995A (zh) 一种基于场景识别的内容推送方法、系统及智能终端
US20180176631A1 (en) Methods and systems for providing an interactive second screen experience
US10966000B1 (en) Method and apparatus for determining and presenting answers to content-related questions
WO2014134753A1 (zh) 一种社交网络载体的展现方法、系统及其装置
CN109815408B (zh) 用于推送信息的方法和装置
US20090319571A1 (en) Video indexing
WO2021113499A1 (en) Method and apparatus for determining and presenting answers to content-related questions

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18903506

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.11.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18903506

Country of ref document: EP

Kind code of ref document: A1