CN109766457B

CN109766457B - Media content searching method, device and storage medium

Info

Publication number: CN109766457B
Application number: CN201711097780.6A
Authority: CN
Inventors: 熊欢
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2017-11-09
Filing date: 2017-11-09
Publication date: 2022-12-23
Anticipated expiration: 2037-11-09
Also published as: WO2019091416A1; CN109766457A

Abstract

The application provides a media content searching method, which comprises the following steps: receiving a media content search request carrying partial keywords; sending the partial keywords to an application server for media content search; receiving media content information of one or more media contents fed back by the application server; media content information that presents the one or more media content; responding to a preview request of a user for media content, and downloading a summary file of the media content; the summary file is a media file which is generated by an application server according to a plurality of image frames extracted from the media content and corresponds to the media content; and playing the summary file of the media content in a preview window corresponding to the media content. Correspondingly, the application also provides the user terminal and the application server.

Description

Media content searching method, device and storage medium

Technical Field

The present application relates to the field of information technology, and in particular, to a method, an apparatus, and a storage medium for searching media content.

Background

Searching is the most important function on the internet, and almost everyone can inquire about web pages, news, maps, knowledge, pictures and the like through searching, so that the searching becomes a huge flow entrance. In a search scene, when a user inputs a keyword, an associated keyword can appear, and the input of the user is reduced. But in the search scenario of a video application, when the user sees the associated keywords, it may still be unclear which is the intended, especially non-theatrical, search.

Disclosure of Invention

The embodiment of the application provides a media content searching method. The method comprises the following steps: receiving a media content search request carrying partial keywords; sending the part of keywords to an application server for searching media contents; receiving media content information of one or more media contents fed back by the application server; presenting media content information of the one or more media contents; responding to a preview request of a user for media content, and downloading a summary file of the media content; the summary file is a media file which is generated by an application server according to a plurality of image frames extracted from the media content and corresponds to the media content; and playing the summary file of the media content in a preview window corresponding to the media content.

The embodiment of the application also provides a media content searching method. The method comprises the following steps: after a piece of media content is uploaded, a plurality of image frames are extracted from the media content, and at least one summary file of the media content is generated; receiving a media content search request carrying partial keywords from an application client; determining one or more text keywords according to the partial keywords; one or more media contents determined according to the one or more text keywords; acquiring media content information of the one or more media contents and a storage address of the summary file; and feeding back the media content information of the one or more media contents and the storage address of the summary file to the application client.

The embodiment of the application also provides a media content searching method. The method comprises the following steps: receiving a media content search request carrying partial keywords from an application client; determining one or more text keywords according to the partial keywords; sequencing the at least one text keyword according to the relevance degree of the part of keywords recorded by the user and the at least one text keyword; the relevancy of the partial keywords and the text keywords represents that a user inputs a partial keyword for retrieval and finally selects a probability statistic value of the media content corresponding to the text keyword; one or more media contents determined according to the one or more text keywords; acquiring the media content information of the one or more media contents and the storage address of the summary file; and feeding back the media content information of the corresponding media content and the storage address of the summary file to the application client according to the sequence of the at least one text keyword.

The embodiment of the application also discloses a user terminal. The user terminal includes:

the sending module is used for receiving a media content searching request carrying part of keywords and sending the part of keywords to the application server for media content searching;

the receiving module is used for receiving the media content information of the one or more media contents fed back by the application server;

the display module is used for displaying the media content information of the one or more media contents;

the preview module is used for responding to a preview request of a user for a media content, downloading the summary file of the media content and playing the summary file of the media content in a preview window corresponding to the media content.

Wherein the display module may include: the expansion unit is used for displaying part of media content information of the one or more media contents in a list manner, responding to an expansion request aiming at one media content in the list, displaying a display area of the media content, and displaying a preview window of the media content and all the media content information of the media content in the display area; the downloading unit is used for responding to a preview request of a user for media content and downloading the summary file of the media content according to the storage address of the summary file; and the preview unit is used for playing the summary file of the media content in the preview window.

The summary file can be a large picture file; and the preview unit may include: the splitting sub-module is used for reversely splitting the large picture file into a plurality of screenshots according to the splicing rule of the abstract file; the playing area setting submodule is used for setting a playing area in the preview window according to the size of the single screenshot; and the mobile playing sub-module is used for displaying the first screenshot in the playing area, and moving the large picture file according to a preset moving rule at intervals of a preset time interval so as to display the next screenshot until the preview is finished.

The user terminal may further include: and the progress adjusting unit is used for adjusting the preview progress according to the playing progress adjusting operation of the user and the current operation position of the user in the preview window.

The schedule adjusting unit may include: the operation position acquisition submodule is used for responding to the play progress adjustment operation of the user and acquiring the current operation position of the user in the preview window; the playing progress determining submodule is used for determining a playing progress value of the media content corresponding to the operation position according to the current operation position of the user in the preview window; and the progress adjusting submodule is used for determining the position of the screenshot of the media content corresponding to the operation position in the summary file according to the playing progress value.

The embodiment of the application also discloses an application server. The application server includes:

the summary file generation module is used for extracting a plurality of image frames from the media content and generating at least one summary file of the media content;

the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving a media content searching request carrying partial keywords from an application client side and determining one or more text keywords according to the partial keywords;

the determining module is used for determining one or more media contents according to the text keywords and acquiring the media content information of the one or more media contents and the storage address of the abstract file; and

and the sending module is used for feeding back the media content information of the one or more media contents and the storage address of the summary file to the application client.

Wherein, the summary file generation module may include: the screenshot module is used for intercepting a plurality of screenshots from the media content according to the frequency of intercepting one frame of image from the media content at intervals of a predetermined time interval; the splicing module is used for splicing each P screenshots according to a preset splicing rule to generate a large picture file, and the generated at least one large picture file is respectively used as one or more abstract files of the media content; wherein P is a natural number.

The summary file generation module may further include: and the address generation module is used for splicing the file name of the summary file to the domain name of the content distribution network according to a preset rule and then generating the storage address of the summary file.

The application server may further include: the sorting module is used for recording the association degree of partial keywords and text keywords and sorting the at least one text keyword according to the association degree of the partial keywords and the at least one text keyword recorded by the sorting module; and the sending module is used for feeding back the media content information of the one or more media contents and the storage address of the summary file to the application client according to the sequence of the at least one text keyword.

The embodiment of the present application further discloses an application server, wherein the application server includes:

the receiving module is used for receiving a part of keywords input by a user and sent by the application client;

the first determining module is used for determining at least one text keyword according to the partial keywords;

the sorting module is used for recording the association degree of partial keywords and text keywords and sorting the at least one text keyword according to the association degree of the partial keywords and the at least one text keyword recorded by the sorting module;

a second determining module, configured to determine at least one media content corresponding to the at least one text keyword; and

and the sending module is used for feeding back the media content information of the corresponding media content to the application client according to the sequence of the at least one text keyword.

The application server may further include: and the establishing module is used for updating the association degree of the partial keywords and the text keywords corresponding to the media content according to the partial keywords input by the user and the media content selected to be clicked.

The embodiment of the present application further provides a storage medium, which stores readable instructions and can cause at least one processor to execute the method for sending the exposure data of the content item.

According to the technical scheme, in the process of searching the target media content by the user, the preview window is set for a certain candidate media content, and the summary file of the media content is played in the preview window, so that more information besides the media content information can be provided for the user, the user can conveniently determine whether the candidate media content is the target media content required by the user, the search efficiency is improved, the unnecessary repeated search is avoided, and the hardware resources and the network resources of a terminal side and a network side can be saved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic diagram of a system architecture according to an embodiment of the present application;

FIG. 2 is a flowchart of a media content searching method according to an embodiment of the present application;

FIG. 3 is an example of presenting media content in a list according to an embodiment of the present application;

FIG. 4 is an example of expanding a media content according to an embodiment of the present application;

fig. 5 is an example of an automatically carousel summary file according to an embodiment of the present application;

FIG. 6 is a flowchart of a media content searching method according to an embodiment of the present application;

FIG. 7 is a flowchart of a media content searching method according to an embodiment of the present application;

fig. 8A is a schematic structural diagram of a user terminal according to an embodiment of the present application;

FIG. 8B is a schematic structural diagram of a display module according to an embodiment of the present application;

fig. 9 is a schematic diagram of a hardware structure of a user terminal according to an embodiment of the present application;

FIG. 10 is a block diagram of a server according to an embodiment of the present application;

FIG. 11 is a block diagram of a server according to an embodiment of the present application; and

fig. 12 is a schematic hardware structure diagram of a server according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

For simplicity and clarity of description, the aspects of the invention are set forth below by describing several representative embodiments. The numerous details of the examples are merely provided to assist in understanding the inventive arrangements. It will be apparent, however, that the invention may be practiced without these specific details. Some embodiments are not described in detail, but rather only a framework is presented, in order to avoid unnecessarily obscuring aspects of the invention. Hereinafter, "comprising" means "including but not limited to", "according to '8230;' 8230;" means "according to at least '8230;' 8230;, but not limited to only according to '8230;' 8230;". When the number of one component is not particularly specified hereinafter, it means that the component may be one or more, or may be understood as at least one.

In the present application, the media content may specifically refer to multimedia content such as video, audio, and pictures. There are many kinds of media content searching methods. One type of search method is based on keyword cues. Specifically, when a prefix of a target media content name input by a user through a terminal is received, for example, a prefix of a movie and television series name, the network-side application server may associate various possible query keywords according to the prefix, and display the query keywords to the user through the user terminal in a pull-down list manner. Wherein the prefix refers to the previous word or words of the name of the target media content. When a user selects one of the query keywords, the network side application server performs actual search according to the query keyword to obtain a search result of media content information containing one or more media contents, and the search result is displayed to the user through the terminal. In addition to displaying the name of the searched media content, the search method also displays information such as a static poster picture of the media content. However, in any search method, if there are situations where a plurality of scenario names are similar, the user needs to select from a plurality of candidate keywords and then perform a search. And further browsing and searching the searched candidate media contents for the media contents wanted by the user. Often if the content is found to be undesirable after the search, it is likely that the user will be required to re-type the keywords for additional searching. In such a process, the user usually cannot obtain more information, so that the search accuracy cannot be determined, and thus the user can repeatedly operate the search, the user experience is not intelligent and convenient, and resources are wasted.

In order to solve the above problem, an example of the present application proposes a media content search method. In the method, after a user inputs partial keywords of target media content through an application client, the application client displays the media content information of candidate media content searched by an application server to the user, and plays an abstract file of the media content returned by the application server after the user selects to preview a certain media content, and simulates a video playing effect in a key frame dynamic image carousel mode, so that the user can quickly preview the media content and determine whether the media content is the media content desired by the user. The media searching method can improve the efficiency of searching the media content by the user and improve the experience of finding the media content quickly by searching, thereby saving the hardware resources of the terminal side and the network side equipment and the network resources occupied by communication. Here, the partial keyword of the target search content may refer to a part of the media content name, and for example, "speed" or "passion" in the name of "speed and passion 8" of the movie may be input as the partial keyword to perform the search.

Fig. 1 is a schematic structural diagram of a media content searching system to which a media content searching method according to some embodiments of the present application is applied. As shown in fig. 1, the media content search system of the present application includes at least: a user terminal 11, a network 12 and an application server 13.

In some examples of the present application, the user terminal 11 may be a personal computer, a notebook, or an intelligent terminal device such as a tablet computer, a smart phone, and a PAD. The user terminal 11 includes a display device, such as a liquid crystal screen. In general, various application clients, such as an application client for Tencent video, etc., may be installed on the user terminal 11. The application client may retrieve the corresponding media content from the application server 13 and display it to the user on its own display device.

The application server 13 is an application server corresponding to the application client, and may be, for example, an Tencent video server or the like. The application server software in the application server 13, together with the application client software in the user terminal 11, provides services to the user, for example, determining media content such as content that needs to be previewed according to keywords. The application server 13 may be a single server or a cluster server composed of a plurality of servers.

The network 12 may include wired networks and wireless networks. As shown in fig. 1, on the access network side, a user terminal 11 may access a network 12 in a wireless manner or in a wired manner; on the core network side, the application server 13 is typically connected to the network 12 by wire. Of course, the application server 13 may also be connected to the network 12 in a wireless manner.

The media content searching method provided by the embodiment of the application is described below by several embodiments with reference to the accompanying drawings.

Based on the system structure shown in fig. 1, an embodiment of the present application provides a media content searching method, which is applied to an application client of a user terminal 11, and after displaying a list containing at least one media content searched by a keyword to a user, the method displays preview information of the media content in response to a user preview request operation for one media content, and provides more and richer information for the user to determine whether the media content is the media content required by the user, so as to improve the efficiency of media content search, and save hardware resources and network resources of user side devices and network side devices.

Fig. 2 shows a flowchart of a media content searching method provided by an example of the present application. As shown in fig. 2, the media content searching method includes the steps of:

step 201: and receiving a media content search request carrying part of keywords, and sending the part of keywords to an application server for media content search.

In some embodiments, a user may conduct a search for media content through an application client on the user terminal 11 in an attempt to find the media content he needs, which may also be referred to as target media content. Specifically, the user may typically enter a partial keyword within a search box provided by the application client on the user terminal 11 and click a search key to send a media content search request to the application client. At this time, the application client responds to the media content search request, and sends the partial keywords input by the user in the search box to the application server, so that the application server performs media content search according to the partial keywords to determine the corresponding media content.

Step 202: and receiving the media content information of the one or more media contents fed back by the application server.

Here, the media content information is information that can be used to describe characteristics of the media content, and includes one or more of a name, a genre, a starring actor, a storage address of the media content, and poster information of the media content. In general, the application server searches for media content according to a part of keywords uploaded by the application client, acquires media content information of the searched media content, and feeds back the acquired media content information of the media content to the application client.

In the embodiment of the present application, in addition to the media content information of the media content, the application server may further feed back the storage address of the summary file corresponding to the searched media content.

In an embodiment of the present application, the summary file may be a media file corresponding to a media content, which is generated by an application server according to a plurality of key frames extracted from the media content. For example, the application server may capture a media content at a fixed time interval a (e.g., every 10 seconds) to obtain a plurality of captured images, and concatenate a predetermined number of captured images according to a certain sequence and a concatenation rule to obtain one or more large picture files. Each large picture file can be used as a summary file of the media content, and generally, each media content can have one or more summary files. For another example, the application server may capture a media content at a fixed time interval a (e.g., every 10 seconds) to obtain a plurality of captures, then generate an animation file according to the plurality of obtained captures, and use the animation file as a summary file of the media content. After the application server generates the summary file, the application server stores the summary file in a database of the application server and records the storage address of the summary file. For example, the storage address of the digest file may be a Uniform Resource Locator (URL) that identifies the storage location of the digest file.

Step 203: media content information of the one or more media content is presented.

In some embodiments of the present application, the application client may present the media content information of the one or more media contents in a list. For example, fig. 3 shows an example of media content information showing media content in a list form. As shown in fig. 3, the application client receives media contents 'speed and passion 8', 'speed and passion 7', 'speed and passion 6' corresponding to a partial keyword 301 'speed', and presents them in a list in which media content information of each media content, for example, a name 302 and a category 303 of each media content is presented.

Step 204: and responding to a preview request of a user for a media content, downloading the summary file of the media content, and playing the summary file of the media content in a preview window corresponding to the media content.

In an embodiment of the application, when the application client displays the media content information of the one or more media contents, a preview window may be further displayed for each media content, so as to display a poster or a summary file of the media content for the user.

Specifically, when the application client displays the media content information of the one or more media contents in a list manner, the application client may set a display area for each media content on the page, for displaying the media content information of the media content. At this time, the preview window may be set at a predetermined position within the presentation area of each media content.

In some embodiments of the present application, in order to reduce the occupied space for displaying each media content, and in order to display media content information of more media contents on the same page, as shown in fig. 3, when the application client displays the media content information of the one or more media contents in a list manner, part of the media content information, such as name and type, of the first one or more media contents may be displayed in a list manner on the page, instead of displaying all the content of the media content information and the preview window. At this time, if the user wants to view all the media content information and the preview window of a certain media content, it is necessary to transmit an expansion request for the media content. For example, as shown in fig. 3, when the application client displays the media content information of the one or more media contents in a list manner, an expansion symbol 304 is displayed corresponding to each media content. The user clicks the expansion symbol 304 corresponding to a certain media content to trigger an expansion request for the media content. Alternatively, the application client may not display the expansion symbol 304 corresponding to each media content, and in this case, the expansion request may be triggered by a click operation of the user clicking on part of the media content information of a certain media content, or may also be triggered by a slide operation of the user sliding a mouse over part of the media content information of a certain media content. In any triggering mode, in response to an expansion request for one media content in the list, the application client expands a display area for displaying the media content and displays a preview window of the media content and all media content information of the media content in the display area.

As previously mentioned, the preview pane is used to present a poster or summary file of media content to a user. When the user sends a preview request to preview the media content, the application client plays the summary file of the media content for the user through the preview window.

In an embodiment of the present application, the preview request may also be triggered in various ways, for example, when the application client displays media content information of a certain media content, a poster of the media content may be statically displayed in the preview window, and a preview key is provided. When the user clicks the preview key, a preview request is triggered. For example, fig. 4 is an example of expanding display of one media content information. As shown in fig. 4, in response to an expansion request from a user, specifically, for example, clicking on a selection operation of "speed and passion 8" of a media content 401, an exhibition area 402 of the media content is expanded, and a preview window 403 of the media content 401 and media content information, such as a name 404, a lead actor 405, and the like, are exhibited in the exhibition area 402, and a play button 406 is also provided. Further, the preview window 403 may statically show a poster (shaded portion) of the media content and provide a preview key 407. When the user clicks the preview key 407, it indicates that the user has sent a preview request. Alternatively, a preview key may not be provided, and the preview request may be triggered by a user clicking on part of media content information of a certain media content or clicking on a certain position in a preview window area; or may be triggered by a sliding operation of a user mouse sliding into a part of the media content information or the preview window area of a certain media content.

As described above, in the embodiment of the present application, in response to a preview request for a media content from a user, if a storage address of a summary file of the media content is already known, an application client downloads the summary file of the media content according to the storage address of the summary file of the media content, and plays the summary file of the media content in a preview window. In the embodiment of the application, in response to a preview request of a user for a media content, if a storage address of a summary file of the media content is not known yet, an application client first requests the application server for the storage address of the summary file of the media content, downloads the summary file of the media content according to the storage address of the summary file of the media content after obtaining the storage address of the summary file of the media content, and plays the summary file of the media content in a preview window. When requesting the storage address of the summary file, the application client may carry identification information such as the name of the media content to identify which storage address of the summary file of the media content is currently requested.

As described above, the summary file may be a media file corresponding to a media content generated by an application server according to a plurality of image frames extracted from the media content.

In some embodiments of the present application, the summary file may be a moving picture file generated by the application server by capturing a screenshot of a media content at a fixed time interval (e.g., every 10 seconds), and generating a moving picture file according to a plurality of obtained screenshots. At this time, playing the summary file of the media content in the preview window specifically means playing the moving picture file in the preview window.

In some embodiments of the present application, the summary file may also be obtained by the application server capturing a screenshot of one media content at a fixed time interval (for example, every 10 seconds), and splicing the obtained multiple screenshots according to a certain order to obtain one or more picture files, which are herein referred to as large picture files for short. At this time, playing the summary file of the media content in the preview window specifically means automatically playing each screenshot in the large picture file in turn in the preview window. The automatic carousel refers to automatically and sequentially playing and amplifying all screenshots contained in the picture file according to a preset sequence and a time interval.

In some embodiments, automatically carousel the large picture file in the preview window may specifically include:

step A: and reversely splitting the large picture file into a plurality of screenshots according to the splicing rule of the large picture file.

For example, when the server generates a large picture file as a summary file, P screenshots are arranged from left to right in a time sequence from top to bottom into R rows and S columns, where R × S > = P, and R, S, and P are positive integers, and then the arranged P screenshots in the R rows and S columns are spliced into the large picture file, so in this step, the application client reversely splits the downloaded large picture file into the R rows and S columns and P screenshots in total according to the splicing rule.

And B: and setting a playing area of the preview window according to the size of the single screenshot.

Through the setting, the size of the playing area in the preview window is equal to the size of a single screenshot. That is, the length and width of the playback area is equal to the length and width of a single screenshot.

And C: and displaying the first screenshot in the playing area.

Step D: and moving the large picture file according to a preset moving rule at a preset time interval T, and displaying the next screenshot until the preview is finished.

The predetermined moving rule is determined by the splicing rule of the large picture file. As described above, on the application server side, when generating a large picture file, the application server splices together a plurality of screen shots obtained by screen shooting in a certain order. Then, in this step, the application client may move the large picture file in the reverse order of the stitching. For example, the application server splices the screenshots from left to right and from top to bottom in time order, so in this step, the application client may use the leftmost screenshot in the first row as the first screenshot, and move the distance of the width of a single screenshot to the left to display the next screenshot until the row of the large picture file is displayed. Then, the further application client moves the large picture file up by the height of a single screenshot, and moves the large picture file to the left-most screenshot of the row to start presentation of the next row of screenshots. And repeating the steps until all screenshots of the large picture file of the media content are displayed or the user selects to stop previewing.

Furthermore, if one media content corresponds to a plurality of summary files, the summary files are sequentially downloaded according to the generation sequence of the summary files and the summary files of the media content are respectively displayed according to the method. In the embodiment of the application, the application client may send the request of the storage address of the summary file only once, and the application server may feed back all the storage addresses of all the summary files corresponding to one media content to the application client once. Alternatively, the application client may send the request for the storage address of the digest file multiple times, for example, when the application client is about to preview a digest file, the application client will request the storage address of the next digest file from the application server. At this time, the application server feeds back the storage address of the next summary file to the application client according to the recorded interaction condition.

Fig. 5 is an example of automatically carousel large picture files. As shown in fig. 5, the large picture file is stored by splicing 100 screenshots in a manner of 10 × 10, and the 100 screenshots are arranged from left to right and from top to bottom in a time sequence. Responding to a preview request of a user, reversely splitting the large picture file into 10 rows and 10 columns of 100 screenshots according to an arrangement rule of the large picture file, and setting a play preview area of the preview window according to the size of a single screenshot, so that the size of the play preview area of the preview window is equal to the size of a single screenshot. When the preview is started, starting from the display of the first screenshot 501 in the preview window (the thick line screenshot is the currently displayed screenshot), after waiting for the preset time interval P, the large picture file is moved to the left by the width 502 of a single screenshot, so that the second screenshot 503 is displayed in the preview window (the thick line screenshot is the currently displayed screenshot, and the dotted line screenshot is the displayed screenshot), and thus, until the first line 504 of the large picture file is displayed (the dotted line screenshot is the displayed screenshot). The large picture file is then moved up by the height 505 of a single screenshot and moved to the right to the left-most screenshot 506 of the row (the thick line screenshot is the currently presented screenshot) to begin presentation of the next row of screenshots. And continuously repeating the process until all screenshots of the large picture file corresponding to the media content are displayed.

In this way, by controlling the predetermined time interval P, the large picture file can be controlled to move at a certain speed, thereby achieving the effect of video playing in the preview window.

Therefore, according to the method, in the process of searching the target media content by the user, the preview window is set for a certain candidate media content, and the summary file of the media content is played in the preview window, so that more information besides the media content information is provided for the user, the user can conveniently determine whether the candidate media content is the target media content required by the user, the searching efficiency is improved, unnecessary repeated searching is avoided, and hardware resources and network resources at a terminal side and a network side are saved.

In addition, in the above manner of automatically carousel the summary files, the size of each summary file may be controlled by controlling the number of the screenshots included in each large picture file and the resolution of each screenshot, for example, in general, the smaller the number of the screenshots included in one large picture file is, and the smaller the resolution of each screenshot is, the smaller the file size is; while a large picture file contains a larger number of shots and the higher the resolution of each shot, the larger its file size. Therefore, the method can realize the preview of the media content and the controllable transmission flow, namely realize the quick preview of the media content under the lower flow requirement, thereby providing richer information for users, improving the searching efficiency of the media content and further saving hardware and network resources.

On the basis of the media content searching process, the media content searching method may further include a process of adjusting a preview progress according to a play progress adjustment operation of the user, so as to achieve a goal of previewing the media content from each preview progress point desired by the user. As shown in fig. 2, the process of adjusting the preview progress may include:

step 205: and responding to the adjustment operation of the playing progress of the user, and acquiring the current operation position of the user in the preview window.

In some examples of the application, the operation of adjusting the playing progress may be an operation of sliding a cursor of a mouse to a certain position of the preview window by a user, where the determined current operation position of the user in the preview window is a position where the cursor of the current mouse is located.

In other examples of the application, the play progress adjusting operation may be an operation that a user clicks a certain position of the preview window with a mouse or a finger, where the determined operation position of the user currently in the preview window is a position clicked by the user in the preview window.

In some examples of the present application, the play progress adjusting operation may be an operation that a user clicks a certain position of the preview window with a mouse or a finger, and slides in the preview window, where the determined operation position of the user currently in the preview window is a position clicked by the user in the preview window and each position on a sliding track of the user.

Step 206: and determining the playing progress value of the media content corresponding to the operation position according to the current operation position of the user in the preview window.

In the embodiment of the present application, the playing progress value of the media content corresponding to the operation position may be determined according to the position of the operation position in the horizontal direction relative to the left frame and the right frame of the preview window, for example, may be determined according to the abscissa of the operation position.

Specifically, assuming that the preview window is rectangular, and the abscissa of the left frame and the abscissa of the right frame are located at the pixels of W1 and W2, respectively, the width of the preview window is W = W2-W1; when the operation of the user is detected to fall into the preview window, for example, when a mouse slides into the preview window or the user clicks a certain position in the preview window, acquiring an abscissa x of the current operation position of the user in the preview window, and calculating a playing progress value T = (x-W1)/(W2-W1) × S corresponding to the operation position, wherein S is the duration of the media content.

Step 207: and determining the position of the screenshot of the media content corresponding to the operation position in the summary file according to the playing progress value.

The application client can then play the summary file starting from the determined position.

In an embodiment of the present application, determining the position of the screenshot of the media content corresponding to the operation position in the summary file specifically means determining the summary file where the screenshot is located and the specific position of the screenshot in the summary file, that is, determining that the screenshot is in the first summary file and determining that the screenshot is in the first row and the second column of the summary file.

In the application, determining the summary file where the screenshot of the media content corresponding to the operation position is located according to the play progress value and the specific position of the summary file may be completed in the following manner: assuming that a time interval adopted when the application server performs screen capturing on the media content is a, each summary file of the media content is composed of P screenshots, each summary file is composed of R rows and S columns of screenshots, wherein R = S > = P, and the playing progress value corresponding to the operation position of the user is T, the summary file where the screenshot corresponding to the operation position is located may be obtained by rounding down a quotient of (T/a)/P, and a position of the screenshot in the summary file may be obtained by a remainder Y of (T/a)/P, for example, the quotient of Y/S is rounded down to obtain the row number where the screenshot is located, and the remainder of Y/S is obtained to obtain the column number where the screenshot is located.

For example, the left frame of the preview window has a horizontal coordinate of 0, the right frame of the preview window has a horizontal coordinate of 100, that is, the width W of the preview window has a width of 100 pixels, the total duration of the media content selected by the user for previewing is 2000s, and the application server performs screenshot every 10s when generating the summary file, to obtain 100 screenshots in total, and respectively arrange and splice every 100 screenshots into one large picture according to the time sequence, to obtain two large picture files spliced by 100 screenshots in 10 rows and 10 columns. When the user mouse slides to the position corresponding to the 75 th pixel of the preview window, it may be determined that the playing progress value of the media content corresponding to the position is (75-0)/(100-0) · 2000s =1500s, that is, the playing progress corresponding to the 75 th pixel position should be 1500s. Therefore, the playing progress 1500s corresponding to the 75 th pixel position of the user mouse position is calculated 150/100 to obtain that the quotient is rounded down to 1 and the remainder is 50, that is, the screenshot corresponding to the user mouse position is the 50 th screenshot of the 1 st summary file. Further, the screenshot could be determined to be in row 5, column 10 based on a 50/10 quotient and remainder.

Thus, with the method, when the user operates the mouse to make the cursor of the mouse fall at a certain position in the preview window or the user clicks a certain position in the preview window, the preview of the media content can be started from the screenshot corresponding to the position. Moreover, when the user operates the mouse to enable the cursor of the mouse to move in the preview window or the finger of the user slides in the preview window, the steps can be quickly completed according to each position contained in the moving track, and therefore the effect of quickly previewing the media content is achieved.

Accordingly, in order to implement the application client on the user terminal 11 to play the summary file of the media content, the example of the present application further provides a media content searching method, which is applied on the side of the application server 13. The method is mainly used for screen capturing of media content after uploading of the media content, such as in a coding and watermarking process, and at least one summary file corresponding to the media content is generated by extracting a plurality of image frames. Thereafter, the application server 13 receives a part of keywords input by the user and sent by the application client, determines corresponding text keywords according to the part of keywords, and then determines corresponding one or more media contents according to the text keywords; after the media content information of the one or more media contents and the storage address of the digest file are obtained, the media content information of the one or more media contents and the storage address of the digest file are sent to the application client on the user terminal 11 for displaying.

As described above, the summary file may be a large picture file or a moving picture file. Specifically, the application server may intercept multiple screenshots from the media content according to a predetermined frequency, and generate a large picture file or a moving picture file from the intercepted screenshots, thereby generating one or more summary files of the media content. In order to control the size of the summary file, the maximum number of screenshots contained in the large picture file or the moving picture file may be set, and thus, more than one summary file may be generated.

Fig. 6 is a flowchart of a media content searching method provided by an example of the present application. In the media content searching method shown in fig. 6, a large picture file is taken as an example of a summary file. As shown in fig. 6, the method comprises the steps of:

step 601: and intercepting a plurality of screenshots from the media content according to the frequency of intercepting one frame of image from the media content at intervals of a predetermined time interval O.

Here, O is a preset step value for extracting the key frame, and may generally take a value of 5 to 20 seconds, for example, 10 seconds, according to experience O.

Step 602: and splicing each P screenshots according to a preset splicing rule to generate a large picture file, and respectively using at least one generated large picture file as one or more abstract files of the media content.

Here, P is a natural number, which is the number of key frames included in each digest file set in advance. According to experience, P can generally take a value of 50-1000, for example 100, that is, every 100 screenshots are spliced and stored as a summary file. In addition, the predetermined splicing rule may specifically refer to arranging and splicing the extracted P screenshots together in a time sequence in a matrix form, for example, splicing 100 screenshots together in a time sequence from left to right in a matrix form of 10 rows and 10 columns, and storing the spliced screenshot in a summary file.

Thus, typically, one media content will correspond to multiple summary files. For example, if a movie is 120 minutes long, i.e. 7200 seconds, and the key frames, i.e. the cut pictures, are extracted every 10 seconds according to the empirical value, and every 100 cut pictures are put into one summary file, the movie should have 720 cut pictures in total, and the 720 cut pictures should be saved into 8 summary files respectively according to the sequence, wherein each of the first 7 summary files includes 100 cut pictures, and the last summary file includes 20 cut pictures.

For example, still taking fig. 5 as an example, as shown in fig. 5, the P screenshots are stored in a splicing manner of 10 × 10, so as to form a summary file formed by splicing 10 rows and 10 columns of screenshots. And the screenshot in the first row and the first column corresponds to an image of a frame at the beginning of the media content and the screenshot in the 10 th row and the 10 th column corresponds to an image of a frame of the media content at the 1000 th second.

Furthermore, the size of the screenshot can be adjusted by referring to the model of the display device in the user when the image of the media content is intercepted, that is, the display devices corresponding to different user terminals with different sizes, so that the images with different sizes are intercepted, and the abstract files corresponding to the screenshots with different sizes are generated. For example, corresponding to two sizes of user terminals with resolutions of 1024 × 768 and 1280 × 960, different sizes may be used for screenshot, so as to generate summary files corresponding to different user terminal display device models.

Step 603: according to a predetermined rule, the file name of the summary file is spliced to the domain name of a content delivery network (cdn), and then the storage address of the summary file is generated.

In the embodiment of the application, the URL of the summary file can be obtained by directly splicing the file name of the generated summary file with the domain name of the CDN, and thus, the URLs of all the summary files of the media content can be obtained, respectively, for example, https:// puui.qpic.cn/video _ caps/0/m0024qjk1k9.q1.1.jpg/0.

Step 604: receiving a part of keywords input by a user and sent by an application client, and determining corresponding text keywords according to the part of keywords.

Step 605: and determining one or more corresponding media contents according to the text keywords.

Step 606: and acquiring the media content information of the one or more media contents and the storage address of the summary file, and sending the media content information of the one or more media contents and the storage address of the summary file to an application client on the user terminal 11 for displaying.

As described above, the application server may feed back the storage address of the corresponding summary file to the application client while feeding back the media content information, or may feed back the storage address of the media content summary file requested by the user to the application client when the application client requests the storage address of the media content summary file. Moreover, when there are a plurality of summary files corresponding to one media content, the storage addresses of all the summary files can be fed back at one time, or only the storage address of one summary file can be fed back at one time according to the request of the application client.

Through the scheme, the application client can quickly preview the key frame screenshot of the media content in a mode of playing the large picture file in a motion picture carousel mode, on one hand, compared with a preview mode of a static poster, the preview mode has a more impact effect, a user can experience better, on the other hand, the user can obtain more information, so that the accuracy of the user in determining the search is improved, and the repeated operation of the user and the waste of resources are avoided. Meanwhile, compared with the media content, the summary file is very small, and the time required by transmission and the occupied network resources are very small, so that the waste of the network resources is further avoided.

Based on the system structure shown in fig. 1, an embodiment of the present application further provides a media content searching method, which is applicable to the application server 13, and can determine a corresponding media content list for the user to select according to a part of keywords input by the user and media contents associated with the part of keywords.

Fig. 7 shows a flowchart of a media content searching method provided by an embodiment of the present application. As shown in fig. 7, the method comprises the steps of:

step 701: and receiving a media content search request carrying partial keywords from the application client.

Here, the partial keyword may be query content input by a user when searching for the target media content. For example, when the user wants to search for the media content "speed and passion 8", a part of the keyword "speed" may be input as the query content, and a part of the keyword "passion" may also be input as the query content.

Step 702: and determining at least one text keyword according to the partial keywords.

Here, the text keyword may be a name of the target media content. For example, the title "speed and passion 8" of the movie "speed and passion 8".

In some instances, the application server 13 will typically maintain a library of candidate keywords to complete the search for media content. In this case, after receiving a part of the keywords input by the user sent by the application client, the application server 13 may perform fuzzy matching on the part of the keywords and the candidate keywords in the candidate keyword library to obtain one or more text keywords with the highest matching degree. For example, when the user inputs a partial keyword "three", a plurality of text keywords such as "sansheng sanshi shiehui", "new three kingdoms", etc. may be matched from the candidate keyword library.

Step 703: and sequencing the at least one text keyword according to the relevance degree of the part of keywords recorded by the user and the at least one text keyword.

It can be understood that the fuzzy matching method may match a very large number of text keywords when a part of the keywords input by the user has no strong degree of distinction, and thus may overwhelm the names of the media contents that the user really wants to search for. Also using the example above, when the user enters the partial keyword "three," the application server 13 may match a very large number of text keywords containing "three" from the candidate keyword library. The large amount of search results returned according to the text keywords can cause that the user can hardly find the target media content 'three generations and ten miles peach blossom' which the user wants to search quickly.

As such, in some instances, the application server 13 may pre-record the degree of association between the partial keywords and the text keywords. The relevance between the partial keywords and the text keywords represents a probability statistic value of media content corresponding to a text keyword, such as the number of times of selection or the proportion of the number of times of selection to all search times, when a user inputs a partial keyword for retrieval and finally selects a text keyword. The higher the degree of association between a certain part of keywords and a certain text keyword is, the higher the probability that the user finally selects the media content corresponding to the text keyword after inputting the part of keywords is. In a specific implementation, one or more relevance counters may be set for a part of the keywords, where each relevance counter is used to count the number of times of relevance between the part of the keywords and a certain text keyword, so as to record the degree of relevance between the part of the keywords and a certain text keyword. There is typically no statistics on such data at the beginning of the start-up of the application server 13. Therefore, when the user inputs a certain part of keywords, the application server 13 matches one or more text keywords from the candidate keyword library according to the part of keywords, and provides the media content information of the media content corresponding to the text keywords to the user for selection. At this time, if the user selects one of the media contents, it indicates that the partial keyword and the text keyword corresponding to the media content have a primary association, so that the association degree corresponding to the partial keyword and the text keyword can be increased by 1, that is, the association counter corresponding to the partial keyword and the text keyword is increased by 1 (if there is no corresponding association counter before the partial keyword and the text keyword, an association technologist corresponding to the partial keyword and the text keyword may be established first and the count value thereof is set to 1). By the method, after a large number of users search the media contents and find the target media contents which the users want to search, each part of keywords has a certain degree of association with the text keywords of one or more media contents.

In this case, after receiving a part of keywords input by the user, the application server 13 may not only perform matching in the candidate keyword library, but also rank the matched text keywords according to the degree of association between the part of keywords recorded by the application server 13 and the text keywords, so as to rank the text keywords with high degree of association with the part of keywords in front, thereby ranking media contents more likely to be selected by the user in front, so as to improve the search efficiency of the user.

For example, currently, "peach blossom in san sheng, san shi li", is a popular media content, and after the most statistical users input a partial keyword "three", they will finally select "peach blossom in san sheng, san shi li", finally. In this case, the highest degree of association between the partial keyword "three" and the text keyword "three generations, three times and ten days of peach blossom" can be obtained through the setting of the degree of association. Thus, when a user inputs a part of the keywords 'three', the text keywords 'three-life three-free ten-mile peaches' can be obtained through matching, and the text keywords 'three' can be ranked according to the relevance of the text keywords, so that the text keywords 'three-life three-month peaches' are ranked in front of other text keywords. Thus, the media content "Sansheng Sanshijiri peach blossom" will be ranked first in the final search results returned to the user.

In addition, if the number of the text keywords matched with part of the keywords is large, the first N text keywords with large association degrees can be reserved according to the association degrees, wherein N is a preset value.

Step 704: determining at least one media content corresponding to the at least one text keyword.

Since the text keyword may be the name of the target media content, the application server 13 may determine a text content according to a text keyword, and obtain the media content information of the text content.

Step 705: and feeding back the media content information of the corresponding media content to the application client according to the sequence of the at least one text keyword.

In some embodiments, the media content information includes some or all of the name of the media content, the starring actor, the poster, and the URL of the media content, among others.

In some embodiments of the present application, the method may further include: and updating the association degree of the partial keywords and the text keywords according to the text keywords corresponding to the media content which is finally selected and played by the user. That is, for example, 1 is added to the value of the association counter corresponding to the partial keyword and the text keyword.

In the method provided by the above embodiment, by setting the association degree between part of the keywords and the text keywords and sorting the media contents corresponding to the text keywords according to the association degree, an effect of sorting the candidate media contents according to the heat degree can be achieved, so that information of the media contents which are more likely to be selected by the user is displayed in front, thereby shortening the time for the user to search the media contents, improving the search efficiency of the user, avoiding unnecessary operations such as page turning, searching, browsing and the like, and saving hardware resources and network resources on the network side and the terminal side.

Furthermore, in some embodiments of the present application, the technical solutions of the two embodiments may be combined, that is, a preview function of the media content is provided for the user on the basis of sorting the media content according to the association degree, so as to further shorten the time for the user to search the media content, improve the search efficiency of the user, further avoid unnecessary operations such as downloading and playing the media content, and further save hardware resources and network resources on the network side and the terminal side.

In order to implement the above solution, as mentioned above, the application server 13 further needs to generate a summary file for each media content, and feed back the storage address of the summary file of the media content to the application client while feeding back the media content information. Therefore, after receiving a preview request of a user for certain media content, the application client can download the summary file of the media content according to the storage address of the summary file, and realize the rapid preview of the media content by playing the summary file.

Specifically, as mentioned above, the method for generating the summary file of the media content by the application server 13 and the method for browsing the summary file by the application client 11 have been described in detail above, and are not repeated herein.

Through the scheme, on one hand, the associated media contents are sequenced by associating part of keywords with the media contents and accumulating the association times, and the problems of errors and insufficient coverage caused by pure character association and media content name matching are solved. On the other hand, the method can realize the rapid preview of the key frame screenshot of the media content in a mode of playing the abstract file, has a more impact effect compared with a preview mode of a static poster, provides better experience for a user, and enables the user to obtain more information so as to improve the accuracy of the user for determining the search and avoid the repeated operation of the user and the waste of resources.

Corresponding to the above various media content searching methods, the application also provides an application client 800 for implementing the above methods.

In some examples of the present application, the application client 800 implementing the method for searching for media content may be implemented by a structure diagram shown in fig. 8A, including: the functions of the sending module 801, the receiving module 802, the displaying module 803 and the previewing module 804 are as follows:

a sending module 801 receives a media content search request carrying a part of keywords, and sends the part of keywords to an application server for media content search;

the receiving module 802 receives media content information of one or more media contents fed back by the application server;

the presentation module 803 presents the media content information of the one or more media contents;

the preview module 804 responds to a preview request of a user for a media content, downloads the summary file of the media content, and plays the summary file of the media content in a preview window corresponding to the media content.

In some examples, fig. 8B is an internal structure diagram of the presentation module 803, and as shown in fig. 9, the presentation module 803 includes an expansion unit 8031, a download unit 8032, and a preview unit 8033. Wherein, each unit function is as follows:

an expansion unit 8031 displaying part of the media content information of the one or more media contents in a list manner; in response to an expansion request for one media content in the list, displaying a display area of the media content and displaying a preview window of the media content and all media content information of the media content in the display area;

the downloading unit 8032, in response to a preview request of a user for a media content, downloads a summary file of the media content according to a storage address of the summary file; and

the preview unit 8033 plays the summary file of the media content in the preview window.

Specifically, when the summary file is a large picture file, the preview unit 8033 may include: the splitting submodule is used for reversely splitting the large picture file into a plurality of screenshots according to the splicing rule of the abstract file; the playing area setting submodule is used for setting a playing area in the preview window according to the size of a single screenshot; and the mobile playing sub-module is used for displaying a first screenshot in the playing area, and moving the large picture file according to a preset moving rule at a preset time interval T so as to display the next screenshot until the preview is finished.

The display module 803 may further include: the progress adjusting unit 8034 adjusts the preview progress according to the play progress adjusting operation of the user and the current operation position of the user in the preview window.

Specifically, the schedule adjustment unit 8034 includes: the operation position acquisition sub-module is used for responding to the play progress adjustment operation of the user and acquiring the current operation position of the user in the preview window; the playing progress determining submodule is used for determining a playing progress value of the media content corresponding to the operation position according to the current operation position of the user in the preview window; and the progress adjusting submodule is used for determining the position of the screenshot of the media content corresponding to the operation position in the summary file according to the playing progress value. The preview module may then continue to play the summary file from that location.

The specific operation method of the progress adjustment unit 8034 can refer to the above steps 205-207.

Fig. 9 shows a block diagram of a computing device 900 on which an application client 800 implementing the media content search method is located. As shown in fig. 9, the computing device includes one or more processors (CPUs) 902, a communications module 904, a memory 906, a user interface 910, and a communications bus 908 for interconnecting these components.

The processor 902 can receive and transmit data via the communication module 904 to enable network communications and/or local communications.

User interface 910 includes one or more output devices 912 including one or more speakers and/or one or more visual displays. The user interface 910 also includes one or more input devices 914, including, for example, a keyboard, a mouse, a voice command input unit or microphone, a touch screen display, a touch-sensitive tablet, a gesture-capture camera or other input buttons or controls, and the like.

The memory 906 may be a high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; or non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

The memory 906 stores a set of instructions executable by the processor 902, including:

an operating system 916 including programs for handling various basic system services and for performing hardware related tasks;

applications 918, including various applications for implementing media content search, can implement the process flows in the examples described above, such as some or all of the elements in user terminal 800 that may include the media content search method shown in fig. 8A. At least one of the units or modules 801-804 may store machine-executable instructions. The processor 902 may be capable of performing the functions of at least one of the respective modules 801-804 described above by executing machine-executable instructions in at least one of the respective modules 801-804 in the memory 906.

Corresponding to the above method for searching media content, the application also provides an application server 1000 for implementing the above method.

In some examples of the present application, the server 1000 implementing the method for searching for media content may be implemented by a structure diagram shown in fig. 10, and includes a digest file generation module 1001, a first receiving module 1002, a determination module 1003, and a first sending module 1004, where functions of the modules are as follows:

the summary file generation module 1001 is mainly used for extracting a plurality of image frames from a media content after the media content is uploaded, for example, during a process of encoding and watermarking, and generating at least one summary file of the media content.

The first receiving module 1002 is configured to receive a media content search request carrying a part of keywords from an application client, and determine one or more text keywords according to the part of keywords.

The determining module 1003 is configured to determine one or more media contents according to the text keyword, and acquire media content information of the one or more media contents and a storage address of the summary file.

The sending module 1004 is configured to feed back the media content information of the one or more media contents and the storage address of the summary file to the application client.

In an embodiment of the present application, when the summary file is a large picture file, the summary file generation module 1001 includes: a screenshot module 10011 and a stitching module 10012. The digest file generation module 1001 may further include an address generation module 10013.

The screenshot module 10011 is configured to capture a plurality of screenshots from the media content according to the frequency of capturing one frame of image from the media content at predetermined time intervals O.

The splicing module 10012 splices each P screenshots according to a predetermined splicing rule to generate a large picture file, and uses at least one generated large picture file as one or more summary files of the media content.

The address generating module 10013, according to a predetermined rule, concatenates the file name of the summary file with the domain name of the CDN, and then generates a storage address of the summary file.

In some embodiments of the present application, the application server 1000 may further include: and the sequencing module is used for recording the association degree of partial keywords and the text keywords and sequencing the at least one text keyword according to the association degree of the partial keywords and the at least one text keyword recorded by the sequencing module. At this time, the sending module 1004 feeds back the media content information of the one or more media contents and the storage address of the summary file to the application client according to the sequence of the at least one text keyword.

Through the scheme, the application server generates a summary file for each media content in advance, and the application client can play the summary file at the request of the user, namely, the quick preview of the key frame screenshot of the media content is realized through a moving picture carousel mode. Compared with a preview mode of a static poster, the mode has a more impact effect and gives a better experience to a user; on the other hand, the user can obtain more information, so that the accuracy of the user for determining the search is improved, unnecessary repeated operation of the user is avoided, and waste of hardware resources and network resources of the terminal side and the network side is avoided.

The embodiment of the application also provides an application server 1100 for implementing the method. In some examples of the present application, the server 1100 implementing the method for searching for media content may be implemented by a structure diagram shown in fig. 11, and includes a second receiving module 1101, a first determining module 1102, a sorting module 1103, a second determining module 1104 and a second sending module 1105, where functions of the modules are as follows:

a second receiving module 1101, which receives a part of keywords input by the user sent by the application client;

a first determining module 1102, determining at least one text keyword according to the partial keywords;

a sorting module 1103, configured to record association degrees of a part of keywords and text keywords, and sort the at least one text keyword according to the association degrees of the part of keywords and the at least one text keyword recorded by the sorting module;

a second determining module 1104, determining at least one media content corresponding to the at least one text keyword; and

the second sending module 1105 feeds back the media content information of the corresponding media content to the application client according to the order of the at least one text keyword.

In some examples of the present application, the server 1100 implementing the method for searching for media content further includes: the establishing module 1106 updates the association degree between the partial keywords and the text keywords corresponding to the media content according to the partial keywords input by the user and the media content selected to click.

In some examples, the establishing module 1106 further sets an association counter for counting the association times of each partial keyword with a text keyword corresponding to a certain media content. Responding to the media content searching operation of inputting a certain part of keywords by a user and the operation of clicking a certain media content on a searching result page, and adding 1 to the relevant counter corresponding to the part of keywords and the text keywords corresponding to the media content. At this time, the value of the association counter is the number of associations between the partial keywords and the text keywords corresponding to the media content.

In some examples, the sorting module 1103 may further retain N text keywords before the relevance after the sorting, where N is a preset value.

The application server of the embodiment can realize the effect of ordering the candidate media contents according to the heat by setting the association degree between part of the keywords and the text keywords and ordering the media contents corresponding to the text keywords according to the association degree, so that the information of the media contents which are more likely to be selected by the user is displayed in front, the time for searching the media contents by the user is shortened under the condition of large probability, the searching efficiency of the user is improved, unnecessary operations such as page turning, searching and browsing are avoided, and the hardware resources and the network resources of a network side and a terminal side are saved.

In some examples of the present application, the application server 1100 implementing the method for searching for media content may further include the digest file generation module 1001. In this case, the second sending module 1105 further feeds back the summary file of the media content to the application client when feeding back the media content information of the media content.

Through the scheme, on one hand, the associated media contents are sequenced by associating part of keywords with the media contents and accumulating the association times, and the problems of errors and insufficient coverage caused by pure character association and media content name matching are solved. On the other hand, the method can realize the quick preview of the key frame screenshot of the media content in a mode of playing the abstract file, has a more impact effect compared with a preview mode of a static poster, provides better experience for a user, and simultaneously enables the user to obtain more information, thereby improving the accuracy of the user for determining the search and avoiding the waste of repeated operation and resources of the user.

Fig. 12 shows a block diagram of a computing device 1200 in which an

application server

1000 or 1100 implementing the media content search method is located. As shown in fig. 12, the computing device includes one or more processors (CPUs) 1202, a communications module 1204, a memory 1206, a user interface 1210, and a communications bus 1208 interconnecting these components.

The processor 1202 may receive and transmit data via the communication module 1204 to enable network communications and/or local communications.

The user interface 1210 includes one or more output devices 1212 including one or more speakers and/or one or more visual displays. The user interface 1210 also includes one or more input devices 1214, including, for example, a keyboard, a mouse, a voice command input unit or microphone, a touch screen display, a touch sensitive tablet, a gesture capture camera or other input buttons or controls, and the like.

The memory 1206 may be a high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices; or non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

The memory 1206 stores a set of instructions executable by the processor 1202, including:

an operating system 1216 including programs for handling various basic system services and for performing hardware related tasks;

applications 1218, including various applications for implementing media content searches, may implement the process flows of the examples described above, and may include some or all of the elements of application server 1000 shown in fig. 10 or some or all of the elements of application server 1100 shown in fig. 11, for example. At least one of the units or modules 1001-1004 or 1101-1106 may store machine executable instructions. The processor 1202 may be capable of performing the functions of at least one of the modules 1001-1004 or 1101-1106 described above by executing machine-executable instructions in at least one of the modules 1001-1004 or 1101-1106 in the memory 1206.

It should be noted that not all steps and modules in the above flows and structures are necessary, and some steps or modules may be omitted according to actual needs. The execution order of the steps is not fixed and can be adjusted as required. The division of each module is only for convenience of describing adopted functional division, and in actual implementation, one module may be divided into multiple modules, and the functions of multiple modules may also be implemented by the same module, and these modules may be located in the same device or in different devices.

The hardware modules in the embodiments may be implemented in hardware or a hardware platform plus software. The software includes machine-readable instructions stored in a non-volatile storage medium. Thus, embodiments may also be embodied as software products.

Accordingly, some examples of the present application also provide a computer-readable storage medium having computer instructions stored thereon, wherein the computer instructions, when executed by a processor, implement the steps of the method of any of the above-described figures 2-7.

In various examples, the hardware may be implemented by specialized hardware or hardware executing machine-readable instructions. For example, the hardware may be specially designed permanent circuits or logic devices (e.g., special purpose processors, such as FPGAs or ASICs) for performing the specified operations. The hardware may also include programmable logic devices or circuits temporarily configured by software (e.g., including a general purpose processor or other programmable processor) to perform certain operations.

In addition, each example of the present application may be realized by a data processing program executed by a data processing apparatus such as a computer. It is clear that a data processing program constitutes the present application. In addition, a data processing program stored in one storage medium is generally executed by directly reading the program out of the storage medium or by installing or copying the program into a storage device (such as a hard disk and or a memory) of a data processing device. Such a storage medium therefore also constitutes the present application, which also provides a non-volatile storage medium in which a data processing program is stored, which data processing program can be used to carry out any one of the above-mentioned method examples of the present application.

Machine readable instructions corresponding to the modules in fig. 10 and 12 may cause an operating system or the like operating on the computer to perform some or all of the operations described herein. The nonvolatile computer-readable storage medium may be a memory provided in an expansion board inserted into the computer or written to a memory provided in an expansion unit connected to the computer. A CPU or the like mounted on the expansion board or the expansion unit may perform part or all of the actual operations according to the instructions.

In addition, the apparatuses and modules in the examples of the present application may be integrated into one processing unit, or each module may exist alone physically, or two or more apparatuses or modules may be integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. A media content search method, wherein the method comprises:

receiving a media content search request carrying part of keywords;

sending the partial keywords to an application server for media content search;

receiving media content information of one or more media contents fed back by the application server;

media content information that presents the one or more media content;

responding to a preview request of a user for media content, and downloading a summary file of the media content; the summary file is a large picture file which is generated by an application server according to a plurality of image frames extracted from the media content and corresponds to the media content; and

reversely splitting the large picture file into a plurality of screenshots according to the splicing rule of the large picture file;

setting a playing area of a preview window according to the size of the single screenshot;

displaying a first screenshot in the playing area; and

moving the large picture file according to a preset moving rule at intervals of a preset time interval, and displaying a next screenshot until the preview is finished;

the moving the large picture file according to a predetermined moving rule includes:

A. moving the large picture file to the left by the width of a single screenshot at preset time intervals until one row of screenshots of the large picture file are displayed;

B. and moving the large picture file upwards by the height of a single screenshot, moving the large picture file to the left of the leftmost screenshot in the row, and then returning to the step A to start displaying the screenshot in the next row.

2. The method of claim 1, wherein the media content information presenting the one or more media content comprises:

respectively setting a display area for the one or more media contents on the page, and respectively displaying the media content information of the corresponding media contents in the display area; wherein the preview window is disposed at a predetermined position within a presentation area of each media content; or

Displaying part of the media content information of the one or more media contents on a page in a list manner; in response to an expansion request for a media content, displaying a display area of the media content and displaying a preview window of the media content and all media content information of the media content in the display area.

3. The method according to claim 1, wherein the summary file of the media content is a motion picture file generated by an application server from a plurality of image frames extracted from the media content;

the playing the summary file of the media content in the preview window corresponding to the media content comprises: and running the moving picture file in the preview window.

4. The method of claim 1, wherein the method further comprises:

responding to the adjustment operation of the playing progress, and acquiring the current operation position of the user in the preview window;

determining a playing progress value of the media content corresponding to an operation position according to the current operation position of a user in a preview window; and

determining the position of the screenshot of the media content corresponding to the operation position in an abstract file according to the playing progress value; and

playing the summary file from the determined position.

5. The method of claim 4, wherein the determining the progress value of the media content corresponding to the operation position comprises: determining a playing progress value of the media content corresponding to the operation position according to the positions of the operation position relative to the left frame and the right frame of the preview window in the horizontal direction;

determining the position of the screenshot of the media content corresponding to the operation position in the summary file according to the playing progress value comprises: determining the position of the screenshot of the media content corresponding to the operation position in the summary file according to a formula (T/a)/P; wherein, T is a playing progress value corresponding to the operation position; a is a time interval adopted when the application server carries out screen capture on the media content; the number of the screenshots contained in each summary file of the media content is P; the quotient of (T/a)/P is rounded down to be the summary file where the screenshot corresponding to the operation position is located; and the remainder of (T/a)/P is the position of the screenshot corresponding to the operation position in the summary file.

6. A media content searching method, wherein the method comprises:

after a piece of media content is uploaded, extracting a plurality of image frames from the media content to generate at least one summary file of the media content, wherein the summary file comprises a large picture file;

receiving a media content search request carrying partial keywords from an application client;

determining one or more text keywords according to the partial keywords;

one or more media contents determined according to the one or more text keywords;

acquiring the media content information of the one or more media contents and the storage address of the summary file;

feeding back the media content information of the one or more media contents and the storage address of the summary file to the application client, and reversely splitting the large picture file into a plurality of screenshots by the application client according to the splicing rule of the large picture file; setting a playing area of a preview window according to the size of the single screenshot; displaying a first screenshot in the playing area; moving the large picture file according to a preset moving rule at intervals of a preset time interval, and displaying a next screenshot until the preview is finished; the moving the large picture file according to the predetermined moving rule includes: A. moving the large picture file to the left by the width of a single screenshot at preset time intervals until one row of screenshots of the large picture file are displayed; B. and moving the large picture file upwards by the height of a single screenshot, moving the large picture file to the left of the leftmost screenshot in the row, and then returning to the step A to start displaying the screenshot in the next row.

7. The method of claim 6, wherein said extracting a plurality of image frames from said media content, generating at least one summary file of said media content comprises:

intercepting a plurality of screenshots from the media content according to the frequency of intercepting one frame of image from the media content at intervals of predetermined time;

splicing each P screenshots according to a preset splicing rule to generate the large picture file; wherein P is a natural number; and

and taking the generated at least one large picture file as one or more summary files of the media content.

8. The method of claim 7, wherein the summary file further comprises an animation file; the extracting a plurality of image frames from the media content, and the generating at least one summary file of the media content comprises:

intercepting a frame of image from the media content at a predetermined time interval O, and intercepting a plurality of screenshots from the media content;

generating the motion picture file by each P screenshots; wherein P is a natural number; and

and taking the generated at least one motion picture file as one or more summary files of the media content.

9. The method according to claim 7 or 8, wherein when capturing one frame of image of the media content, the size of the screenshot is adjusted corresponding to different models of display devices of different user terminals, the images with different sizes are captured, and summary files corresponding to different models of display devices are generated; and

the feeding back the storage address of the summary file to the application client comprises: and determining a summary file corresponding to the model of the display equipment according to the model of the display equipment of the user terminal where the application client is located, and feeding back a storage address of the summary file corresponding to the model of the display equipment to the application client.

10. The method of claim 8, wherein the method further comprises:

after one or more text keywords are determined according to the partial keywords, sequencing the at least one text keyword according to the relevance degree of the partial keywords and the at least one text keyword recorded by the user; the relevancy of the partial keywords and the text keywords represents that a user inputs a partial keyword for retrieval and finally selects a probability statistic value of the media content corresponding to the text keyword; and

the feeding back the media content information of the one or more media contents and the storage address of the summary file to the application client comprises: and feeding back the media content information of the corresponding media content and the storage address of the abstract file to the application client according to the sequence of the at least one text keyword.

11. The method of claim 10, wherein the method further comprises: and updating the association degree of the partial keywords and the text keywords according to the text keywords corresponding to the media content which is finally selected and played by the user.

12. A media content searching method, wherein the method comprises:

determining one or more text keywords according to the partial keywords;

sequencing the at least one text keyword according to the relevance degree of the partial keywords recorded by the user and the at least one text keyword; the relevancy of the partial keywords and the text keywords represents the probability statistic value of the media content corresponding to one text keyword which is input by a user for retrieval and finally selected;

acquiring media content information of the one or more media contents and a storage address of a summary file, wherein the summary file is a large picture file corresponding to the media content and generated according to a plurality of image frames extracted from the media content;

feeding back media content information of corresponding media content and a storage address of the summary file to the application client according to the sequence of the at least one text keyword, wherein the application client responds to a preview request of a user for the media content and downloads the summary file of the media content; reversely splitting the large picture file into a plurality of screenshots according to the splicing rule of the large picture file in the abstract file; setting a playing area of a preview window according to the size of a single screenshot; displaying a first screenshot in the playing area; moving the large picture file according to a preset moving rule at intervals of preset time, and displaying a next screenshot until the preview is finished; the moving the large picture file according to a predetermined moving rule includes: A. moving the large picture file to the left by the width of a single screenshot at preset time intervals until one row of screenshots of the large picture file are displayed; B. and moving the large picture file upwards by the height of a single screenshot, moving the large picture file to the left of the leftmost screenshot in the row, and then returning to the step A to start displaying the screenshot in the next row.

13. The method of claim 12, wherein the method further comprises: and updating the association degree of the partial keywords and the text keywords according to the text keywords corresponding to the media content which is finally selected and played by the user.

14. A user terminal, wherein the user terminal comprises:

the preview module is used for responding to a preview request of a user for one media content, downloading a large picture file of the media content, and reversely splitting the large picture file into a plurality of screenshots according to a splicing rule of the large picture file; setting a playing area of a preview window according to the size of the single screenshot; displaying a first screenshot in the playing area; moving the large picture file according to a preset moving rule at intervals of preset time, displaying a next screenshot until the preview is finished, and playing the summary file of the media content in a preview window corresponding to the media content; the moving the large picture file according to the predetermined moving rule includes: A. moving the large picture file to the left by the width of a single screenshot at preset time intervals until one row of screenshots of the large picture file are displayed; B. and moving the large picture file upwards by the height of a single screenshot, moving the large picture file to the left of the leftmost screenshot in the row, and then returning to the step A to start displaying the screenshot in the next row.

15. An application server, wherein the application server comprises:

the summary file generation module is used for extracting a plurality of image frames from the media content and generating at least one summary file of the media content, wherein the summary file comprises a large picture file;

the sending module is used for feeding back the media content information of the one or more media contents and the storage address of the summary file to the application client, and the application client reversely splits the large picture file into a plurality of screenshots according to the splicing rule of the large picture file; setting a playing area of a preview window according to the size of a single screenshot; displaying a first screenshot in the playing area; moving the large picture file according to a preset moving rule at intervals of preset time, and displaying a next screenshot until the preview is finished; the moving the large picture file according to the predetermined moving rule includes: A. moving the large picture file to the left by the width of a single screenshot at preset time intervals until one row of screenshots of the large picture file are displayed; B. and moving the large picture file upwards by the height of a single screenshot, moving the large picture file to the left-most screenshot of the row rightwards, and returning to the step A to start displaying the next row of screenshots.

16. An application server, wherein the application server comprises:

the sending module is used for feeding back the media content information of the corresponding media content and the storage address of the summary file to the application client according to the sequence of the at least one text keyword, and the application client responds to a preview request of a user for the media content and downloads the summary file of the media content; reversely splitting the large picture file into a plurality of screenshots according to the splicing rule of the large picture file in the abstract file; setting a playing area of a preview window according to the size of the single screenshot; displaying a first screenshot in the playing area; moving the large picture file according to a preset moving rule at intervals of preset time, and displaying a next screenshot until the preview is finished; the moving the large picture file according to the predetermined moving rule includes: A. moving the large picture file to the left by the width of a single screenshot at preset time intervals until one row of screenshots of the large picture file are displayed; B. and moving the large picture file upwards by the height of a single screenshot, moving the large picture file to the left of the leftmost screenshot in the row, and then returning to the step A to start displaying the screenshot in the next row.

17. A storage medium having stored thereon machine readable instructions for causing at least one processor to perform the method of any one of claims 1-13.