CN113032587A

CN113032587A - Multimedia information recommendation method, system, device, terminal and server

Info

Publication number: CN113032587A
Application number: CN201911355850.2A
Authority: CN
Inventors: 胡伟松; 张翼
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2019-12-25
Filing date: 2019-12-25
Publication date: 2021-06-25
Anticipated expiration: 2039-12-25
Also published as: CN113032587B

Abstract

The disclosure relates to a multimedia information recommendation method, a system, a device, a terminal and a server, and belongs to the technical field of internet. The system comprises: a terminal and a server cluster; storing a second multimedia information base in each server in the server cluster; the terminal sends recommendation requests to a plurality of servers in the server cluster; for each server in the server cluster, the server receives a recommendation request, and determines the matching degree between the multimedia information according to the first information identifier; determining at least one first target multimedia information from a second multimedia information base according to the matching degree, and returning a recommendation result to the terminal, wherein the recommendation result comprises the at least one first target multimedia information; and the terminal receives the recommendation result returned by each server in the server cluster and displays the recommendation result in a recommendation interface. The server can determine a recommendation result according to the current latest second multimedia information base when receiving the recommendation request, and the recommendation accuracy is high.

Description

Multimedia information recommendation method, system, device, terminal and server

Technical Field

The present disclosure relates to the field of internet technologies, and in particular, to a multimedia information recommendation method, system, device, terminal, and server.

Background

With the development of internet technology, users can obtain desired content through various clients. The client can also recommend content to the user that may be of interest to the user based on the user's behavioral preferences. For example, the client is a short video client, a user browses short videos through the short video client, and a server corresponding to the short video client can determine target short videos which are possibly interested by the user according to the short videos browsed by the user historically and send the target short videos to the short video client. And recommending the target short videos which may be interested in the short videos to the user in a recommendation interface of the short video client.

In the related art, a server acquires a short video library; for each short video in the short video library, determining at least one target short video with the matching degree of the short video exceeding a certain threshold; the identification of the short video and the identification of the at least one target short video are stored in a buffer. If the server receives a recommendation request sent by the client; determining at least one target short video identifier with the matching degree of the short video exceeding a certain threshold from a cache region according to the short video identifier carried in the recommendation request; and returning the identification of the at least one target short video to the short video client. The short video client determines at least one target short video according to the identifier of the at least one target short video; and displaying at least one target short video in a recommendation interface of the short video client.

In the related art, the server needs to determine a target short video corresponding to each short video in the short video library in advance, and store an identifier of each short video and an identifier of the target short video corresponding to each short video in the cache region. And if the recommendation request is received, acquiring the identifier of the target short video corresponding to the identifier of the short video carried by the recommendation request from the buffer area. The identification of the target short video stored in the cache region cannot be updated in time along with the updating of the short video in the short video library, so that the recommendation accuracy is low.

Disclosure of Invention

The embodiment of the disclosure provides a multimedia information recommendation method, a multimedia information recommendation system, a multimedia information recommendation device, a multimedia information recommendation terminal and a multimedia information recommendation server, and can solve the problem of low recommendation accuracy. The technical scheme is as follows:

according to an aspect of the embodiments of the present disclosure, a multimedia information recommendation method is provided, where the method is applied in a terminal, and includes:

sending recommendation requests to a plurality of servers in a server cluster, wherein the recommendation requests carry first information identifiers of reference multimedia information, a first multimedia information base is stored in the server cluster, a second multimedia information base is stored in each server, and the second multimedia information base comprises part of multimedia information in the first multimedia information base; each server is used for determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identification; determining at least one first target multimedia message from a second multimedia information base stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia information base stored by the server; returning a recommendation result to the terminal, wherein the recommendation result comprises the at least one first target multimedia information;

receiving a recommendation result returned by each server, wherein the recommendation result comprises at least one first target multimedia message;

and displaying at least one first target multimedia information in the recommendation results returned by the plurality of servers in a recommendation interface.

In a possible implementation manner, the recommendation result further includes a matching degree between each first target multimedia information and the reference multimedia information;

the displaying of at least one first target multimedia information in the recommendation results returned by the plurality of servers in a recommendation interface includes:

according to the matching degree between each first target multimedia information and the reference multimedia information, selecting a preset number of first target multimedia information with the highest matching degree from a plurality of first target multimedia information in the recommendation results of the plurality of servers;

and displaying the first target multimedia information with the highest matching degree and the preset number in the recommendation interface.

According to an aspect of the embodiments of the present disclosure, a multimedia information recommendation method is provided, where the method is applied to any one server in a server cluster, where the server cluster stores a first multimedia information base, each server stores a second multimedia information base, and the second multimedia information base includes part of multimedia information in the first multimedia information base; the method comprises the following steps:

receiving a recommendation request sent by a terminal, wherein the recommendation request carries a first information identifier of reference multimedia information;

according to the first information identification, determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server;

determining at least one first target multimedia message from a second multimedia information base stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia information base stored by the server;

and returning a recommendation result to the terminal, wherein the recommendation result comprises the at least one first target multimedia information.

In a possible implementation manner, before determining, according to the first information identifier, a matching degree between the reference multimedia information and each multimedia information in a second multimedia information library stored by the server, the method further includes:

if the second information identifier of at least one second target multimedia information corresponding to the first information identifier exists in the cache region, obtaining the at least one second information identifier from the cache region, wherein the cache region is used for caching the recommendation result of the historical recommendation request;

and if the second information identifier of at least one second target multimedia information corresponding to the first information identifier does not exist in the cache region, executing the step of determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identifier.

In another possible implementation manner, the method further includes:

counting the cache duration of each first information identifier stored in the cache region;

and deleting a first information identifier of which the caching duration exceeds the preset duration and a second information identifier of at least one second target multimedia information corresponding to the first information identifier.

In another possible implementation manner, the determining, according to the first information identifier, a matching degree between the reference multimedia information and each multimedia information in a second multimedia information library stored by the server includes:

according to the first information identification, determining a first feature vector of the reference multimedia information from the corresponding relation between the information identification and the feature vector, wherein the first feature vector is used for identifying the feature of the reference multimedia information, and for each multimedia information in the second multimedia information base, determining a second feature vector of the multimedia information from the corresponding relation between the information identification and the feature vector according to a third information identification of the multimedia information;

and determining the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base according to the first characteristic vector and the second characteristic vector.

In another possible implementation manner, before determining a first feature vector of the reference multimedia information according to the first information identifier, where the first feature vector is used to identify a feature of the reference multimedia information, and determining a second feature vector of the multimedia information for each multimedia information in the second multimedia information library, the method further includes:

reading multimedia information from the message queue, and storing the multimedia information in the second multimedia information base;

reading the multimedia information from the second multimedia information base, and extracting a feature vector of the multimedia information;

and associating the information identification of the multimedia information with the feature vector of the multimedia information.

In another possible implementation manner, the determining, according to the first feature vector and the second feature vector, a matching degree between the reference multimedia information and each multimedia information in the second multimedia information library includes:

according to the first feature vector and the second feature vector, determining a first position point corresponding to the first feature vector and a second position point corresponding to the second feature vector from a multimedia information index structure;

determining a distance between the first location point and the second location point;

determining the distance as a matching degree between the reference multimedia information and the multimedia information;

wherein the multimedia information index structure comprises position points mapped by feature vectors of the multimedia information.

In another possible implementation manner, the method further includes:

acquiring a fourth information identifier from a white list in which the information identifiers of the multimedia information are stored;

acquiring a feature vector of the multimedia information corresponding to the fourth information identifier according to the fourth information identifier;

and establishing a multimedia information index structure according to the feature vector of the multimedia information corresponding to the fourth information identifier.

According to an aspect of the embodiments of the present disclosure, there is provided a multimedia information recommendation system, the system including: the system comprises a terminal and a server cluster, wherein the server cluster comprises a plurality of servers; the method comprises the steps that a first multimedia information base is stored in a server cluster, a second multimedia information base is stored in each server, and the second multimedia information base comprises part of multimedia information in the first multimedia information base;

the terminal is used for sending recommendation requests to a plurality of servers in the server cluster, wherein the recommendation requests carry first information identifiers of reference multimedia information;

for each server in the server cluster, the server is configured to receive the recommendation request, and determine, according to the first information identifier, a matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server; determining at least one first target multimedia message from a second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server, and returning a recommendation result to the terminal, wherein the recommendation result comprises the at least one first target multimedia message;

the terminal is further configured to receive recommendation results returned by each server in the server cluster, and display at least one first target multimedia information in the recommendation results returned by the plurality of servers in a recommendation interface.

According to another aspect of the embodiments of the present disclosure, there is provided a multimedia information recommendation apparatus, which is applied in a terminal, including:

the system comprises a first sending module, a second sending module and a third sending module, wherein the first sending module is configured to execute sending of recommendation requests to a plurality of servers in a server cluster, the recommendation requests carry first information identifiers of reference multimedia information, a first multimedia information base is stored in the server cluster, a second multimedia information base is stored in each server, and the second multimedia information base comprises part of multimedia information in the first multimedia information base; each server is used for determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identification; determining at least one first target multimedia message from a second multimedia information base stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia information base stored by the server; returning a recommendation result to the terminal, wherein the recommendation result comprises the at least one first target multimedia information;

the first receiving module is configured to execute receiving of a recommendation result returned by each server, and the recommendation result comprises at least one first target multimedia message;

and the display module is configured to display at least one first target multimedia information in the recommendation results returned by the plurality of servers in a recommendation interface.

In a possible implementation manner, the recommendation result further includes a matching degree between each first target multimedia information and the reference multimedia information; the display module is further configured to select a preset number of first target multimedia information with the highest matching degree from a plurality of first target multimedia information in the recommendation results of the plurality of servers according to the matching degree between each first target multimedia information and the reference multimedia information; and displaying the first target multimedia information with the highest matching degree and the preset number in the recommendation interface.

According to another aspect of the embodiments of the present disclosure, a multimedia information recommendation apparatus is provided, where the apparatus is applied to any server in a server cluster, where the server cluster stores a first multimedia information base, and each server stores a second multimedia information base, where the second multimedia information base includes part of multimedia information in the first multimedia information base; the device comprises:

the second receiving module is configured to execute a recommendation request sent by a receiving terminal, wherein the recommendation request carries a first information identifier of reference multimedia information;

a determining module configured to perform determining a matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identification; determining at least one first target multimedia message from a second multimedia information base stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia information base stored by the server;

and the second sending module is configured to execute the return of a recommendation result to the terminal, wherein the recommendation result comprises the at least one first target multimedia information.

In one possible implementation, the apparatus further includes:

the obtaining module is configured to execute, if a second information identifier of at least one second target multimedia information corresponding to the first information identifier exists in a cache region, obtaining the at least one second information identifier from the cache region, where the cache region is used for caching a recommendation result of a history recommendation request; and if the second information identifier of at least one second target multimedia information corresponding to the first information identifier does not exist in the cache region, executing the step of determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identifier.

In another possible implementation manner, the apparatus further includes:

the counting module is configured to perform counting on the cache duration of each first information identifier stored in the cache region;

the deleting module is configured to delete a first information identifier of which the caching duration exceeds a preset duration and a second information identifier of at least one second target multimedia information corresponding to the first information identifier.

In another possible implementation manner, the determining module is further configured to perform determining, according to the first information identifier, a first feature vector of the reference multimedia information from a corresponding relationship between an information identifier and a feature vector, the first feature vector being used for identifying a feature of the reference multimedia information, and for each multimedia information in the second multimedia information base, determining, according to a third information identifier of the multimedia information, a second feature vector of the multimedia information from a corresponding relationship between an information identifier and a feature vector; and determining the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base according to the first characteristic vector and the second characteristic vector.

In another possible implementation manner, the apparatus further includes:

a storage module configured to perform reading multimedia information from a message queue, storing the multimedia information in the second multimedia information base;

the extraction module is configured to read the multimedia information from the second multimedia information base and extract the feature vector of the multimedia information;

an association module configured to perform associating the information identification of the multimedia information with the feature vector of the multimedia information.

In another possible implementation manner, the determining module is further configured to perform determining, according to the first feature vector and the second feature vector, a first location point corresponding to the first feature vector and a second location point corresponding to the second feature vector from a multimedia information index structure; determining a distance between the first location point and the second location point; determining the distance as a matching degree between the reference multimedia information and the multimedia information; wherein the multimedia information index structure comprises position points mapped by feature vectors of the multimedia information.

In another possible implementation manner, the apparatus further includes:

the obtaining module is further configured to perform obtaining a fourth information identifier from a white list in which information identifiers of multimedia information are stored; acquiring a feature vector of the multimedia information corresponding to the fourth information identifier according to the fourth information identifier;

and the establishing module is configured to execute the characteristic vector of the multimedia information corresponding to the fourth information identifier to establish a multimedia information index structure.

According to another aspect of the embodiments of the present disclosure, a terminal is provided, where the terminal includes a processor and a memory, where the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the method for recommending multimedia information according to any of the foregoing possible implementation manners.

According to another aspect of the embodiments of the present disclosure, there is provided a server, where the server includes a processor and a memory, where the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the method for recommending multimedia information according to any of the above possible implementation manners.

According to another aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, where at least one instruction is stored, and the at least one instruction is loaded and executed by a processor to implement the method for recommending multimedia information according to any of the above-mentioned possible implementation manners.

According to another aspect of the embodiments of the present disclosure, there is provided a computer program product, wherein instructions of the computer program product, when executed by a processor of a terminal or a server, enable the terminal or the server to execute the multimedia information recommendation method described in any one of the above possible implementation manners.

In the embodiment of the disclosure, a terminal sends a recommendation request to a plurality of servers in a server cluster; and the server receives a recommendation request sent by the terminal, and determines a recommendation result according to the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base. The server can determine a recommendation result according to the current latest second multimedia information base when receiving the recommendation request, and the recommendation accuracy is high. And each server in the server cluster stores part of the multimedia information in the first multimedia information base, and the size of the data volume of the multimedia information stored in the first multimedia information base is not limited by the maximum memory capacity of a single server any more. And the terminal sends recommendation requests to a plurality of servers in the server cluster, the plurality of servers can perform parallel computation, the load pressure of a single server is reduced, the computation efficiency can be improved, and the time consumption for the server to return a recommendation result to the terminal is reduced, so that the multimedia information recommendation system can improve the recommendation accuracy and improve the recommendation speed.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.

FIG. 1 is a schematic diagram illustrating a multimedia information recommendation system in accordance with an exemplary embodiment;

FIG. 2 is a flow diagram illustrating a method for multimedia information recommendation, according to an example embodiment;

FIG. 3 is a flow diagram illustrating a method for multimedia information recommendation, according to an example embodiment;

FIG. 4 is a block diagram illustrating a multimedia information recommendation apparatus according to an exemplary embodiment;

FIG. 5 is a block diagram illustrating a multimedia information recommendation apparatus according to an exemplary embodiment;

FIG. 6 is a block diagram illustrating a terminal in accordance with an exemplary embodiment;

FIG. 7 is a block diagram illustrating a server in accordance with an example embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

The user information to which the present disclosure relates may be information authorized by the user or sufficiently authorized by each party.

FIG. 1 is a schematic diagram illustrating a multimedia information recommendation system according to an exemplary embodiment. Referring to fig. 1, the multimedia information recommendation system includes: the system comprises a terminal and a server cluster, wherein the server cluster comprises a plurality of servers; the server cluster stores a first multimedia information base, each server stores a second multimedia information base, and the second multimedia information base comprises part of multimedia information in the first multimedia information base.

The first multimedia information base comprises all multimedia information uploaded to the server cluster by the terminal. The server cluster is divided into a plurality of shards, and each shard is deployed in each server in the server cluster. The multimedia information uploaded by the terminal can be temporarily stored in a plurality of BTQueue (message queues), each server in the server cluster respectively reads the multimedia information from the corresponding message queue, and stores the read multimedia information in the second multimedia information base. The second multimedia information base comprises part of multimedia information in the first multimedia information base. The multimedia information in the second multimedia information base stored in each server is different. For example, the server cluster includes 5 servers, and the terminal uploads 10 pieces of multimedia information to the server cluster, so that the second multimedia information library stored in each server in the server cluster may include 2 pieces of multimedia information, respectively. Each server in the server cluster can equally distribute all multimedia information uploaded by the terminal, can randomly distribute all multimedia information uploaded by the terminal, and can distribute all multimedia information uploaded by the terminal through a certain rule. In the embodiment of the present disclosure, a method for distributing all multimedia information uploaded by a terminal to each server in a server cluster is not specifically limited.

The terminal in the multimedia information recommendation system is used for sending recommendation requests to a plurality of servers in a server cluster, wherein the recommendation requests carry first information identifiers of reference multimedia information.

The terminal may send the recommendation request to each of the plurality of servers in the server cluster, or the terminal may send the recommendation request to some of the plurality of servers in the server cluster.

Each server in the server cluster receives the recommendation request, and determines the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the reference multimedia information according to the first information identifier; determining at least one first target multimedia message from a second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server, and returning the at least one first target multimedia message to the terminal;

the terminal in the multimedia information recommendation system is further used for receiving at least one first target multimedia information returned by each server in the server cluster and displaying the at least one first target multimedia information returned by each server in the recommendation interface.

Fig. 2 is a flowchart illustrating a multimedia information recommendation method according to an example embodiment. Referring to fig. 2, the multimedia information recommendation method includes the steps of:

in step S201, the terminal transmits a recommendation request to a plurality of servers in the server cluster.

The recommendation request carries a first information identifier of the reference multimedia information. The server cluster comprises a plurality of servers, a first multimedia information base is stored in the server cluster, a second multimedia information base is stored in each server in the server cluster, and the second multimedia information base comprises part of multimedia information of the first multimedia information base.

The terminal may send a recommendation request to each of the plurality of servers in the server cluster, or the terminal may send a recommendation request to some of the plurality of servers in the server cluster; for example, the server cluster includes 5 servers, and the terminal may send a recommendation request to 2 servers in the server cluster. In the embodiment of the present disclosure, a description is given by taking an example in which a terminal sends a recommendation request to each of a plurality of servers in a server cluster.

The reference multimedia information is a basis for the server to determine the recommendation result, and the reference multimedia information may be multimedia information capable of representing user preferences. The server determines target multimedia information which is possibly interested by the user according to the reference multimedia information.

For example, when the client is a short video application, the reference multimedia information may be a certain short video. Specifically, the reference multimedia information may be a certain short video browsed, praised or collected by the user, a certain short video with a browsing frequency exceeding a preset threshold, or a certain short video with a ratio of a time length of the certain short video browsed by the user to a total time length of the short video being greater than a preset threshold. Correspondingly, the first information identifier of the reference multimedia information is a short video identifier of the certain short video. For example, the preset threshold is 10, the short video with the browsing times of the user exceeding 10 times is the reference multimedia information, and the first information identifier of the reference multimedia information is the short video identifier of the short video with the browsing times of the user exceeding 10 times.

The reference multimedia information may also be a certain type of short video with the browsing times, the like times or the collection times of the user exceeding a preset threshold, or the reference multimedia information may be the certain type of short video if the browsing times of the user on the certain type of short video are greater than the browsing times of other types of short videos. Correspondingly, the first information identifier of the reference multimedia information is a category identifier of a certain type of short video. For example, the number of times that the user browses the science and technology type short video exceeds 100 times, or the number of times that the user browses the science and technology type short video is greater than the number of times that the user browses other types of short videos, the reference multimedia information may be the science and technology type short video, and the first information identifier of the reference multimedia information is a category identifier of the science and technology type short video.

The reference multimedia information can also be user preference information, and correspondingly, the first information identifier of the reference multimedia information is a user preference identifier. The user preference information may be a category of short videos of interest selected by the user. The user preference information may also be a category of short videos of interest to the user determined from one or more of historical browsing records, historical praise records, historical favorites records, or short video authors of interest to the user. Accordingly, the user preference identification may be a set of category identifications corresponding to categories in which the user is interested. For example, the category of the short videos of interest selected by the user is a science category, a news category and a food category, and the user preference identifier may be a set of a category identifier of the science short videos, a category identifier of the news short videos and a category identifier of the food short videos.

The reference multimedia information may also be other types of multimedia information, and is not specifically limited in the embodiments of the present disclosure.

The server cluster includes a plurality of servers, and with continued reference to fig. 1, each server in the server cluster is in a parallel relationship, and the terminal may simultaneously send a recommendation request to each server in the server cluster. The server cluster includes a plurality of servers. For example, n servers such as server _1, server _2, server _ n, etc. may be included in the server cluster, where n may be 2, 3, 8, etc., that is, 2 servers, 3 servers, 8 servers, etc. may be included in the server cluster. In the embodiment of the present disclosure, the number of servers in a server cluster is not specifically limited.

With continued reference to fig. 1, a client on a terminal sends a request to each server in a server cluster, each server in the server cluster reads multimedia information from a message queue corresponding to the server cluster, determines a recommendation result by the method provided by the embodiment of the present disclosure, and sends the recommendation result to the terminal, that is, responds to the request of the client. The Client and the server can communicate through a GPRC (high-performance, cross-language remote procedure call framework), and correspondingly, the Client can be a GPRC Client (GRPC Client) and the server can be a GPRC Service (GPRC server).

The number of the servers in the server cluster can be set according to the data volume of the multimedia information stored in the first multimedia information base by the client and the maximum memory capacity of the servers in the server cluster. For example, the client expects that the amount of data stored in the first multimedia information base is 100TB (TeraByte), the maximum memory capacity of each server in the server cluster is 10TB, and 11 servers in the server cluster can be set.

And each server in the server cluster stores a second multimedia information base, wherein the second multimedia information base comprises part of multimedia information required to be stored by the client. For example, 10 servers are included in the server cluster, and each server may include one tenth of the multimedia information that the client needs to store. The first multimedia information library includes multimedia information for each of a plurality of second multimedia libraries. For example, the first multimedia information library includes 10 multimedia information, and each server in the server cluster stores 1 multimedia information of the 10 multimedia information. Wherein the multimedia information stored in each server in the server cluster is different. For example, the first multimedia information library includes three multimedia information, i.e., first multimedia information, second multimedia information, and third multimedia information, and the first multimedia information may be stored by a first server, the second multimedia information may be stored by a second server, and the third multimedia information may be stored by a third server in the server cluster.

In the embodiment of the present disclosure, each server in the server cluster stores a part of the multimedia information in the first multimedia information base, and the size of the data amount of the multimedia information stored in the first multimedia information base is no longer limited by the maximum memory capacity of a single server. In addition, the terminal sends recommendation requests to the plurality of servers in the server cluster, the plurality of servers can perform parallel computation, the load pressure of a single server is reduced, the computation efficiency can be improved, the time consumed for the server to return recommendation results to the terminal is reduced, and the recommendation speed is further improved.

In step S202, for any server in the server cluster, a recommendation request sent by the terminal is received, where the recommendation request carries the first information identifier referring to the multimedia information.

Any server in the server cluster can receive the recommendation request sent by the terminal, determine the recommendation result according to the recommendation request sent by the terminal, and return the recommendation result to the terminal.

The terminal may send a recommendation request to each server in the server cluster, and correspondingly, each server in the server cluster receives the recommendation request sent by the terminal. The terminal can also send a recommendation request to a specified server in the server cluster. The terminal may send a recommendation request to a designated server in the server cluster, and correspondingly, the server designated by the terminal receives the recommendation request sent by the terminal. The terminal can also send recommendation requests to the specified servers in the server cluster, and correspondingly, the specified servers of the terminal receive the recommendation requests sent by the terminal.

In step S203, the server determines a matching degree between the reference multimedia information and each multimedia information in the second multimedia information library stored by the server according to the first information identifier.

Each multimedia message in the second multimedia message library may or may not include the reference multimedia message.

The server can determine the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base according to the first information identification of the reference multimedia information. Accordingly, this step can be realized by the following steps (1) to (2):

(1) the server determines a first feature vector of the reference multimedia information according to the first information identification, wherein the first feature vector is used for identifying the feature of the reference multimedia information, and determines a second feature vector of each multimedia information in the second multimedia information base.

In a possible implementation manner, the server may determine the reference multimedia information according to the first information identifier, and determine the first feature vector of the reference multimedia information according to the feature of the reference multimedia information. For example, the reference multimedia information is a short video with the browsing times of the user exceeding a preset threshold, the feature of the short video may include one or more features in a category tag of the short video, a short video author who publishes the short video, summary information of the short video, background music of the short video, or an image of the short video, and the server may generate the feature vector of the short video according to the one or more features of the short video.

The server can sequentially acquire each multimedia message from the second multimedia message library, and determine a second feature vector of each multimedia message according to the feature of each multimedia message. The step of determining the second eigenvector of each multimedia message by the server according to the characteristics of each multimedia message is similar to the step of determining the first eigenvector of the reference multimedia message by the server according to the characteristics of the reference multimedia message, and is not repeated herein.

In another possible implementation manner, the server may further directly determine, from the correspondence between the information identifier and the feature vector, the feature vector corresponding to the information identifier. Correspondingly, the step of determining, by the server, a first feature vector of the reference multimedia information according to the first information identifier, the first feature vector being used to identify the feature of the reference multimedia information, and for each multimedia information in the second multimedia information library, determining a second feature vector of each multimedia information may be: the server determines a first feature vector of the reference multimedia information from the corresponding relation between the information identifier and the feature vector according to the first information identifier, and determines a second feature vector of each multimedia information for each multimedia information in the second multimedia information base. Correspondingly, before this step, the server may further perform the following steps: the server reads the multimedia information from the message queue and stores the multimedia information in a second multimedia information base; and reading the multimedia information from the second multimedia information base, extracting the characteristic vector of the multimedia information, and associating the information identifier of the multimedia information with the characteristic vector of the multimedia information.

Referring to fig. 3, the server may continuously read multimedia information from the message queue through a Consumer component, and store the multimedia information in a second multimedia information base; and the MetaParser analyzes the multimedia information read from the second multimedia information base, extracts the characteristic vector of the multimedia information, and converts the read multimedia information into a uniform data format in the service. The MetaParser may also directly read multimedia information from the message queue through a Consumer component, parse the original multimedia information read from the message queue, and convert the original multimedia information into a unified data format inside the service.

With continued reference to fig. 3, the server may store the information identifier of the multimedia information and the feature vector association in the key-value data set. The storage form of the data in the key value data set may be a "key-value (key value pair)" form, the information identifier of the multimedia information corresponds to a key, and the feature vector of the multimedia information corresponds to a value.

Correspondingly, the step of determining, by the server, a first feature vector of the reference multimedia information according to the first information identifier, where the first feature vector is used to identify the feature of the reference multimedia information, and the step of determining, by the server, a second feature vector of each multimedia information according to each multimedia information in the second multimedia information library may be: the server determines a first feature vector of the reference multimedia information from the key value data set according to the incidence relation between the first information identifier and the first feature vector in the key value data set; and the server determines a second feature vector of the reference multimedia information from the key value data set according to the incidence relation between the third information identifier of each multimedia information in the second multimedia information base and the third information identifier and the second feature vector in the key value data set.

In the embodiment of the disclosure, the server receives the recommendation request of the terminal, and may determine the feature vector of the multimedia information according to the information identifier of the multimedia information directly from the corresponding relationship between the information identifier and the feature vector. The step of determining the feature vector of the multimedia information according to the multimedia information is not required to be executed, and time consumption for returning the recommendation result to the terminal is reduced.

(2) And the server determines the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base according to the first characteristic vector and the second characteristic vector of each multimedia information in the second multimedia information base.

The degree of match between the reference multimedia information and each multimedia information in the second multimedia information base may represent a degree of similarity between the reference multimedia information and each multimedia information in the second multimedia information base. For example, if the multimedia information is a short video, the higher the matching degree between the reference multimedia information and the multimedia information in the second multimedia information base is, the more similar the reference multimedia information and the multimedia information in the second multimedia information base is, the higher the possibility that the multimedia information in the second multimedia information base is the multimedia information in which the user is interested is. The matching degree between the reference multimedia information and each multimedia information in the second multimedia information base can also be the distance between the first feature vector corresponding to the reference multimedia information and the fourth feature vector of each multimedia information in the second multimedia information base, and the smaller the distance is, the more similar the reference multimedia information and the multimedia information in the second multimedia information base are.

In a possible implementation manner, the server may map the first feature vector and the second feature vector in a vector space, calculate a distance between the first feature vector and the second feature vector by a distance calculation method, and determine the distance between the first feature vector and the second feature vector as a matching degree between the reference multimedia information and each multimedia information in the second multimedia information base. The distance calculation method may be a euclidean distance calculation method, and may also be other distance calculation methods.

In another possible implementation manner, the server may further determine a matching degree between the reference multimedia information and each multimedia information in the second multimedia information library through an (Approximate Nearest Neighbor) algorithm. Before the server determines the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base, the server needs to organize the feature vectors and the information identifiers of the multimedia information to establish a multimedia information index structure, that is, an index. Accordingly, with continued reference to fig. 3, the step of the server establishing the multimedia information index structure may be: for the feature vector and the information identifier of each piece of multimedia information stored in the key value data set, the server reads the feature vector and the information identifier of the multimedia information from the key value data set; and organizing the feature vector and the information identification of each multimedia information to establish a multimedia information index structure.

Correspondingly, the step of determining, by the server, the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base according to the first feature vector and the second feature vector of each multimedia information in the second multimedia information base may be: the server determines a first position point corresponding to the first feature vector and a second position point corresponding to the second feature vector from the multimedia information index structure according to the first feature vector and the second feature vector; determining a distance between the first location point and the second location point; determining the distance between the first position point and the second position point as the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base; the multimedia information index structure comprises position points mapped by the feature vectors of the multimedia information.

The server can periodically read the feature vectors and the information identifications of the multimedia information from the key value data set according to the reading period of the feature vectors, and establish a multimedia information index structure. The reading period may be set to 1 minute or 1 hour. The reading period may also be set according to the updating speed of the multimedia information in the second multimedia information base, and the length of the reading period may be inversely proportional to the updating speed. The reading period can also be set by the service party according to the service requirement.

In the embodiment of the disclosure, the server may periodically read the feature vector and the information identifier of the multimedia information, establish a multimedia information index structure, keep the multimedia information index structure in a regularly updated state, and ensure timeliness of the feature vector and the information identifier in the multimedia information index structure, so that the server determines the first target multimedia information according to the multimedia information index structure with higher accuracy.

With continued reference to fig. 3, the server may build the multimedia information index structure based on only a portion of the multimedia information in the key-value data set. Correspondingly, the step of the server establishing the multimedia information index structure according to part of the multimedia information in the key value data set may be: acquiring a fourth information identifier from a white list in which the information identifiers of the multimedia information are stored; acquiring a feature vector corresponding to the fourth information identifier according to the fourth information identifier; and establishing a multimedia information index structure according to the feature vector of the multimedia information corresponding to the fourth information identifier.

The server can also mark the characteristic vector of the multimedia information hitting the white list when the multimedia information is analyzed through the MetaParser; the MetaParser writes the feature vector of the multimedia information into a key value data set; and the server takes out the characteristic vectors from the key value data set and establishes a multimedia information index structure for the marked characteristic vectors.

With continued reference to fig. 3, the Server may obtain the white list from the white list configuration module and store the white list in a Remote Dictionary service (Redis). When the server analyzes the multimedia information through the MetaParser, whether the information identifier of the multimedia information is in a white list is determined. If the information identifier of the multimedia information is in the white list, the multimedia information hits the white list; and if the information identifier of the multimedia information is not in the white list, the multimedia information does not hit the white list.

In the embodiment of the disclosure, the server may only establish the multimedia information index structure for the multimedia information in the white list, so that the speed of determining the first target multimedia information from the multimedia information index structure by the server is faster, and the time consumed for returning the recommendation result to the terminal is shorter.

Continuing to refer to fig. 3, before the server acquires the fourth information identifier from the white list in which the information identifiers of the multimedia information are stored, the server also receives configuration information sent by the terminal corresponding to the service party, wherein the configuration information includes the fourth information identifier of the multimedia information of which the recommendation weight is greater than a certain threshold; and the server stores the fourth information identifier in the configuration information in a white list through a white list configuration module.

The recommendation weight may be determined according to information such as browsing amount, collection amount, authority, and the like of the multimedia information. For example, the multimedia information is a short video, and the higher the browsing amount or the collection amount of the short video is, the larger the recommendation weight is; as another example, the authority of the short video with the short video author being the official news platform is higher, and the recommendation weight is also larger.

In the embodiment of the disclosure, the server may establish the multimedia information index structure only for the multimedia information whose recommendation weight is greater than a certain threshold, so that the recommendation weight of the first target multimedia information determined from the multimedia information index structure is higher, the quality of the first target multimedia information is higher, and the recommendation effect is better.

The specific Ann algorithm may be an Approximate nearest neighbor search (Annoy) algorithm, a Faiss (a high performance library for similarity search and dense vector clustering) algorithm, or a Hnsw (hierarchical navigable worldlet) algorithm. The service party can select a suitable algorithm according to the service scenario.

In another possible implementation manner, the server may also determine the similarity between the first feature vector and the second feature vector through a similarity calculation method, and determine the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base according to the similarity between the first feature vector and the second feature vector. The similarity calculation method may be a cosine similarity calculation method, and may also be other similarity calculation methods.

The server may also calculate the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base by other methods, and in the embodiment of the present disclosure, the calculation method of the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base is not specifically limited.

Another point to be explained is that, before determining the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base stored by the server according to the first information identifier, the server may first query the recommendation result corresponding to the first information identifier from the cache region according to the first information identifier. Continuing to refer to fig. 3, if there is a recommendation result corresponding to the first information identifier in the cache region, directly returning the recommendation result corresponding to the first information identifier. Correspondingly, the step of querying, by the server, the recommendation result corresponding to the first information identifier from the cache region according to the first information identifier may be: and if the cache region has at least one second information identifier of second target multimedia information corresponding to the first information identifier, the server acquires the at least one second information identifier from the cache region, and the cache region is used for caching the recommendation result of the historical recommendation request.

The cache region stores recommendation results of historical recommendation requests. When the server returns the recommendation result corresponding to the first information identifier to the terminal, the first information identifier and the recommendation result corresponding to the first information identifier may be stored in the cache region. Correspondingly, the step of the server storing the historical recommendation result in the cache region may be: the server receives a recommendation request carrying a first information identifier; according to the first information identification, determining the matching degree between the reference multimedia information corresponding to the first information identification and each multimedia information in the second multimedia information base; determining at least one second target multimedia information from the second multimedia information base according to the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base; and returning the first information identifier and the second information identifier of the second target multimedia information to the terminal as recommendation results, and storing the recommendation results in the cache region.

Correspondingly, the step of determining the recommendation result from the cache region and returning the recommendation result to the terminal by the server may be: the server determines whether the first information identifier exists in the cache region according to the first information identifier, if the first information identifier exists in the cache region, the server determines a recommendation result corresponding to the first information identifier according to the first information identifier, and returns the recommendation result to the terminal, wherein the recommendation result comprises at least one second information identifier of second multimedia information.

For example, in the short video application, the reference multimedia information is a first short video with the browsing times of the user exceeding a preset threshold, the server receives a recommendation request of the terminal, the recommendation request carries a short video identifier "a" of the first short video, determines a matching degree of the first short video and each second short video in the second multimedia information base, determines at least one second target multimedia information from the second multimedia information base according to the matching degree of the first short video and each second short video in the second multimedia information base, the second target multimedia information may be a third short video and a fourth short video, the second information identifier of the second target multimedia information includes a short video identifier "B" of the third short video and a short video identifier "C" of the fourth short video, the server may return "B, C" as a recommendation result to the terminal, and, "A-B, C" is stored in the cache. If the server receives the recommendation request of the terminal again and the recommendation request carries the short video identifier "A", the server determines that the short video identifier "A" exists in the cache region, determines the recommendation result "B, C" corresponding to the short video identifier "A" according to the short video identifier "A", and returns the recommendation result "B, C" to the terminal.

In the embodiment of the disclosure, the server can cache the recommendation result, the server receives the recommendation request sent by the terminal, and may first determine whether the cache region has the recommendation result of the first information identifier corresponding to the recommendation request, and if the cache region has the recommendation result of the first information identifier corresponding to the recommendation request, the server may directly return the recommendation result to the terminal. The step of determining the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base stored by the server according to the first information identification is not required to be executed. The time consumption for returning the recommendation result to the terminal according to the recommendation request is greatly reduced, and the recommendation result can be more quickly returned to the terminal.

Continuing to refer to fig. 3, if there is no second information identifier of at least one second target multimedia information corresponding to the first information identifier in the cache region, the server performs a step of determining a matching degree between the reference multimedia information and each multimedia information in a second multimedia information library stored by the server according to the first information identifier.

The recommendation result stored in the cache region can be deleted periodically, and if the time for storing the recommendation result in the cache region exceeds a certain value, the server deletes the recommendation result from the cache region. Correspondingly, the step of the server periodically deleting the recommendation result stored in the cache area may be: the server counts the cache duration of each first information identifier stored in the cache region; and deleting the first information identifier of which the caching duration exceeds the preset duration and the second information identifier of at least one second target multimedia information corresponding to the first information identifier.

The buffer duration is the duration from the beginning of the first information identifier being stored in the buffer to the current time. The preset time period may be set to 1 minute, 30 minutes, 1 hour, or the like.

The preset time length can also be set according to the updating speed of the multimedia information in the second multimedia information base, and the preset time length and the updating speed are in an inverse proportion relation. If the updating speed of the multimedia information in the second multimedia information base is slower, the preset time length can be set to be longer; if the updating speed of the multimedia information in the second multimedia information base is faster, the preset time length can be set to be shorter. For example, the multimedia information in the second multimedia information base is increased by 10 ten thousand per hour, the updating speed is fast, and the preset time duration can be set to 1 minute. For another example, the multimedia information in the second multimedia information base is increased by 1 ten thousand per hour, and the preset time period may be set to 30 minutes.

The preset duration can be set according to one or more of the parameters such as the recommendation accuracy requirement, the recommendation time consumption requirement and the like of the multimedia information recommendation system provided by the embodiment of the disclosure. For example, the minimum recommendation accuracy of the multimedia information recommendation system is 90%, and the server may determine the preset time length that enables the recommendation accuracy of the multimedia information recommendation system to reach 90% or more than 90% according to the mathematical relationship between the recommendation accuracy and the preset time length. For another example, the minimum recommendation accuracy requirement of the multimedia information recommendation system is 90%, and the recommendation time consumption requirement is that a recommendation result is returned at most 30 seconds after the recommendation request is received, and the server can determine the most appropriate preset time which simultaneously meets the recommendation time consumption requirement and the recommendation accuracy according to the mathematical relationship between the recommendation accuracy, the recommendation time consumption and the preset time.

The preset time length can also be configured by a service party using the multimedia information recommendation system provided by the embodiment of the disclosure, and the service party can configure the preset time length meeting the requirements according to the requirements of the recommendation accuracy or the recommendation time consumption and the like of the multimedia information recommendation system.

In the embodiment of the disclosure, the recommendation result stored in the cache region can be deleted periodically, so that the recommendation result stored in the cache region can be ensured to meet the real-time requirement of the current recommendation request, the performance requirement of the multimedia information recommendation system for real-time recommendation can be met, and the recommendation accuracy is improved.

In step S204, the server determines at least one first target multimedia message from the second multimedia message library stored in the server according to a matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored in the server.

The first target multimedia information is multimedia information matched with the reference multimedia information in the second multimedia information base, namely multimedia information which is possibly interested by the user.

In one possible implementation, the server may determine a specified number of first target multimedia information that matches the reference multimedia information most closely from the second multimedia information library. Correspondingly, the step of determining, by the server, at least one first target multimedia message from the second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server may be: the server sorts the matching degrees of the reference multimedia information and each multimedia information in the second multimedia information base according to the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base to obtain a sorting result of the matching degrees; and determining the first target multimedia information with the highest matching degree in the specified quantity according to the sorting result.

For example, the matching degrees between the reference multimedia information and each multimedia information in the second multimedia information base are respectively 90%, 69%, 75%, 92%, 95%, 83%, and the designated number is 2, the sorting result is 95%, 92%, 90%, 83%, 75%, and 69%, and the first target multimedia information is the multimedia information in the second multimedia information base with the matching degree with the reference multimedia information of 95% and the multimedia information in the second multimedia information base with the matching degree with the reference multimedia information of 92%.

It should be noted that the specified amount may be set according to the total amount of the multimedia information in the second multimedia information database, for example, the specified amount may be one tenth of the total amount of the multimedia information in the second multimedia information database. The specified amount may also be the amount of the first target multimedia information desired to be obtained from the second multimedia information library. The designated number may also be a numerical value determined by a machine learning algorithm, and in the embodiment of the present disclosure, the setting or determining manner of the designated number is not specifically limited.

It should be noted that, the matching degree may be sorted from high to low to obtain a sorting result, or sorted from low to high to obtain a sorting result, which is not specifically limited in the embodiment of the present disclosure.

In another possible implementation, the server may determine the first target multimedia information having a matching degree with the reference multimedia information greater than a specified threshold from the second multimedia information library. Correspondingly, the step of determining, by the server, at least one first target multimedia message from the second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server may be: the server compares the matching degree of the reference multimedia information and each multimedia information in the second multimedia information base with a specified threshold value according to the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base; and determining first target multimedia information with the matching degree with the reference multimedia information larger than a specified threshold value.

The designated threshold may be a threshold determined by a machine learning algorithm, or may be a threshold set by the service provider according to its own requirements. In the embodiment of the present disclosure, the setting or determining manner of the designated threshold is not specifically limited.

For example, the matching degrees between the reference multimedia information and each of the multimedia information in the second multimedia information base are 89%, 69%, 75%, 92%, 95%, 83%, respectively, and the designated threshold value is 90%, then the first target multimedia information is the multimedia information in the second multimedia information base with the matching degree of 95% with the reference multimedia information and the multimedia information in the second multimedia information base with the matching degree of 92% with the reference multimedia information.

In another possible implementation manner, the server may determine a distance between a first feature vector corresponding to the reference multimedia information and a second feature vector corresponding to the multimedia information in the second multimedia information base as a matching degree, and accordingly, the server may determine a specified number of first target multimedia information with the smallest matching degree with the reference multimedia information from the second multimedia information base. Correspondingly, the step of determining, by the server, at least one first target multimedia message from the second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server may be: the server sorts the matching degrees of the reference multimedia information and each multimedia information in the second multimedia information base according to the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base to obtain a sorting result of the matching degrees; and determining the first target multimedia information with the minimum matching degree in the specified quantity according to the sequencing result.

The server can also determine the first target multimedia information with the matching degree with the reference multimedia information less than a certain threshold value from the second multimedia information base. Correspondingly, the step of determining, by the server, at least one first target multimedia message from the second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server may be: the server compares the matching degree of the reference multimedia information and each multimedia information in the second multimedia information base with a specified threshold value according to the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base; and determining first target multimedia information with the matching degree with the reference multimedia information smaller than a certain threshold value.

The certain threshold may be a threshold determined by a machine learning algorithm, or may be a threshold set by the service provider according to its own requirements. In the embodiment of the present disclosure, the setting or determining manner of a certain threshold is not specifically limited.

In step S205, the server returns a recommendation result to the terminal, where the recommendation result includes at least one first target multimedia information.

In one possible implementation, the server may return all of the at least one first target multimedia information determined from the second multimedia information library to the terminal. The recommendation result comprises all first target multimedia information in at least one first target multimedia information determined by the server.

In another possible implementation manner, the server may return one of the at least one first target multimedia message to the terminal in sequence from high matching degree to low matching degree, and the recommendation result includes the one of the at least one first target multimedia message determined by the server.

In another possible implementation manner, the server returns a recommendation result to the terminal, where the recommendation result includes identification information of the first target multimedia information. For example, the first target multimedia information is a short video, and the identification information of the first target multimedia information may be a cover page of the short video.

In step S206, the terminal receives the recommendation result returned by each server, and displays at least one first target multimedia information in the recommendation results of the plurality of servers in the recommendation interface.

In one possible implementation manner, the recommendation interface may be an interface that presents a plurality of first target multimedia information. The terminal can display a plurality of first target multimedia information in the recommendation results of the plurality of servers in the recommendation interface. For example, the first target multimedia information is a short video, and the terminal may display a plurality of short videos in the recommendation interface. For another example, the first target multimedia information may be a business card of a short video author, and the terminal may display the business cards of a plurality of short video authors in the recommendation interface, where the business card includes user information such as a user head portrait or a user name of a short video author.

In another possible implementation manner, the terminal may further filter the first target multimedia information from the recommendation results of the plurality of servers according to a matching degree between the reference multimedia information and the first target multimedia information. The recommendation result also comprises the matching degree between each first target multimedia information and the reference multimedia. Correspondingly, the step of displaying, by the terminal, at least one first target multimedia information in the recommendation results of the plurality of servers in the recommendation interface may be: the terminal selects a preset number of first target multimedia information with the highest matching degree from a plurality of first target multimedia information in the recommendation results of the plurality of servers according to the matching degree between each first target multimedia information and the reference multimedia information; and displaying the first target multimedia information in a recommendation interface.

The terminal can sequence the matching degree between each first target multimedia information and the reference multimedia information to obtain a sequencing result, and according to the sequencing result, the preset number of first target multimedia information with the highest matching degree is selected from the plurality of first target multimedia information in the recommendation results of the plurality of servers.

The preset number may be set according to service requirements, for example, only 10 first target multimedia information similar to the reference multimedia information need to be displayed in the recommendation interface, and the preset number may be set to 10. The preset number may also be a numerical value determined by a machine learning algorithm, and in the embodiment of the present disclosure, the setting or determining manner of the preset number is not specifically limited.

The step of screening the first target multimedia information by the terminal according to the matching degree between the reference multimedia information and the first target multimedia information may further be: and the terminal selects the first target multimedia information with the matching degree exceeding a preset threshold value from the plurality of first target multimedia information in the recommendation results of the plurality of servers according to the matching degree between each first target multimedia information and the reference multimedia information.

The preset threshold may be a threshold determined by a machine learning algorithm, or may be a threshold set by the service provider according to its own requirements. In the embodiment of the present disclosure, the setting or determining manner of the preset threshold is not specifically limited.

In the embodiment of the disclosure, the terminal receives the recommendation results returned by the plurality of servers, and can also screen the first target multimedia information with higher matching degree from the plurality of first target multimedia information of the plurality of recommendation results according to the matching degree of the reference multimedia information and the first target multimedia information, so that the recommendation accuracy is higher.

In another possible implementation manner, the recommendation interface may also be the interface next to the interface currently browsed by the user, and when the terminal receives an instruction to trigger display of the next multimedia information, the terminal may display the first target multimedia information to be recommended in the recommendation interface. Correspondingly, the step of displaying, by the terminal, at least one first target multimedia information in the recommendation results of the plurality of servers in the recommendation interface may be: the terminal receives at least one first target multimedia message returned by the server, and the at least one first target multimedia message forms a pool to be recommended; when the terminal receives an instruction for triggering the display of the next multimedia information, the first target multimedia information with the highest matching degree is determined from the pool to be recommended, the first target multimedia information with the highest matching degree is used as the first target multimedia information to be recommended and displayed in the recommendation interface, and the first target multimedia information displayed in the recommendation interface is deleted from the pool to be recommended.

In another possible implementation manner, the recommendation result returned by the server to the terminal may include a first target multimedia information, and the recommendation interface may be a next interface of an interface currently browsed by the user. When the terminal receives an instruction for triggering the display of the next multimedia information, the terminal can receive a first target multimedia information returned by the server and display the first target multimedia information in the recommendation interface.

In another possible implementation manner, the recommendation result returned by the server to the terminal includes identification information of the first target multimedia information, and the terminal may receive the identification information of the first target multimedia information returned by the server and display the identification information in the recommendation interface. When the terminal receives the trigger operation of the identification information, sending an acquisition request to the server, wherein the acquisition request carries the information identification of the first target multimedia information; and the terminal receives the first target multimedia information returned by the server according to the information identifier and displays the first target multimedia information in a recommendation interface.

For example, the first target multimedia information is a short video, and the identification information of the first target multimedia information is a cover page of the short video; when the terminal receives a click operation on the cover of the short video, sending an acquisition request to a server, wherein the acquisition request carries the short video identifier of the short video; and receiving the short video returned by the server, and playing the short video.

In the embodiment of the disclosure, the terminal can acquire the first target multimedia information from the recommendation result and display the first target multimedia information in the recommendation interface, so that a user can browse the first target multimedia information in the recommendation interface directly, and the experience of the user is improved.

In the embodiment of the disclosure, a terminal sends a recommendation request to a plurality of servers in a server cluster; and the server receives a recommendation request sent by the terminal, and determines a recommendation result according to the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base. The server can determine a recommendation result according to the current latest second multimedia information base when receiving the recommendation request, and the recommendation accuracy is high.

All the above optional technical solutions may be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described herein again.

Fig. 4 is a block diagram illustrating a multimedia information recommendation apparatus according to an example embodiment. Referring to fig. 4, the apparatus is applied in a terminal, and includes:

a first sending module 401, configured to execute sending a recommendation request to a plurality of servers in a server cluster, where the recommendation request carries a first information identifier of reference multimedia information, the server cluster stores a first multimedia information base, and each server stores a second multimedia information base, where the second multimedia information base includes part of multimedia information in the first multimedia information base; each server is used for determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identification; determining at least one first target multimedia message from a second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server; returning a recommendation result to the terminal, wherein the recommendation result comprises at least one first target multimedia message;

a first receiving module 402, configured to perform receiving of a recommendation result returned by each server, where the recommendation result includes at least one first target multimedia information;

and the display module 403 is configured to perform displaying of at least one first target multimedia information in the recommendation results returned by the plurality of servers in the recommendation interface.

In a possible implementation manner, the recommendation result further includes a matching degree between each first target multimedia information and the reference multimedia information; the display module is further configured to select a preset number of first target multimedia information with the highest matching degree from a plurality of first target multimedia information in the recommendation results of the plurality of servers according to the matching degree between each first target multimedia information and the reference multimedia information; and displaying the first target multimedia information with the highest matching degree in a preset number in a recommendation interface.

It should be noted that: in the multimedia information recommendation apparatus provided in the foregoing embodiment, only the division of the functional modules is illustrated when multimedia information is recommended, and in practical applications, the function distribution may be completed by different functional modules according to needs, that is, the internal structure of the terminal is divided into different functional modules to complete all or part of the functions described above. In addition, the multimedia information recommendation device provided in the above embodiment and the multimedia information recommendation method embodiment belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

Fig. 5 is a block diagram illustrating a multimedia information recommendation apparatus according to an example embodiment. Referring to fig. 5, the apparatus is applied to any one of the servers in the server cluster, where the server cluster stores a first multimedia information base, and each server stores a second multimedia information base, where the second multimedia information base includes part of the multimedia information in the first multimedia information base; the device includes:

a second receiving module 501, configured to execute a recommendation request sent by a receiving terminal, where the recommendation request carries a first information identifier referring to multimedia information;

a determining module 502 configured to perform determining a matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identification; determining at least one first target multimedia message from a second multimedia message library stored by the server according to the matching degree between the reference multimedia message and each multimedia message in the second multimedia message library stored by the server;

and the second sending module 503 is configured to execute returning of a recommendation result to the terminal, where the recommendation result includes at least one first target multimedia information.

In one possible implementation, the apparatus further includes:

the obtaining module is configured to execute, if at least one second information identifier of second target multimedia information corresponding to the first information identifier exists in the cache region, obtaining the at least one second information identifier from the cache region, wherein the cache region is used for caching a recommendation result of the historical recommendation request; and if the second information identifier of at least one second target multimedia information corresponding to the first information identifier does not exist in the cache region, executing a step of determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identifier.

In another possible implementation manner, the apparatus further includes:

and the deleting module is configured to delete the first information identifier of which the caching duration exceeds the preset duration and the second information identifier of at least one second target multimedia information corresponding to the first information identifier.

In another possible implementation manner, the determining module 502 is further configured to perform determining a first feature vector of the reference multimedia information from a corresponding relationship between the information identifier and the feature vector according to the first information identifier, the first feature vector being used for identifying a feature of the reference multimedia information, and for each multimedia information in the second multimedia information base, determining a second feature vector of the multimedia information from a corresponding relationship between the information identifier and the feature vector according to a third information identifier of the multimedia information; and determining the matching degree between the reference multimedia information and each multimedia information in the second multimedia information base according to the first characteristic vector and the second characteristic vector.

In another possible implementation manner, the apparatus further includes:

the storage module is configured to read the multimedia information from the message queue and store the multimedia information in a second multimedia information base;

and the association module is configured to perform association of the information identification of the multimedia information and the feature vector of the multimedia information.

In another possible implementation manner, the determining module 502 is further configured to perform determining, according to the first feature vector and the second feature vector, a first location point corresponding to the first feature vector and a second location point corresponding to the second feature vector from the multimedia information index structure; determining a distance between the first location point and the second location point; determining the distance as a matching degree between the reference multimedia information and the multimedia information; the multimedia information index structure comprises position points mapped by the feature vectors of the multimedia information.

In another possible implementation manner, the apparatus further includes:

the acquisition module is also configured to acquire a fourth information identifier from a white list in which the information identifiers of the multimedia information are stored; acquiring a feature vector of the multimedia information corresponding to the fourth information identifier according to the fourth information identifier;

and the establishing module is configured to execute the characteristic vector of the multimedia information corresponding to the fourth information identification and establish a multimedia information index structure.

It should be noted that: in the multimedia information recommendation apparatus provided in the above embodiment, only the division of the above function modules is exemplified when recommending multimedia information, and in practical applications, the function distribution may be completed by different function modules according to needs, that is, the internal structure of the server is divided into different function modules to complete all or part of the functions described above. In addition, the multimedia information recommendation device provided in the above embodiment and the multimedia information recommendation method embodiment belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

Fig. 6 shows a block diagram of a terminal 600 according to an exemplary embodiment of the present disclosure. The terminal 600 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. The terminal 600 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, etc.

In general, the terminal 600 includes: a processor 601 and a memory 602.

The processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 601 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 601 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 601 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 602 is used to store at least one instruction for execution by the processor 601 to implement the multimedia information recommendation method provided by the method embodiments of the present disclosure.

In some embodiments, the terminal 600 may further optionally include: a peripheral interface 603 and at least one peripheral. The processor 601, memory 602, and peripheral interface 603 may be connected by buses or signal lines. Various peripheral devices may be connected to the peripheral interface 603 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 604, a touch screen display 605, a camera assembly 606, an audio circuit 607, a positioning component 608, and a power supply 609.

The peripheral interface 603 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 601 and the memory 602. In some embodiments, the processor 601, memory 602, and peripheral interface 603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 601, the memory 602, and the peripheral interface 603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The Radio Frequency circuit 604 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 604 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 604 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 604 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 604 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 604 may also include NFC (Near Field Communication) related circuits, which are not limited by this disclosure.

The display 605 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 605 is a touch display screen, the display screen 605 also has the ability to capture touch signals on or over the surface of the display screen 605. The touch signal may be input to the processor 601 as a control signal for processing. At this point, the display 605 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 605 may be one, providing the front panel of the terminal 600; in other embodiments, the display 605 may be at least two, respectively disposed on different surfaces of the terminal 600 or in a folded design; in still other embodiments, the display 605 may be a flexible display disposed on a curved surface or on a folded surface of the terminal 600. Even more, the display 605 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 605 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and the like.

The camera assembly 606 is used to capture images or video. Optionally, camera assembly 606 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 606 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

Audio circuitry 607 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 601 for processing or inputting the electric signals to the radio frequency circuit 604 to realize voice communication. For the purpose of stereo sound collection or noise reduction, a plurality of microphones may be provided at different portions of the terminal 600. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 601 or the radio frequency circuit 604 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, audio circuitry 607 may also include a headphone jack.

The positioning component 608 is used for positioning the current geographic Location of the terminal 600 to implement navigation or LBS (Location Based Service). The Positioning component 608 can be a Positioning component based on the united states GPS (Global Positioning System), the chinese beidou System, the russian graves System, or the european union's galileo System.

Power supply 609 is used to provide power to the various components in terminal 600. The power supply 609 may be ac, dc, disposable or rechargeable. When the power supply 609 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the terminal 600 also includes one or more sensors 610. The one or more sensors 610 include, but are not limited to: acceleration sensor 611, gyro sensor 612, pressure sensor 613, fingerprint sensor 614, optical sensor 615, and proximity sensor 616.

The acceleration sensor 611 may detect the magnitude of acceleration in three coordinate axes of the coordinate system established with the terminal 600. For example, the acceleration sensor 611 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 601 may control the touch screen display 605 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 611. The acceleration sensor 611 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 612 may detect a body direction and a rotation angle of the terminal 600, and the gyro sensor 612 and the acceleration sensor 611 may cooperate to acquire a 3D motion of the user on the terminal 600. The processor 601 may implement the following functions according to the data collected by the gyro sensor 612: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

The pressure sensor 613 may be disposed on a side frame of the terminal 600 and/or on a lower layer of the touch display screen 605. When the pressure sensor 613 is disposed on the side frame of the terminal 600, a user's holding signal of the terminal 600 can be detected, and the processor 601 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 613. When the pressure sensor 613 is disposed at the lower layer of the touch display screen 605, the processor 601 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 605. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 614 is used for collecting a fingerprint of a user, and the processor 601 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 614, or the fingerprint sensor 614 identifies the identity of the user according to the collected fingerprint. Upon identifying that the user's identity is a trusted identity, the processor 601 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 614 may be disposed on the front, back, or side of the terminal 600. When a physical button or vendor Logo is provided on the terminal 600, the fingerprint sensor 614 may be integrated with the physical button or vendor Logo.

The optical sensor 615 is used to collect the ambient light intensity. In one embodiment, processor 601 may control the display brightness of touch display 605 based on the ambient light intensity collected by optical sensor 615. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 605 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 605 is turned down. In another embodiment, the processor 601 may also dynamically adjust the shooting parameters of the camera assembly 606 according to the ambient light intensity collected by the optical sensor 615.

A proximity sensor 616, also known as a distance sensor, is typically disposed on the front panel of the terminal 600. The proximity sensor 616 is used to collect the distance between the user and the front surface of the terminal 600. In one embodiment, when the proximity sensor 616 detects that the distance between the user and the front surface of the terminal 600 gradually decreases, the processor 601 controls the touch display 605 to switch from the bright screen state to the dark screen state; when the proximity sensor 616 detects that the distance between the user and the front surface of the terminal 600 gradually becomes larger, the processor 601 controls the touch display 605 to switch from the breath screen state to the bright screen state.

Those skilled in the art will appreciate that the configuration shown in fig. 6 is not intended to be limiting of terminal 600 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.

Fig. 7 is a schematic structural diagram of a server 700 according to an embodiment of the present disclosure, where the server 700 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 701 and one or more memories 702, where the memory 702 stores at least one instruction, and the at least one instruction is loaded and executed by the processors 701 to implement the methods provided by the above method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.

In an exemplary embodiment, a computer-readable storage medium is further provided, in which at least one instruction is stored, and the at least one instruction is executable by a processor in a server to perform the multimedia information recommendation method in the above embodiment. For example, the computer-readable storage medium may be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, and the like.

The present disclosure also provides a computer program product, wherein when the instructions in the computer program product are executed by a processor of a terminal or a server, the terminal or the server can execute the multimedia information recommendation method provided by the above method embodiments.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A multimedia information recommendation method is applied to a terminal and comprises the following steps:

2. The method of claim 1, wherein the recommendation further includes a matching degree between each first target multimedia information and the reference multimedia information;

3. A multimedia information recommendation method is characterized in that the method is applied to any server in a server cluster, a first multimedia information base is stored in the server cluster, a second multimedia information base is stored in each server, and the second multimedia information base comprises part of multimedia information in the first multimedia information base; the method comprises the following steps:

4. The method of claim 3, wherein before determining the degree of matching between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identifier, the method further comprises:

5. The method of claim 3, wherein determining the matching degree between the reference multimedia information and each multimedia information in a second multimedia information base stored by the server according to the first information identification comprises:

6. A multimedia information recommendation system, the system comprising: the system comprises a terminal and a server cluster, wherein the server cluster comprises a plurality of servers; the method comprises the steps that a first multimedia information base is stored in a server cluster, a second multimedia information base is stored in each server, and the second multimedia information base comprises part of multimedia information in the first multimedia information base;

7. A multimedia information recommendation device, which is applied in a terminal, comprises:

8. A multimedia information recommendation device is applied to any server in a server cluster, wherein a first multimedia information base is stored in the server cluster, a second multimedia information base is stored in each server, and the second multimedia information base comprises part of multimedia information in the first multimedia information base; the device comprises:

9. A terminal, characterized in that the terminal comprises a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the multimedia information recommendation method according to any one of claims 1 to 2.

10. A server, characterized in that the server comprises a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to realize the multimedia information recommendation method according to any one of claims 3 to 5.