CN112115284A

CN112115284A - Multimedia recommendation method, device, equipment and storage medium

Info

Publication number: CN112115284A
Application number: CN201910537550.XA
Authority: CN
Inventors: 田元
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-06-20
Filing date: 2019-06-20
Publication date: 2020-12-22
Anticipated expiration: 2039-06-20

Abstract

The application discloses a multimedia recommendation method, a device, equipment and a storage medium, wherein the method comprises the following steps: determining second geographical position information of the terminal; obtaining at least one frame of second object image required by recommending multimedia; matching at least one multimedia message according to at least the second geographic position information and the at least one frame of second object image; the at least one multimedia information is recommended. The scheme of the application provides a more novel multimedia recommending mode, and is favorable for improving the multimedia recommending effect.

Description

Multimedia recommendation method, device, equipment and storage medium

Technical Field

The present application relates to the field of multimedia recommendation technologies, and in particular, to a multimedia recommendation method, apparatus, device, and storage medium.

Background

Multimedia service platforms often involve recommending multimedia to users or obtaining multimedia shared by users. For example, after the user accesses the multimedia service platform through the terminal, the multimedia server returns the multimedia resource to the terminal, which needs to be recommended to the user. For another example, the user sends the favorite multimedia information to the server through the terminal, so that the server can recommend the multimedia to other users with the same favorite.

However, at present, multimedia is recommended to a user by a multimedia platform or recommended to the multimedia platform by the user in a single way, which is not favorable for improving the multimedia recommendation effect.

Disclosure of Invention

In view of this, the present application provides a multimedia recommendation method, apparatus, device and storage medium, so as to provide a more novel multimedia recommendation method and facilitate improving a multimedia recommendation effect.

To achieve the above object, in one aspect, the present application provides a multimedia recommendation method, including:

acquiring first geographical position information of a terminal;

obtaining at least one frame of a first object image;

obtaining multimedia information selected and recommended by a user of the terminal;

and at least storing the first geographical position information, the first object image and the multimedia information in a server in a correlated mode.

In another aspect, the present application further provides a multimedia recommendation method, including:

determining second geographical position information of the terminal;

obtaining at least one frame of second object image required by recommending multimedia;

matching at least one multimedia message according to at least the second geographic position information and the at least one frame of second object image;

recommending the at least one multimedia information.

In another aspect, the present application further provides a multimedia recommendation apparatus, including:

the first position acquisition unit is used for acquiring first geographical position information of the terminal;

a first image obtaining unit for obtaining at least one frame of a first object image;

the multimedia obtaining unit is used for obtaining the multimedia information selected and recommended by the user of the terminal;

and the recommendation storage unit is used for storing at least the first geographical position information, the first object image and the multimedia information in a server in a correlation manner.

the second position acquisition unit is used for determining second geographical position information of the terminal;

the second image obtaining unit is used for obtaining at least one frame of second object image required by the recommended multimedia;

the multimedia matching unit is used for matching at least one piece of multimedia information at least according to the second geographic position information and the at least one frame of second object image;

and the multimedia recommendation unit is used for recommending the at least one piece of multimedia information.

a processor and a memory;

the processor is used for calling and executing the program stored in the memory;

the memory is configured to store the program, the program at least to:

acquiring first geographical position information of a terminal;

obtaining at least one frame of a first object image;

a processor and a memory;

the memory is configured to store the program, the program at least to:

determining second geographical position information of the terminal;

recommending the at least one multimedia information.

In still another aspect, the present application further provides a storage medium having stored therein computer-executable instructions, which when loaded and executed by a processor, implement the multimedia recommendation method according to any one of the above.

According to the technical scheme, the multimedia information can be recommended by combining the geographical position information of the terminal and the obtained object image, so that a more novel multimedia recommendation mode is provided. Meanwhile, the geographic position information of the terminal actually represents the geographic environment of the user, and the object image can reflect the object concerned by the user at present, so that the multimedia is recommended based on the geographic position and the object image, so that the multimedia is favorably shared by the user and suitable for the scene of the user, the multimedia suitable for the scene of the user is more reasonably recommended to the user, and the multimedia recommendation effect is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments are briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a schematic diagram illustrating a composition structure of an application scenario of a multimedia recommendation method according to the present application;

FIG. 2 is a flow chart illustrating a multimedia recommendation method according to the present application;

FIG. 3 is a schematic flow chart illustrating a multimedia recommendation method according to the present application;

FIG. 4 is a schematic flow chart illustrating a multimedia recommendation method according to the present application;

FIG. 5 is a schematic diagram illustrating an application scenario of a multimedia recommendation method according to the present application;

FIG. 6 is an interaction diagram of a multimedia recommendation method according to the present application;

FIG. 7 is a flow chart illustrating a multimedia recommendation method according to another embodiment of the present application;

FIG. 8 is a schematic diagram illustrating a further flow interaction of a further multimedia recommendation method of the present application;

FIGS. 9a and 9b show two schematic views of interfaces in a terminal, respectively;

FIG. 10 is a schematic flow chart illustrating a method for multimedia recommendation according to another embodiment of the present application;

FIG. 11 is a diagram illustrating a multimedia recommendation method according to an application scenario;

FIG. 12 is an interactive diagram of another multimedia recommendation method of the present application;

FIG. 13 is a diagram illustrating another recommendation process in another multimedia recommendation method of the present application;

FIG. 14 is a schematic diagram of a multimedia recommendation apparatus according to the present application;

FIG. 15 is a schematic diagram of another exemplary embodiment of a multimedia recommendation device according to the present application;

fig. 16 is a schematic diagram illustrating a configuration of a multimedia recommendation apparatus according to the present application.

Detailed Description

The scheme of the application is suitable for the terminal to recommend the multimedia selected by the user to the multimedia service system, and the multimedia service system recommends the multimedia to the user of the terminal, so that the multimedia is recommended by combining the environment where the user is located and the scenery or object faced by the user.

The multimedia may be music, video, or images, among others.

The multimedia service system can be an instant messaging system, an audio and video playing system and the like with multimedia services. For convenience of understanding, the components of the multimedia recommendation system to which the multimedia recommendation method of the embodiment of the present application is applied will be described first.

As shown in fig. 1, the multimedia recommendation system may include: at least one terminal 101 and at least one server 102.

The terminal 101 may be a mobile phone, a tablet computer, a notebook computer, an intelligent sound, and the like.

An Application (APP) is installed in the terminal 101, and based on the APP, the terminal can establish a communication connection with the server 102 to which the APP belongs, and request multimedia from the server 102 or receive multimedia recommended by the server. For example, the application program may be an instant messaging application, and the instant messaging application may include a multimedia service function or include an applet with audio/video playing function; as another example, the application program may be an audio playback application or a video playback application, etc.

The server 102 may return the multimedia to be recommended to the terminal upon detecting that the terminal establishes a communication connection with the server, or return the multimedia to the terminal after receiving a multimedia request sent by the terminal.

Optionally, the multimedia recommendation system may be provided with a plurality of servers, and the plurality of servers may form a server cluster or a distributed server system.

It is understood that in the present application, a multimedia resource may be stored in the server, such as a multimedia library stored in the server, and a plurality of multimedia is stored in the multimedia library.

Optionally, the multimedia recommendation system may further include: a data storage device 103, which may establish a communication connection with the server, for storing the multimedia library. Accordingly, the server 102 can query multimedia from a multimedia library of the data storage device and feed back to the terminal.

In addition, the terminal may send, to the server, multimedia information that the user of the terminal selects to recommend (may also be understood as sharing). Accordingly, service

The server stores the recommended (or shared) multimedia information of the user, so that the server recommends the multimedia information to other users by combining the recommended multimedia of the user.

The multimedia recommendation method in the embodiment of the present application may be applied to the above-mentioned terminal or server, and the following introduces the multimedia recommendation method in combination with the flowchart.

The multimedia recommendation of the application relates to the recommendation of two conditions, wherein one condition is that a terminal recommends the multimedia information selected by a user of the terminal to a server so as to share the multimedia information recommended by the user to other users of a multimedia recommendation system; and the other method is that the server recommends multimedia to the user of the terminal so as to reasonably recommend the multimedia suitable for the user.

First, a case where a terminal recommends multimedia selected by a user of the terminal to a server, that is, the user shares multimedia, will be described.

As shown in fig. 2, which shows a flowchart of an embodiment of a multimedia recommendation method according to the present application, the embodiment may be applied to the above-mentioned terminal or server, and the method of the embodiment may include:

s201, acquiring first geographical position information of the terminal.

The first geographical position information is information representing the current geographical position of the terminal.

For example, in one possible case, the first geographical location information may be latitude and longitude information of the terminal, for example, latitude and longitude information of the terminal determined by Global Positioning System (GPS) technology.

In yet another possible case, the first geographical location information may be first point of interest information characterizing a geographical location of the terminal. The points of Interest (POIs) are some geographic objects that can be abstracted as points, especially some geographic entities that are closely related to people's lives. It can be seen that the points of interest themselves include latitude and longitude as well as information about the geographic objects. For example, the point of interest may be a supermarket, bank, restaurant, etc. at a location. The description capability and the query capability of the position of the object or event can be enhanced through the interest points, and the accuracy of geographic positioning is improved.

It is understood that the first point of interest information may be determined by the terminal according to the first geographic location corresponding to the latitude and longitude where the terminal is located, or may be information of a point of interest selected by a user of the terminal.

Optionally, the obtaining of the first point of interest information may be: and outputting the first map in the terminal based on the geographical position of the terminal. Then, information of the selected first interest point in the first map is obtained.

It should be noted that, in order to facilitate distinguishing from a case of subsequently recommending multimedia to a user of a terminal, in the embodiment of the present application, in a scenario in which the user shares multimedia by recommending multimedia, geographic position information of the terminal is referred to as first geographic position information, and information of an interest point where the terminal is located is referred to as first interest point information. Correspondingly, in the process of subsequently recommending multimedia to the user of the terminal, the geographical position information of the terminal is called second geographical position information, and the information of the interest point where the terminal is located is called second interest point information.

S202, at least one frame of first object image is obtained.

The first object image may include an image of an object, wherein the object may be various items or entities, such as trees, flowers, equipment, buildings, and the like. The object may also be an object such as a scene, e.g., a sea or mountain scene.

Wherein the first object image may be used to characterize an object associated with multimedia information to be recommended by a user of the terminal. For example, the first object image may include an object that the user is interested in or interested in, so that the object is associated with as multimedia to be recommended.

It can be understood that, in the process of sharing multimedia by a user, an object image or an object video which is considered by the user to be associated with the multimedia to be recommended may be shared as needed, and therefore, the at least one frame of first object image may be one first object image or a first object video formed by multiple frames of first object images.

The first object image is obtained by the terminal or the server in the process of sharing multimedia by the user, and for convenience of distinguishing, the object image is referred to as a first object image, and the object image involved in the process of subsequently recommending multimedia to the user of the terminal is referred to as a second object image.

S203, obtaining the multimedia information selected and recommended by the user of the terminal.

The multimedia information may be one or more of a name of the multimedia, a link address of the multimedia, content of the multimedia, and the like, which the user of the terminal needs to share.

It is understood that, in the case where the present embodiment is applied to the terminal side, the terminal side may acquire the above first geographical position information, the at least one frame of the first object image, and the multimedia information according to an operation of a user or automatically.

In the case that the present embodiment is applied to the server side, the server may obtain the first geographical location, the at least one frame of the first object image, and the multimedia information sent by the terminal. For example, the server may acquire the three kinds of information at one time, or may sequentially acquire the three kinds of information in order.

And S204, at least the first geographical position information, the first object image and the multimedia information are stored in a server in a correlation mode.

For example, at least the first geographical position information, the first object image, and the multimedia information are stored in the server as associated information associated with each other, for example, the first geographical information, the first object image, and the multimedia information are stored in one record in a table of the server.

For the terminal side, the terminal side may associate the first geographical location information, the first object image, and the multimedia information to obtain information to be shared, and then send the information to be shared to the server.

In a possible case, the information to be shared may include the first geographic position information, the first object image, and the multimedia information, and the first object image and the first geographic position information associated with the multimedia information are recommended to the server by sending the information to be shared.

In yet another possible case, the information to be shared may be indication information indicating that the first geographical location information, the first object image, and the multimedia information are stored in association, and the indication information carries the multimedia information. The situation is suitable for the terminal to sequentially send the first geographic position and the first object image to the server, and after the multimedia information is obtained, the information to be shared is sent to the server.

Particularly, if the information to be shared includes the multimedia information, and the server receives the multimedia information, the first geographical location information, the first object image and the multimedia information sequentially sent by the terminal are stored in an associated manner.

For the server side, after acquiring the first geographic position and the first object sent by the terminal and the multimedia information selected by the user of the terminal, the server may establish and store an association relationship between the first geographic position and the multimedia information and the first object image.

For example, the server receives the first geographic location, the first object image and the multimedia information in sequence, and stores the association of the first geographic location, the first object image and the multimedia information after receiving the multimedia information.

For another example, the server receives information to be shared sent by the terminal, where the information to be shared may include the first geographic location, the first object image, and the multimedia information, and of course, the information to be shared may also indicate to store the three in an associated manner. In this case, the server stores the first geographic position, the first object image, and the multimedia information in association in the server based on the information to be shared.

Optionally, the user of the terminal may wish to publish and share comments, insights, or experiences related to the multimedia information while sharing the multimedia information, so that before the step S204, user experience information input for the multimedia information may be obtained. Accordingly, at least the first geographical location, the first object image, the user experience information and the multimedia information may be stored in the server in association in step S204.

Further, in order to reflect the location of the user of the terminal more accurately, before step S204, the altitude at which the terminal is located may also be obtained, and for convenience of distinguishing, in the multimedia scene shared by the user, the altitude at which the terminal is located is referred to as a first altitude. Correspondingly, the first geographical position, the first altitude, the first object image, the user experience information and the multimedia information are stored in the server in an associated mode.

It is understood that, after the server stores the association relationship between the multimedia information selected and recommended by the user and the information of the first geographical position, the first object image and the like, the server may recommend multimedia to other users based on the stored association relationship so as to recommend the multimedia information related to the position where the user is currently located, the object concerned or interested in, and the like.

Therefore, according to the scheme of the embodiment, the user can recommend the object image concerned or interested by the user at the position and the multimedia information required to be shared to the server through the terminal, and the position where the user is located, the object concerned or interested by the user and the multimedia information are stored in the server in an associated manner, so that a novel mode for realizing the multimedia sharing of the user is provided.

Meanwhile, the first geographical position information of the terminal actually represents the geographical environment of the user, and the first object image can reflect the object concerned or interested by the user at present, so that in the process of recommending the multimedia information by the user, the recommended multimedia information, the geographical position information of the user and the object image reflecting the object concerned by the user are stored in the server in a correlated manner, and the multimedia information suitable for the position of the user and the object concerned can be shared with the server, thereby realizing multimedia sharing more suitable for the scene of the user, and improving the multimedia recommendation effect.

Moreover, based on the multimedia information shared by the users and the associated geographic position and the object image, the server is also favorable for more reasonably recommending multimedia suitable for the positions of other users and related to the concerned object image for other users, and the effect of recommending the multimedia to the users is favorably improved.

To facilitate understanding of the specific implementation of the multimedia recommendation from the terminal to the server by the user, the following describes the case from the terminal side and the server side, respectively.

Referring to fig. 3, which shows a flowchart of another embodiment of the multimedia recommendation method according to the present application, the method of the present embodiment is applied to a terminal, and the present embodiment may include:

s301, a first geographical position and a first altitude of the terminal are determined.

In this embodiment, the first geographic location is a first longitude and latitude of the terminal, and the first geographic location does not include information of the point of interest.

The first altitude is an altitude at which the terminal is located when the terminal is at the first geographic location. For example, the terminal may determine altitude using an altimeter or the like within the terminal.

In a possible implementation manner, the terminal can automatically determine the longitude and latitude and the altitude of the terminal when detecting that the application enters a recommendation operation interface for multimedia recommendation. As shown in fig. 5, in the case that an opening instruction of an application is detected or the recommended operation interface 510 of the application is presented, the terminal automatically determines the first geographical location without any operation input by the user, so that a map containing the longitude and latitude where the terminal is located is presented in the recommended operation interface 510.

In yet another possible implementation manner, the terminal may further determine the first geographic location and the first altitude when detecting the input sharing triggering operation. If the terminal detects that the user clicks an operation option for requesting to share the multimedia information, a first geographic position and a first altitude are determined.

For example, in fig. 5, the recommendation operation interface 510 may include a first operation option 511 for requesting the server to share multimedia with the server, such as "my" in the recommendation operation interface 510, and a second operation option 512 for requesting the server to recommend multimedia for the user of the terminal, such as "find" in the recommendation operation interface 510, so that if the user clicks "my", it indicates that the user wishes to implement multimedia sharing by recommending multimedia information to the server, in which case, the latitude and longitude and the altitude of the terminal may be determined.

It should be noted that, in this embodiment, the first geographical location is obtained and the first altitude is obtained at the same time as the first geographical location is obtained, and in practical applications, the first altitude may also be obtained after the first geographical location is obtained. In addition, if the multimedia is not desired to be shared, the altitude of the terminal is shared, and the first altitude of the terminal can also be obtained.

S302, based on the first geographic position, a first map is obtained from a server and displayed.

If the terminal sends the latitude and longitude information of the first geographic position to the server, the server can obtain the data of the first map according to the first geographic position. The terminal may present the first map after receiving the data of the first map.

The above steps S301 and S302 are an implementation manner of outputting the first map in the terminal based on the geographical location of the terminal on the terminal side, and of course, other possibilities may also exist in practical applications, which is not limited herein.

S303, responding to the positioning trigger operation, and acquiring the selected first interest point information in the first map.

For example, the positioning trigger operation may be a click operation or an operation of selecting a point of interest in the first map. Correspondingly, the terminal can determine the selected first interest point to obtain the first interest point information.

The first interest point information may include an identifier of the first interest point and longitude and latitude information corresponding to the first interest point, and of course, may also include other information related to the first interest point, which is not limited herein.

It is understood that the steps S302 and S303 are only one implementation manner of obtaining the first point of interest information characterizing the location of the terminal, and in practical applications, the first point of interest information may be obtained in other manners. If the positioning trigger operation does not need to be input, the terminal determines first interest point information according to the first longitude and latitude; or, the first interest point information input by the user is obtained, and the details are not repeated here.

It can be understood that, in this embodiment, the obtained first geographic location information includes first interest point information as an example, in practical application, the terminal may also obtain only the first geographic location representing the longitude and latitude where the terminal is located without obtaining the information of the first interest point, and in this case, the terminal may automatically obtain the first geographic location information; or when the positioning trigger operation is acquired, the first geographical location information may be acquired, and at this time, the positioning trigger operation may be the aforementioned sharing trigger operation.

S304, in response to the input object acquisition operation, acquiring at least one frame of first object image acquired by a camera of the terminal.

The object acquisition operation is used for triggering the terminal to start the camera and acquire images. Correspondingly, the terminal responds to the object acquisition operation and can obtain at least one frame of first object image acquired by the camera.

For example, a function option such as "scan" may be set in the recommendation operation interface of the multimedia recommendation application, and when the terminal detects that the "scan" function option is touched and pressed, it is determined that the input object acquisition operation is detected, so as to acquire the first object image. For example, referring to fig. 5, an interface diagram of an image capturing interface 530 for capturing an image by starting a camera of a terminal is shown, and a preview image or an image of a captured object is displayed in the image capturing interface 530.

It is to be understood that step S304 is merely one implementation of obtaining at least one frame of the first object image. In practical application, the terminal may further obtain the selected at least one frame of the first object image from an image library of the terminal in response to the input object selection operation. For example, an option for triggering image uploading or image selection may be set in the terminal, and when it is detected that the user clicks the option, it is determined that the input object selection operation is detected, so that the image library is presented, so that the user can select an image or a video as the at least one frame of first object image.

S305, responding to the input multimedia selection operation, and determining the selected recommended multimedia information from the displayed multimedia list.

The multimedia information may include one or more of a name of the multimedia, a link address of the multimedia, and the like.

If the terminal detects the multimedia selection operation, the terminal presents the multimedia list, determines the selected multimedia in the multimedia list and obtains the information of the selected multimedia. For example, the multimedia selection operation may be clicking an operation option for triggering selection of multimedia.

For another example, after the terminal acquires at least one frame of the first image, the multimedia list may be presented for the user to select. In this case, the multimedia selection operation may be an operation of selecting multimedia from a multimedia list.

It is understood that the multimedia information of the present embodiment may also be multimedia information that obtains input, for example, a name or a link address of multimedia that a user directly inputs to be recommended. As another example, multimedia information provided by a user via a search or the like is determined.

And S306, responding to the information editing operation, and obtaining the user experience information input aiming at the multimedia information.

The user experience information may be user comments, expressed emotions, and the like, and the form of the user experience information may include one or more of character strings (such as characters and the like) and pictures.

For example, after detecting the information editing operation for the multimedia information, the input user experience information is obtained. For example, the information editing operation may be an operation for inputting user experience information, or an operation for requesting input of user experience information.

For example, after the multimedia information selected by the user is determined, an operation interface of the multimedia information may be presented, an information editing option may be included in the operation interface, and when the user clicks the information editing option, the terminal confirms that the information editing operation is received, presents an information editing window in response to the information editing operation, and obtains user experience information input in the information editing window.

It is understood that the step S306 is an optional step, and in practical applications, the user may not share the user experience information.

It should be noted that the sequence of the terminal determining the first interest point information, the multimedia information and the user experience information may be interchanged, and is not limited to that shown in fig. 3.

S307, responding to the first recommendation confirmation operation, and sending the associated recommendation indication of the multimedia information to the server.

The first recommendation confirmation operation is used for instructing to execute multimedia sharing, and if the terminal detects the input first recommendation confirmation operation, the user confirms to share the multimedia information, the first geographic position, the first object image, the user experience information and the like.

Wherein the association recommendation indication indicates that the first point of interest information, the first altitude, the first object image, the user experience information, and the multimedia information are stored in association in the server.

The specific implementation that the server is instructed to store the information in an associated manner through the associated recommendation instruction has multiple possibilities:

for example, in one possible case, in response to the first recommendation confirmation operation, the terminal associates the first geographic location information, at least one frame of the first object image, user experience information, and multimedia information to obtain information to be shared. Then, the terminal sends a related recommendation indication carrying the information to be shared to the server, so that the server stores the first geographical position information, the first object image, the user experience information and the multimedia information in a related manner.

In another possible case, each time the terminal acquires information of one dimension associated with the multimedia information to be recommended, the terminal sends the acquired corresponding information to the server. That is, after the step S301, the terminal transmits the first geographical position (first longitude and latitude) and the first altitude to the server; after the step S303, the terminal sends the first point of interest information to the server; after the step S304, the terminal transmits the at least one frame of the first object image to the server; after the step S305, the terminal transmits the multimedia information to the server, and after the step S306, the terminal transmits user experience information to the server. Accordingly, in this step S307, the association recommendation indication may indicate that the server has completed sharing of the multimedia information, so that the server may store the multimedia information in association with the first point of interest information, the first altitude, the first object image, and the like.

In addition, in step S307, after the input first recommendation confirmation operation is detected, the multimedia information is sent to the server, and in practical applications, the terminal may automatically trigger sending the associated recommendation instruction of the multimedia information to the server after detecting the user experience information.

According to the embodiment of the application, when a user recommends (shares) multimedia information to the server through the terminal, the interest point information and the altitude of the user and the user experience information of the user are recommended to the server together, so that the situation where the user recommends the multimedia is reflected based on the interest point information, the altitude and the user experience information, the multimedia is shared more flexibly, interaction among different users is increased, and the multimedia recommendation is interesting.

For example, in a certain square, it is very specific that the user sees a statue, and when seeing the statue, the user thinks of a piece of music suitable for the current situation, in which case, the user can recommend information of the piece of music, the interest point where the user is located and the image of the statue to the server by way of the embodiment, so that the server stores the information in association.

In addition, multimedia is recommended by combining the information of the interest points and the altitude of the user, so that the multimedia suitable for listening or watching in the current scene can be recommended by the user, and the server can determine the favorite multimedia of the user in different scenes more accurately.

Next, description will be made from the server side for a case where a user recommends multimedia to the server through the terminal. As shown in fig. 4, which shows another schematic flow chart of a multimedia recommendation method according to the present application, the present embodiment is applied to a server, and the present embodiment may include:

s401, a first geographical position and a first altitude sent by the terminal are obtained.

In this embodiment, the first geographic location is used to represent a first longitude and latitude where the terminal is located.

S402, returning a first map to the terminal based on the first geographic position so as to output the first map at the terminal.

S403, obtaining the first interest point information sent by the terminal.

It is understood that, similar to the operation at the terminal side in fig. 3, in the case where the terminal obtains the first point of interest information input by the user, the server may not need to perform the operation in which the terminal returns the first map.

In this embodiment, for example, the terminal shares the first point of interest information, in practical application, if the terminal only shares the longitude and latitude where the terminal is located when the terminal shares the multimedia information, the steps S401 to S403 may be replaced by acquiring the first geographical location information and the first altitude sent by the terminal.

S404, at least one frame of first object image sent by the terminal is obtained.

S405, multimedia information to be recommended sent by the terminal is obtained.

S406, user experience information aiming at the multimedia information sent by the terminal is obtained.

Wherein, the step S406 is an optional step.

The determination manner of the parameters involved in steps S401 to S406 may refer to the related description of the embodiments in fig. 3 and fig. 4, and is not described herein again.

In a possible case, in the above steps S401 to S406, the server may sequentially receive the related information transmitted by the terminal.

In yet another possible case, the server receives the transmitted information to be shared, where the information to be shared includes the first point of interest information, the first altitude, at least one frame of the first object image, the multimedia information, and the user experience information mentioned above. Correspondingly, the server analyzes the information to be shared, and obtains the first interest point information, the first altitude, at least one frame of first object image, multimedia information and user experience information sent by the terminal.

S407, in response to the association recommendation indication sent by the terminal, the first point of interest information, the first altitude, the first object image, the user experience information and the multimedia information are stored in an association manner.

The associated recommendation indication may be referred to in relation to the description of the embodiment of fig. 3.

For example, after the terminal sequentially transmits the information related in S401 to S406 to the server, the terminal may transmit an association recommendation instruction to the server, and the server may acquire and store the information received in advance in association with each other.

For another example, when the association recommendation indication sent by the terminal carries the above-mentioned information to be shared, the server responds to the association recommendation information, and obtains the first point of interest information, the first altitude, the multimedia information, and the like from the information to be shared carried in the association recommendation information and performs association storage.

Optionally, in consideration of differences between images of the same object captured by different users, the users actually want to share information of the object included in the first object image when sharing multimedia information. Therefore, the server may further recognize information of the object included in the at least one first object image, such as a name of the object, an object identifier, or a captured image of the captured object, and then store the multimedia information in association with the information of the object, the first interest point information, the first altitude, and the like.

Optionally, the server may record the association relationship between different multimedia information and information such as the first point of interest through a table. For example, taking multimedia as music and user experience information as a music story, the associated information of the multimedia information shared by different users can be recorded through the following table 1:

TABLE 1

As shown in table 1, each action in table 1 is associated with multimedia information and associated interest points, objects, and the like. For example, the first point of interest information associated with music "lovely" includes the point of interest POI "XX building" and the geographical location information "longitude and latitude 1, height 1". Meanwhile, the music story shared by the users associated with the music "favorite many" is "good and lovely dog".

For convenience of understanding, a case where a user recommends multimedia information to a server through a terminal is described below with reference to an application scenario in which the user shares music with the server through the terminal as an example. Fig. 5 is a schematic diagram illustrating an application scenario of the multimedia recommendation method in the present application.

In fig. 5, music and related information that a user wants to recommend to a server through a terminal are taken as an example for description.

The application scenario of fig. 5 will be described in detail below with reference to fig. 5 from the interaction of the terminal and the server side. Fig. 6 is a schematic flow chart illustrating the multimedia recommendation method according to the present application applied to the scenario shown in fig. 5. The method of the embodiment may include:

s601, the terminal responds to the sharing trigger operation and determines a first longitude and a first altitude where the terminal is located.

For example, in fig. 5, the terminal detects a sharing trigger operation for requesting to enter the recommendation operation interface, and then presents the recommendation operation interface 510, in this case, the terminal may default to the recommendation operation interface 510 for multimedia sharing, and as shown in fig. 5, the "my" option 511 is in a selected state, where the user may implement publishing of music information that the user wishes to recommend to the server by continuing to operate in the recommendation operation interface, so as to implement music sharing.

As another example, in the case of presenting the recommendation operation interface 510 in fig. 1, it is detected that the user clicks the first operation option 511 for triggering music sharing, as in "my" in fig. 5, the terminal confirms that the sharing triggering operation is detected, so as to determine the longitude and latitude and the altitude where the terminal is located.

S602, the terminal sends the first longitude and the first altitude to a server.

S603, the server obtains a first map based on the first longitude and latitude, and returns the first map to the terminal.

S604, the terminal displays the first map returned by the server.

Wherein, the first map can represent the position point with the first longitude and latitude.

S605, the terminal responds to the interest point selection operation and obtains the information of the first interest point selected from the first map by the user.

This point of interest selection operation corresponds to the location triggering operation in the embodiment of fig. 3.

S606, the terminal sends the information of the first interest point to the server so that the server caches the information of the first interest point.

For example, in fig. 5, a first map is displayed in the displayed recommendation operation interface 510, and a first longitude and latitude position point 513 where the terminal is actually located is indicated in the first map. In the recommendation operating interface 510, the user may select a point of interest in the first map as the first point of interest associated with sharing music. Accordingly, the terminal sends the information of the first point of interest to the server, and meanwhile, a point of interest sharing interface 520 as shown in fig. 5 is shown in the terminal. As can be seen in FIG. 5, the first point of interest 521 selected by the user is indicated in the point of interest sharing interface 520. Meanwhile, the terminal sends the information of the first interest point to the server.

S607, the terminal responds to the image acquisition operation and acquires the first object image through the camera.

For convenience of description, the embodiment takes the acquisition of a first object image as an example.

S608, the terminal sends the first object image to the server, so that the server identifies the object in the first object image.

For example, the user may initiate image capture by clicking on a "scan" or other option.

As explained in connection with fig. 5, a "scan" or other option for triggering image acquisition may be provided in the point of interest sharing interface 520 in fig. 5 (the "scan" option is not shown in fig. 5). Accordingly, after the terminal starts to capture an image, the terminal enters an image capture interface 530, such as the image capture interface 530 in fig. 5 displays a preview image of a captured flower 531. After the user inputs the image confirmation instruction, the terminal may acquire the acquired first object image, and the terminal sends the first object image to the server, as shown by a connection line between the image acquisition interface 530 and the server in fig. 5.

And S609, the terminal responds to the multimedia selection operation and determines the shared multimedia information selected by the user.

S610, the terminal sends the information of the multimedia to be shared to the server.

For example, as described in conjunction with fig. 5, the terminal may present the multimedia sharing interface 540 after sending the first object image. In fig. 5, the multimedia sharing interface 540 may include a multimedia search bar 541 for a user to search multimedia such as music to be recommended. Alternatively, the multimedia sharing interface further includes a music list 542 for the user to select the desired recommended music. After detecting that the user selects or selects music required to be shared, the terminal obtains the music information and sends the music information to the server.

It can be understood that, in the embodiment of the present application, the first longitude and latitude where the terminal is located, the first altitude, and the first interest point are sequentially sent to the server according to the obtained time sequence as an example. The same applies to the present embodiment as to the aforementioned case where a plurality of kinds of information are transmitted at once.

S611, the terminal responds to the first recommendation confirmation operation and sends a relevant recommendation indication to the server.

For example, in the multimedia sharing interface 540 of fig. 5, if the user selects the multimedia information, a dialog box including "confirm" and "cancel" may be popped up in the multimedia sharing interface, and if the user clicks "confirm", it is confirmed that the multimedia information is shared in association with the first point of interest information and the first object image obtained above.

Of course, before the step S611, the terminal may also obtain user experience information shared by the user, which may be specifically referred to the related description above.

S612, the server responds to the association recommendation indication, and stores the multimedia information and the first longitude and latitude, the information of the object in the first object image, the first interest point information and the first altitude in an association mode.

It can be understood that, in practical applications, after the terminal acquires the multimedia information and sends the multimedia information to the server, the server may store the multimedia information and the information such as the first point of interest in an associated manner without executing step S611.

The following describes a case where multimedia is recommended to a user of a terminal.

For example, referring to fig. 7, which shows a flowchart of another method for recommending multimedia in the present application, this embodiment may be applied to a terminal or a server, and this embodiment may include:

s701, determining second geographical position information of the terminal.

The second geographical location information may be longitude and latitude information where the terminal is located. The second geographical location information may further include: and second interest point information representing the geographic position of the terminal. The second point of interest information may include latitude and longitude where the terminal is located, and an identifier of the second point of interest.

It is understood that the second point of interest information may be determined by the terminal in combination with the geographic location corresponding to the second longitude and latitude, or may be information of a point of interest selected by a user of the terminal. Optionally, the obtaining of the second point of interest information may be: and outputting a second map in the terminal based on the current geographic position (such as longitude and latitude) of the terminal. Then, the selected second interest point information in the second map is obtained.

S702, at least one frame of second object image required by the recommended multimedia is obtained.

The second object image is also an image containing an object, and the specific situation of the object can be referred to in the related description above.

The second object image is used to characterize an object associated with the multimedia that the user wishes to obtain, similar to the first object image. For example, the second object image may include an object of interest or interest to the user, such as an image of an object currently viewed by the user of the terminal.

Similar to the first object image, the at least one frame of second object image may be one second object image or a second object video formed by a plurality of frames of second object images.

S703, at least one multimedia message is matched according to at least the second geographic location information and the at least one frame of second object image.

The multimedia information may be one or more of a name, an icon, and a link address of the multimedia.

For example, in the case where the terminal side performs the present embodiment, the terminal may request at least one multimedia information matching at least the second geographical location information and the at least one frame of the second object image from the server based on at least the second geographical location information and the at least one frame of the second object image.

For another example, in the case of executing the embodiment on the server side, the server may obtain the matched at least one piece of multimedia information from the multimedia library or the multimedia list according to the second geographic position information and the at least one frame of second object image.

It is understood that there are many possibilities for implementing the matched at least one multimedia information, for example, based on the foregoing association relationship between the multimedia information and the first geographic location and the at least one frame of the first object image stored by the server in the embodiments of fig. 2 to 6, at least one multimedia matched at least with the second geographic location and the at least one frame of the second object image can be obtained according to the association relationship between the multimedia and the geographic location and the object image.

In addition to the association relationship pre-stored in the server, the second geographic location and the second object image may be combined, a machine learning algorithm is used to determine the feature type of the multimedia matched between the second geographic location and the second object image, and then the multimedia belonging to the feature type is matched from the multimedia library.

It can be understood that the second geographic location and the second object image can reflect the environment of the user and the object generating the sense of touch, and can intuitively reflect the scene and the sense of desire of the user, so that, in combination with the second geographic location and the second object image, the matched multimedia can be related to the geographic location of the user and the object such as the scenery or the object concerned, so that the multimedia can better fit the actual feeling of the user in the scene.

For example, the feeling of the user facing different objects at different geographic locations may be different, the music suitable for the user in different situations may also be different, and if the user faces a fountain in a square, the music related to the fountain may be more suitable for the mood of the user, and therefore, the music more suitable for the situation of the user may be obtained by combining the geographic location and the object image including the fountain.

As an optional mode, after the second geographic location information where the terminal is located is determined in step S701, at least one piece of multimedia information to be recommended that matches the second geographic location information may also be obtained first. Accordingly, in step S703, at least one matching multimedia message may be determined from the at least one multimedia message to be recommended at least according to the at least one frame of second object image. Namely, the multimedia information to be recommended is matched according to the second geographic position of the terminal, and then at least one matched multimedia information to be recommended is screened based on the at least one frame of second object image.

Optionally, according to the at least one frame of second object image, a piece of multimedia information may be matched from the at least one piece of multimedia information to be recommended.

S704, recommending the at least one multimedia message.

For example, for the server side, the server may recommend the at least one multimedia to the terminal, so that the terminal presents the information of the at least one multimedia.

For the terminal side, the terminal outputs the at least one multimedia for the purpose of recommending the at least one multimedia to the user.

Therefore, in the embodiment of the application, when multimedia is recommended to the user of the terminal, at least one piece of multimedia information is matched according to the second geographic position of the terminal and the obtained at least one frame of second object image, so that a more novel way for recommending the multimedia to the user is provided.

Moreover, the second geographic location where the terminal is located actually represents the geographic environment where the user is located, and the second object image can represent an object in which the user is interested in the geographic location, so that the recommendable multimedia is determined based on the second geographic location and the second object image, and the multimedia suitable for the situation where the user is located is recommended to the user more reasonably, so that the degree of interest of the user in the recommended multimedia is better improved, the probability of playing the recommended multimedia by the user is further improved, and the multimedia recommendation effect is improved.

Meanwhile, by determining recommendable multimedia based on the second geographic position and the second object image, multimedia shared by other users in the same place and under the condition of paying attention to the same object image can be recommended to the user, interaction among different users can be improved, and interestingness of multimedia recommendation is also improved.

To facilitate understanding of the specific implementation of multimedia recommendation to the user of the terminal, the following describes such a case from the terminal side and the server side, respectively.

As shown in fig. 8, which shows a schematic flow chart of another multimedia recommendation method according to the present application, the method of the present embodiment is applied to a terminal, and the present embodiment may include:

and S801, determining a second geographic position and a second altitude of the terminal.

The second geographic location may be a second longitude and latitude of the terminal, and the second geographic location does not include information of the point of interest.

It is understood that, in this embodiment, the second geographical position is obtained and the second altitude is obtained at the same time, and in practical application, the second altitude may also be obtained before or after the second geographical position is obtained.

In one implementation, the terminal may automatically determine the longitude and latitude and the altitude of the terminal when detecting that the application enters a recommendation operation interface for multimedia recommendation. Under the condition that an opening instruction of the application is detected or a recommended operation interface of the application is displayed, the terminal can determine the second longitude and latitude and the second altitude of the terminal without detecting the positioning trigger operation of the user.

As shown in fig. 9a, in a case that it is detected that the application presents the recommended operation interface, the second longitude and latitude and the second altitude are automatically obtained, so as to update the map of the recommended operation interface based on the second longitude and latitude.

In another implementation, the terminal detects the recommended trigger operation, and determines the second geographical location information and the second altitude. And if the terminal detects that the user clicks an operation option for requesting the recommendation of the multimedia, determining a second geographical position and a second altitude.

For example, in fig. 9a, for example, the recommendation operation interface 910 may include a first operation option 911, such as "my" in the figure, for requesting multimedia sharing to the server, and a second operation option 912, such as "find" in the figure, for requesting multimedia recommendation to the user of the terminal, so that if the user clicks "find", which indicates that the user wishes to recommend multimedia information to the user, the terminal determines longitude and latitude and altitude.

It is understood that, in the same geographical location, the height of the user is different, and the actual location or environment of the user may also be different. For example, a geographic location may be directed to a business building, and some layers of the business building may be shopping malls, and some layers may be different companies, etc. The states of the user shopping in the shopping mall and working or overtime in the company are different, and multimedia such as music and the like which the user wants to hear are also different. Based on the method, the second altitude of the terminal is obtained, and the method is beneficial to recommending multimedia for the user more accurately and reasonably subsequently.

Of course, obtaining this second altitude is an alternative.

S802, based on the second geographic position, a second map is obtained from the server and displayed.

If the terminal sends the second longitude and latitude information corresponding to the second geographic position to the server, the server obtains the data of the second map according to the second longitude and latitude information. The terminal may present the second map after receiving the data of the second map.

Optionally, the second map may be marked with information of a second longitude and latitude.

Of course, the above is only one implementation way of outputting the second map in the terminal based on the geographic location of the terminal, and the application is not limited to other possible situations.

And S803, responding to the positioning trigger operation, and acquiring the selected second interest point information in the second map.

For example, the location trigger operation may be a click or selection operation of a point of interest in the second map. Correspondingly, the terminal can determine the selected second interest point to obtain second interest point information.

The second interest point information at least may include an identifier of the second interest point and longitude and latitude information corresponding to the second interest point, and of course, may also include other information related to the second interest point.

It is understood that step S803 is only one implementation of acquiring the second geographic location information containing the second point of interest information in response to the input positioning trigger operation. If the positioning triggering operation does not need to be input, the terminal determines second interest point information related to the second longitude and latitude according to the second longitude and latitude; or, obtain the second point of interest information input by the user, etc., which will not be described herein.

It can be understood that, in practical application, the terminal may also obtain only the information of the second geographic location representing the longitude and latitude where the terminal is located without obtaining the information of the second point of interest, and in this case, the terminal may automatically obtain the information of the second geographic location; or when the positioning trigger operation is acquired, the second geographic location information may be acquired, and at this time, the positioning trigger operation may be the aforementioned recommended trigger operation.

Optionally, in order to increase the information dimension according to which the multimedia is recommended, the terminal may further obtain the selected second point of interest information on the basis of obtaining a second geographic location indicating the longitude and latitude where the terminal is located.

S804, in response to the input object acquisition operation, at least one frame of second object image acquired by the camera of the terminal is acquired.

The object acquisition operation is used for triggering the terminal to start the camera and acquire images. The process of acquiring the second object image in response to the object acquisition operation is similar to the process of acquiring the first object image, and is not described in detail.

Similarly, the terminal may further obtain the selected at least one frame of the second object image from an image library of the terminal in response to the input object selection operation.

And S805, responding to the second recommendation confirmation operation, and sending a multimedia recommendation indication to the server.

And the second recommendation confirmation operation is used for instructing the server to execute the multimedia recommendation.

And if the terminal detects the input second recommendation confirmation operation, the terminal indicates that the user confirms the information of various dimensions required by recommending the multimedia, and if the user confirms that the multimedia recommendation is obtained based on the second geographic position and the second object image.

Wherein the multimedia recommendation indication is used for instructing the server to match at least one piece of multimedia information at least according to the second geographic position information and the at least one frame of second object image.

The multimedia recommendation indication implementation instructing server has various possibilities for implementing the information association storage:

for example, in a possible case, in response to the second recommendation confirmation operation, the terminal sends a multimedia recommendation indication carrying the second geographic location and at least one frame of the second object image to the server, so that the server obtains at least one piece of multimedia information to be recommended to the user of the terminal according to the second geographic location information and the second object image. That is, the terminal transmits the second geographical location information and the second object image to the server to instruct the server to match the multimedia information upon detecting that the second recommendation confirmation operation is input.

In yet another possible case, after step S801, the terminal transmits the second longitude and latitude and the second altitude to the server; after step S803, the terminal sends the second point of interest information to the server; after step S804, the terminal transmits the at least one frame of the second object image to the server. In this case, in step S805, the terminal transmits the multimedia recommendation indication to the server, and may indicate that information on which the server needs to recommend multimedia has been completely transmitted, so that the server matches at least one multimedia according to the second point of interest information, the second altitude, and the at least one frame of the second object image.

It should be noted that, on the premise that the terminal sequentially sends the corresponding information to the server according to the sequence of the second interest point and the sequence of the at least one frame of second object image, after the terminal sends the at least one frame of second object image to the server, the step S805 may not be executed, and the server side may automatically match the at least one multimedia information according to the received second interest point information and the at least one frame of second object image.

Correspondingly, similar to the foregoing embodiment, after the terminal obtains the second point of interest information and sends the second point of interest information to the server, the server may also automatically match at least one piece of multimedia information to be recommended that matches the second point of interest information and send the multimedia information to the terminal. The terminal can cache the at least one multimedia to be recommended, and of course, can also present the at least one multimedia information to be recommended. In this case, after the terminal transmits at least one frame of the second object image to the server, the server may match at least one piece of multimedia information from the at least one piece of multimedia information to be recommended based on the at least one frame of the second object image, and transmit the matched at least one piece of multimedia information to the terminal. And the terminal can obtain the matched at least one multimedia information from the server.

S806, user experience information related to the at least one piece of multimedia information and the at least one piece of multimedia information returned by the server is obtained.

It can be understood that, in the case that the server side stores the multimedia-related interest point information, the object image (or the object information in the object image), and the user experience information, the matched at least one multimedia information is returned to the user, and simultaneously the matched multimedia-related user experience information can also be returned to the user, so that the user can intuitively know the user experience issued by the other user on the at least one multimedia information.

S807, displaying the at least one multimedia message and the user experience information associated with the at least one multimedia message, so as to recommend the at least one multimedia message and the user experience information to the user.

And in consideration of the limitation of a display interface of the terminal, only displaying part of the content of the user experience information related to the multimedia information while the terminal displays the at least one multimedia information. The method can also be as follows: and marking a prompt identifier for prompting that the user experience information is associated for each displayed multimedia information according to whether the multimedia information is associated with the user experience information.

Accordingly, after the at least one multimedia message is displayed, a target multimedia selected by the user from the at least one multimedia is determined. Then, the terminal can present a detail page of the target multimedia and present user experience information associated with the target multimedia in the detail page.

It is to be understood that matching the at least one multimedia message with the user experience information associated with the at least one multimedia message and feeding back the matched user experience information to the terminal is merely one implementation. In practical applications, the server may only feed back the at least one multimedia message to the terminal. After the terminal displays the at least one piece of multimedia information, the terminal can determine a target multimedia selected by the user from the at least one piece of multimedia, and then request user experience information associated with the target multimedia from the server; correspondingly, the terminal can display the detail page of the target multimedia according to the user experience information related to the target multimedia returned by the server, and display the user experience information related to the target multimedia in the detail page.

Optionally, after the terminal displays the at least one multimedia message, the user of the terminal may also publish a comment or express user emotion information for a certain multimedia in the at least one multimedia message. Accordingly, the terminal may determine a target multimedia selected by the user from the at least one multimedia after presenting the at least one multimedia information; then, the terminal can obtain the user experience information input by the user aiming at the target multimedia, and send the user experience information input by the user to the server, so that the server stores the user experience information sent by the terminal and the target multimedia information in a correlation mode. For example, the terminal responds to the input experience editing operation to acquire the user experience information aiming at the target multimedia input.

Of course, after the server confirms that the user experience information of the target multimedia is stored, the server notifies the terminal, and the terminal displays the user experience information input by the user of the terminal in the detail page of the target multimedia.

For example, referring to FIG. 9b, a schematic diagram of an interface for a user to post user experience information is shown.

As can be seen from fig. 9b, after the user selects a piece of multimedia, the terminal presents a multimedia detail page 920, in which not only the presentation area 921 of the multimedia can be included, for example, the presentation area can present a playing identifier of the multimedia, which can be a music link and a music icon for realizing music playing, and so on. Meanwhile, a plurality of pieces of user experience information 922 associated with the multimedia are also displayed in the multimedia detail page 920.

In addition, there is an information sharing edit item 923, such as "write your story" in fig. 9, on the multimedia details page. After the terminal detects that the user clicks the information sharing editing item of 'writing your story', the terminal can display an information editing bar or an information editing interface and acquire user experience information input by the user in the information editing bar or the information editing interface. Then, the terminal can send the user experience information to the server; meanwhile, after the server checks the multimedia detail page, the terminal can display the user experience information edited by the user in the multimedia detail page.

It can be seen that, in this embodiment, after the terminal sends the second point of interest information representing the geographic location of the terminal and the obtained at least one frame of second object image to the server, the terminal may obtain the multimedia information matched with the second point of interest information and the at least one frame of second object image from the server, so as to obtain the multimedia information matched with the environment where the user is located and the object concerned or faced by the user, so that the user may obtain the multimedia more suitable for the context where the user is located.

In addition, the server can recommend the second geographic position information of the user and the multimedia matched with the concerned second object image for the user according to the incidence relation between the multimedia shared by other users and the geographic position information and the object images, so that the user can acquire the multimedia information shared by other users under the same situation, the preference of other users under the same situation can be known, the interaction of the multimedia among different users can be improved, and the diversity and the interestingness of multimedia recommendation can be improved.

For example, in the case where a user is in a corporate building and the user is working overtime, the user is facing a computer, in which case the user may wish to learn the music that others are listening to while the corporate building is working overtime. On the basis, the user can send the second interest point selected by the user to the server through the terminal, and after the terminal is used for shooting the image of the computer, the image of the computer is sent to the server. Correspondingly, the server returns music and user experience information which are shared by other users and are related to the company building and the computer image, so that the user can acquire the music which is liked by the other users when the company overtime.

Next, description will be made from the server side for a case where multimedia is recommended to the user of the terminal. As shown in fig. 10, which shows another flow diagram of another multimedia recommendation method according to the present application, the present embodiment is applied to a server, and the present embodiment may include:

and S1001, acquiring a second geographic position and a second altitude sent by the terminal.

In this embodiment, the second geographic location is used to represent a second longitude and latitude where the terminal is located.

And S1002, returning a second map to the terminal based on the second geographic position so as to output the second map at the terminal.

S1003, second interest point information sent by the terminal is obtained.

Similar to the operation of the terminal side in fig. 8, in the case where the second point of interest information input by the user is obtained on the terminal side, the server does not need to return the second map for the terminal either.

Optionally, after obtaining the second interest point information, the server may further match at least one piece of multimedia information to be recommended that is matched with the second interest point, and send the at least one piece of multimedia information to be recommended to the server.

It is understood that, in this embodiment, the second geographic location information includes the second point of interest information as an example, and in the case that the second geographic location information merely recommends multimedia for the longitude and latitude of the terminal, the steps S1002 and S21002 need not be executed. In this case, the server may also obtain at least one piece of multimedia information to be recommended that matches the second geographic location information and send the multimedia information to the terminal when the second geographic location is obtained.

S1004, at least one frame of second object image sent by the terminal is obtained.

S1005, in response to the multimedia recommendation indication sent by the terminal, obtaining at least one multimedia message matched with the second point of interest information, the second altitude and the at least one frame of second object image and user experience information associated with the at least one multimedia message respectively according to the stored association relationship between the multimedia message and the point of interest information, the at least one frame of object image and the altitude.

The association relationship between the multimedia information and the point of interest information, the at least one frame of object image, and the altitude may be obtained according to the association relationship between the multimedia and the first point of interest information, the at least one frame of first object image, and the altitude recommended by the user of the terminal to the server in the foregoing embodiments of fig. 2 to 6. Of course, the association relationship may also be set by a manager of the server or obtained by other methods, which is not limited.

In addition, matching the at least one multimedia message based on the object relationship is only one implementation manner, and is also applicable to the embodiment for other manners.

The multimedia recommendation indication can be referred to the related description of fig. 8. If the multimedia recommendation indicator carries the second point of interest information, the second altitude, and the at least one frame of second object image, in the above steps S1004 to S1005, it may be understood that the server obtains the second point of interest information, the second altitude, and the at least one frame of second object image sent by the terminal by analyzing the multimedia recommendation indicator.

If the multimedia recommendation indication merely indicates that the server matches multimedia according to the received second interest point information, the second altitude and the at least one frame of second object image, the server actually receives the second interest point information, the second altitude and the at least one frame of second object image sent by the terminal before receiving the multimedia recommendation indication.

It can be understood that, in this embodiment, it is exemplified that after the terminal sends the multimedia recommendation indication, the server matches the at least one multimedia message, and in practical application, after the server acquires the at least one frame of the second object image, the server may also obtain the at least one frame of the second object image

And S1006, returning the at least one multimedia message and the user experience information respectively associated with the at least one multimedia message to the terminal.

In this embodiment, obtaining the user experience information is also an optional operation.

For ease of understanding, the case of recommending multimedia to a user of a terminal is described below in connection with an application scenario. Taking an application scenario of recommending music to a user based on a music playing application as an example, fig. 11 shows a schematic diagram of another multimedia recommendation method in an application scenario.

In fig. 11, a plurality of interfaces presented by the terminal under the condition of acquiring different information are displayed, which are a recommendation operation interface 1110, an interest point selection interface 1120, an image scanning interface 1130, a music recommendation interface 1140, and an interface 1150 of a music detail page. Meanwhile, the interaction instruction of the terminal and the server under different interfaces is given.

To facilitate understanding of fig. 11, the following description is made in conjunction with the flowchart interaction diagram of fig. 12. Fig. 12 is a schematic view illustrating a flow interaction of still another multimedia recommendation method in the present application in a scenario of recommending music to a user, where the embodiment may include:

s1201, the terminal determines a second longitude and latitude and a second altitude of the terminal.

As explained in connection with fig. 11, after the terminal detects that the user opens the music playing application, a recommendation operation interface 1110 is presented, in which case the terminal may determine a second longitude and latitude and a second altitude. Alternatively, the user may click a trigger option in the recommendation operation interface 1110 for requesting music recommendation, such as a "find" option in the interface 1110, which may trigger the terminal to determine the second longitude and latitude and the second altitude.

And S1202, the terminal sends the second longitude and latitude and the second altitude to a server.

S1203, the server acquires a second map based on the second longitude and latitude, and acquires at least one piece of first to-be-recommended multimedia information matched with the second longitude and latitude and the second altitude.

For convenience of distinguishing, the multimedia to be recommended matched with the second longitude and latitude and the second altitude is called first multimedia information to be recommended, and the subsequent multimedia information to be recommended screened out based on the second interest point information is called second multimedia information to be recommended.

S1204, the server sends the second map and the at least one first multimedia information to be recommended to the terminal.

And S1205, the terminal displays the second map and displays the at least one piece of multimedia information to be recommended on the second map.

Still referring to fig. 11, if the "find" option is in the selected state in the recommendation operation interface 1110, the terminal is in a state of requesting to recommend multimedia, in which case, the second map is displayed in the recommendation operation interface. The latitude and longitude 1111 where the terminal is located and some points of interest 1112 existing around the latitude and longitude 111 are indicated in the second map.

Meanwhile, in order to enable the user to know which interest points around the current geographic position of the terminal are associated with multimedia shared by other users, the interest points with associated multimedia can be identified in the second map. As shown in fig. 11, a prompt marker 1113 is further identified beside a part of the interest points, and the prompt marker 1113 is used for prompting that the interest point is associated with music information shared by other users.

In addition, in order to make the user know the multimedia information matching with the second longitude and latitude and the second altitude where the terminal is located, a music recommendation preview area 1114, which may display at least one piece of music information matching with the second longitude and latitude and the second altitude, is also displayed in the multimedia recommendation interface 110.

Certainly, the server returns the at least one second multimedia information to be recommended to the terminal, and simultaneously, the user experience information associated with the second multimedia information to be recommended can be matched and returned. As in fig. 11, in addition to information of music, a music story "shift change destiny" is displayed in the music preview area 1114.

And S1206, the terminal responds to the interest point selection operation and acquires the information of the second interest point selected by the user from the second map.

S1207, the terminal sends the information of the second point of interest to the server.

S1208, the server matches at least one piece of second to-be-recommended multimedia information from the at least one piece of first to-be-recommended multimedia information according to the information of the second interest point, and sends the at least one piece of second to-be-recommended multimedia information to the terminal.

S1209, the terminal displays the at least one second multimedia information to be recommended matched with the second interest point information in a second map.

As described in conjunction with fig. 11, the user may select the interest point in the operation recommendation interface 1110 where the user is located or the user wants to view the interest points of music shared by other users, and then, according to the interest point selected by the user, a second interest point selected by the user may be marked in the operation recommendation interface, as shown in the interest point selection interface 1120 in fig. 8. The point-of-interest selection interface 1120 marks a user-selected second point-of-interest 1121 as "XX park".

Meanwhile, after the terminal sends the information of the second interest point to the server, at least one piece of second multimedia information to be recommended, which is returned by the server and is matched with the second interest point, is displayed below the interest point selection interface. Such as recommended music information and music stories below the point of interest selection interface 1120, which is similar to the operation recommendation interface and will not be described herein.

And S1210, the terminal responds to the image acquisition operation and acquires a second object image through the camera.

To illustrate in connection with FIG. 11, assuming that a user is viewing roses in a "XX park," the user may click on a "sweep" option 1122 in the interest selection interface 1120 if the user wishes to know that other users are in the same park to view music listened to by the roses, or to be able to obtain music that fits the user's current view. In this case, the terminal will start the camera to scan the image and enter the image scanning interface 1130.

As shown in fig. 11, an image of the scanned rose 1131 is displayed on the image scanning interface. Correspondingly, when the user confirms that the image of the rose is taken as the second object image, the terminal sends the image of the rose to the server.

Of course, the interest selection interface 1120 may not set an option like "scan" but the user may open a function option bar in the interest selection interface and set a function item triggering image scanning in the function option bar.

S1211, the terminal transmits the second object image to the server.

S1212, the server matches out at least one piece of multimedia information from the at least one piece of second multimedia information to be recommended according to the second object image.

S1213, the server sends the at least one multimedia message to the terminal.

S1214, the terminal presents the at least one multimedia message.

Referring to fig. 11, after the terminal sends the scanned image of one rose to the server, the server will screen out multimedia information matching with the rose from at least one second multimedia to be recommended, so as to finally obtain a recommendation list of music information matching with the "XX park" and the rose and return the recommendation list to the terminal.

Accordingly, the terminal may present the recommendation list of the music information, as shown in the music recommendation interface 1140 in fig. 11. Of course, the server may also return the music information and return a music story matched with the music information for the terminal, so that the terminal displays the music story on the music recommendation interface.

In the music recommendation interface 1140, the user can select the target music to be played or viewed in detail, and the terminal requests the server for a music story associated with the target music, where the music story can be some user experience information shared by other users for the target music. Accordingly, after the server returns the music stories shared by the users corresponding to the target music for the terminal, the terminal may present a music detail page 1150 of the target music.

The music detail page 1150 includes basic information 1151 of the target music, such as a play button, a name, and the like. Also included in the music detail page are music stories 1152 published by different users.

In addition, after the user clicks on the option 1153 "leave music story" also included in the music detail page, the user can input a music story desired to be edited.

It is understood that, in the above embodiment of the present application, if the server does not match the multimedia according to the second geographic location information and the at least one second object image, the server may also reasonably recommend the multimedia according to the historical behavior of the user or the current location of the user. For example, referring to fig. 13, which shows another recommendation process in another multimedia recommendation method, this embodiment may be applied to a server, and the method of this embodiment may include:

s1301, under the condition that at least one piece of multimedia information matched with the second geographic position information and at least one frame of second object does not exist, the environment image collected by the terminal and the user characteristic information of the user stored in the multimedia recommendation platform are obtained.

Wherein, the user characteristic information is information related to one or more of attribute information of the user and behavior data of the user on the network platform. For example, the attribute information of the user may be user tag data such as gender, age, academic history, and hobbies of the user. The behavioral data may include: the user historically selects behaviors such as multimedia and the like or published speeches and the like in the multimedia recommendation platform.

The environment image is an image acquired by the indication terminal after the server is not matched with the multimedia in the previous mode. The environmental image may include an item, a scene, and the like.

Wherein the ambient image is optional.

S1302, matching multimedia information from a multimedia library according to the environment image, the user characteristic information and the recommendation reference information.

Wherein the recommendation reference information includes: one or more of the second geographic location, the second object image, the second point of interest information, and the second altitude.

For example, the feature information of the multimedia matched with the environment image, the user feature information and the recommendation reference information is identified by using a machine learning algorithm, and then the multimedia matched with the feature information is inquired from a multimedia library. Of course, other methods are also applicable to the present embodiment, and are not described herein again.

It is understood that the present embodiment matches multimedia by combining the environment image, the user feature information, and the recommendation reference information, but in practical applications, any two of the three information may also be combined, and the present invention is not limited thereto.

And S1303, recommending the matched multimedia information.

The application also provides a multimedia recommendation device corresponding to the multimedia recommendation method. For example, referring to fig. 14, which shows a schematic structural diagram of a multimedia recommendation apparatus according to the present application, the apparatus of the present embodiment may be applied to a terminal or a server, and includes:

a first location obtaining unit 1401, configured to obtain first geographic location information of a terminal;

a first image obtaining unit 1402 for obtaining at least one frame of a first object image;

a multimedia obtaining unit 1403, configured to obtain multimedia information that is selected and recommended by a user of the terminal;

a recommendation storage unit 1404, configured to store at least the first geographic location information, the first object image, and the multimedia information in association in a server.

In a possible implementation manner, the first location obtaining unit is specifically configured to obtain first geographic location information of the terminal in response to an input positioning trigger operation.

Optionally, when acquiring the first geographic location information of the terminal, the first location acquiring unit is specifically configured to acquire first interest point information used for representing a geographic location of the terminal.

Optionally, when the first location obtaining unit obtains the first point of interest information used for characterizing the geographical location of the terminal, it is specifically configured to,

outputting a first map in the terminal based on the geographical position of the terminal;

and acquiring the selected first interest point information in the first map.

In another possible implementation manner, the first image obtaining unit is specifically configured to obtain, in response to an input object collecting operation, at least one frame of a first object image collected by a camera of a terminal; or, in response to the input object selection operation, acquiring the selected at least one frame of first object image from an image library of the terminal.

Optionally, in the above apparatus, the method may further include:

the experience information acquisition unit is used for acquiring user experience information input aiming at the multimedia information after the multimedia acquisition unit acquires the multimedia information which is selected and recommended by the user of the terminal;

the recommendation storage unit is specifically configured to store the first geographic location, the first object image, the user experience information, and the multimedia information in a server in an associated manner.

The application also provides another multimedia recommendation device corresponding to the another multimedia recommendation method. Referring to fig. 15, which shows a schematic diagram of a composition structure of still another multimedia recommendation method according to the present application, the apparatus may be applied to a terminal or a server, and the apparatus may include:

a second location acquisition unit 1501, configured to determine second geographic location information where the terminal is located;

a second image obtaining unit 1502 for obtaining at least one frame of a second object image required for recommending multimedia;

a multimedia matching unit 1503, configured to match at least one multimedia message according to at least the second geographic location information and the at least one frame of second object image;

a multimedia recommending unit 1504 for recommending the at least one multimedia information.

Optionally, the apparatus may further include:

the pre-matching unit is used for acquiring at least one piece of multimedia information to be recommended, which is matched with the second geographical position information after the second position acquisition unit determines the second geographical position information of the terminal;

the multimedia matching unit is specifically configured to determine, at least according to the at least one frame of second object image, at least one piece of matched multimedia information from the at least one piece of multimedia information to be recommended.

In a possible implementation manner, the second location obtaining unit is specifically configured to obtain second geographic location information of the terminal in response to an input positioning trigger operation.

Optionally, the second location obtaining unit is specifically configured to obtain second interest point information used for characterizing a geographic location of the terminal when obtaining the second geographic location information of the terminal.

Optionally, when the second location obtaining unit obtains second interest point information used for representing the geographic location of the terminal, the second location obtaining unit is specifically configured to output a second map in the terminal based on the geographic location of the terminal; and acquiring the selected second interest point information in the second map.

In another possible implementation manner, the second image obtaining unit is specifically configured to, in response to an input object acquisition operation, obtain at least one frame of second object image acquired by a camera of the terminal; or, in response to the input object selection operation, acquiring the selected at least one frame of second object image from an image library of the terminal.

Optionally, in an embodiment of the above apparatus, the multimedia matching unit is specifically configured to match at least one piece of multimedia information and user experience information associated with the at least one piece of multimedia information, at least according to the second geographic position information and the at least one frame of second object image;

the apparatus may further include: and the experience information recommending unit is used for recommending the user experience information which is respectively associated with the at least one multimedia information when the multimedia recommending unit recommends the at least one multimedia information.

In the embodiment of the application, a multimedia recommendation device is further provided, and the multimedia recommendation device may be the aforementioned terminal or server. For example, refer to fig. 16, which shows a schematic structural diagram of a multimedia recommendation device according to an embodiment of the present application. In fig. 16, the multimedia recommendation apparatus may include: a processor 1601, and a memory 1602.

Optionally, the apparatus may further include: communication interface 1603, input unit 1604, and display 1605 and communication bus 1606. The processor 1601, the memory 1602, the communication interface 1603, the input unit 1604, and the display 1605 are all in communication with each other via a communication bus 1606.

In the embodiment of the present application, the processor 1601 may be a Central Processing Unit (CPU), an asic, or the like.

The processor may call a program stored in memory 1602. The memory 1602 is used to store one or more programs, which may include program code comprising computer operating instructions.

In a possible case, the multimedia recommendation method for sharing multimedia by a user according to the present application, where at least a program for implementing the following functions is stored in the memory:

acquiring first geographical position information of a terminal;

obtaining at least one frame of a first object image;

In another possible case, the multimedia recommendation method for recommending multimedia to a user of a terminal according to the present application includes storing in the memory at least the following levels for:

determining second geographical position information of the terminal;

matching at least one multimedia message according to at least the second geographic position information and the at least one frame of second object image; recommending the at least one multimedia information.

The memory 1602 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, the above-mentioned programs, and the like; the storage data area can store data created during the operation of the multimedia recommendation device.

Further, the memory 1602 may include a high-speed random access memory, and may also include a nonvolatile memory or the like.

The communication interface 1603 may be an interface of a communication module or the like.

The input unit may include a touch sensing unit sensing a touch event on the touch display panel, a keyboard, and the like.

The display 1604 includes a display panel, such as a touch display panel or the like.

Of course, the device structure shown in fig. 16 does not constitute a limitation to the multimedia recommendation device in the embodiment of the present application, and in practical applications, the multimedia recommendation device may include more or less components than those shown in fig. 16, or some components may be combined.

In another aspect, the present application further provides a storage medium, where computer-executable instructions are stored, and when the computer-executable instructions are loaded and executed by a processor, the method for multimedia recommendation is implemented as in any one of the above embodiments.

It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The foregoing is only a preferred embodiment of the present invention, and it should be noted that it is obvious to those skilled in the art that various modifications and improvements can be made without departing from the principle of the present invention, and these modifications and improvements should also be considered as the protection scope of the present invention.

Claims

1. A method for multimedia recommendation, comprising:

acquiring first geographical position information of a terminal;

obtaining at least one frame of a first object image;

2. The method of claim 1, wherein the obtaining the first geographical location information of the terminal comprises:

and responding to the input positioning trigger operation to acquire first geographical position information of the terminal.

3. The method of claim 1 or 2, wherein the obtaining at least one frame of the first object image comprises:

responding to the input object acquisition operation, and acquiring at least one frame of first object image acquired by a camera of the terminal;

or, in response to the input object selection operation, acquiring the selected at least one frame of first object image from an image library of the terminal.

4. The method according to claim 1 or 2, wherein the obtaining the first geographical location information of the terminal comprises:

and acquiring first interest point information used for representing the geographical position of the terminal.

5. The multimedia recommendation method according to claim 4, wherein the obtaining of the first point of interest information for characterizing the geographical location of the terminal comprises:

and acquiring the selected first interest point information in the first map.

6. The multimedia recommendation method according to claim 1, further comprising, after said obtaining the multimedia information selectively recommended by the user of the terminal:

obtaining user experience information input aiming at the multimedia information;

the at least associating and storing the first geographical position information, the first object image and the multimedia information in a server comprises:

and storing the first geographical position, the first object image, the user experience information and the multimedia information in a server in an associated manner.

7. A method for multimedia recommendation, comprising:

determining second geographical position information of the terminal;

recommending the at least one multimedia information.

8. The multimedia recommendation method according to claim 7, further comprising, after determining the second geographical location information of the terminal, the following steps:

acquiring at least one piece of multimedia information to be recommended matched with the second geographical position information;

the matching at least one multimedia message according to at least the second geographic location information and the at least one frame of second object image comprises:

and determining at least one matched multimedia message from the at least one multimedia message to be recommended at least according to the at least one frame of second object image.

9. The multimedia recommendation method according to claim 7, wherein the determining the second geographical location information of the terminal comprises:

and responding to the input positioning trigger operation to acquire second geographic position information of the terminal.

10. The method of claim 7 or 9, wherein the obtaining of the at least one frame of the second object image according to which the multimedia is recommended comprises:

responding to the input object acquisition operation, and acquiring at least one frame of second object image acquired by a camera of the terminal;

or, in response to the input object selection operation, acquiring the selected at least one frame of second object image from an image library of the terminal.

11. The multimedia recommendation method according to claim 7 or 9, wherein the obtaining of the second geographic location information of the terminal comprises:

and acquiring second interest point information used for representing the geographical position of the terminal.

12. The method of claim 11, wherein the obtaining second point of interest information characterizing a geographic location of the terminal comprises:

outputting a second map in the terminal based on the geographical position of the terminal;

and acquiring the selected second interest point information in the second map.

13. The multimedia recommendation method according to claim 7, wherein said matching at least one multimedia information according to at least said second geographical location information and said at least one frame of second object image comprises:

matching at least one piece of multimedia information and user experience information respectively associated with the at least one piece of multimedia information at least according to the second geographic position information and at least one frame of second object image;

while recommending the at least one multimedia information, further comprising:

and recommending user experience information which is respectively associated with the at least one piece of multimedia information.

14. A multimedia recommendation apparatus, comprising:

15. A multimedia recommendation apparatus, comprising:

16. A multimedia recommendation apparatus, comprising:

a processor and a memory;

the memory is configured to store the program, the program at least to:

acquiring first geographical position information of a terminal;

obtaining at least one frame of a first object image;

17. A multimedia recommendation apparatus, comprising:

a processor and a memory;

the memory is configured to store the program, the program at least to:

determining second geographical position information of the terminal;

recommending the at least one multimedia information.

18. A storage medium having stored thereon computer-executable instructions which, when loaded and executed by a processor, implement a method of multimedia recommendation as claimed in any of claims 1 to 6 or 7 to 13 above.