CN112115284B

CN112115284B - Multimedia recommendation method, device, equipment and storage medium

Info

Publication number: CN112115284B
Application number: CN201910537550.XA
Authority: CN
Inventors: 田元
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-06-20
Filing date: 2019-06-20
Publication date: 2024-04-26
Anticipated expiration: 2039-06-20
Also published as: CN112115284A

Abstract

The application discloses a multimedia recommendation method, a device, equipment and a storage medium, wherein the method comprises the following steps: determining second geographic position information of the terminal; obtaining at least one frame of second object image according to which the multimedia is recommended; matching at least one multimedia message based at least on the second geographic location information and the at least one second object image; the at least one multimedia information is recommended. The scheme of the application provides a more novel mode for recommending multimedia, and is beneficial to improving the multimedia recommending effect.

Description

Multimedia recommendation method, device, equipment and storage medium

Technical Field

The present application relates to the field of multimedia recommendation technologies, and in particular, to a multimedia recommendation method, device, equipment, and storage medium.

Background

Multimedia service platforms often involve recommending multimedia to a user or capturing multimedia shared by the user. For example, after the user accesses the multimedia service platform through the terminal, the multimedia server returns multimedia resources to be recommended to the user to the terminal. For another example, the user sends the information of the preferred multimedia to the server through the terminal, so that the server can recommend the multimedia to other users with the same preference.

However, the current multimedia platform recommends multimedia to the user or the multimedia platform recommends multimedia to the user in a single manner, which is not beneficial to improving the multimedia recommendation effect.

Disclosure of Invention

In view of the above, the present application provides a multimedia recommendation method, apparatus, device and storage medium, so as to provide a more novel multimedia recommendation method and facilitate improving the multimedia recommendation effect.

In order to achieve the above object, in one aspect, the present application provides a multimedia recommendation method, including:

acquiring first geographic position information of a terminal;

obtaining at least one frame of first object image;

acquiring multimedia information recommended by a user of the terminal;

at least the first geographical location information, the first object image and the multimedia information association are stored in a server.

In yet another aspect, the present application further provides a multimedia recommendation method, including:

determining second geographic position information of the terminal;

obtaining at least one frame of second object image according to which the multimedia is recommended;

matching at least one multimedia message based at least on the second geographic location information and the at least one frame of the second object image;

The at least one multimedia information is recommended.

In still another aspect, the present application further provides a multimedia recommendation apparatus, including:

the first position acquisition unit is used for acquiring first geographic position information of the terminal;

a first image obtaining unit configured to obtain at least one frame of a first object image;

The multimedia obtaining unit is used for obtaining the multimedia information recommended by the user selection of the terminal;

and the recommendation storage unit is used for storing at least the first geographic position information, the first object image and the multimedia information in a server in a correlated way.

The second position acquisition unit is used for determining second geographic position information of the terminal;

The second image obtaining unit is used for obtaining at least one frame of second object image according to which the multimedia is recommended;

A multimedia matching unit, configured to match at least one multimedia information according to at least the second geographic location information and the at least one frame of the second object image;

and the multimedia recommending unit is used for recommending the at least one piece of multimedia information.

A processor and a memory;

The processor is used for calling and executing the program stored in the memory;

the memory is used for storing the program, and the program is at least used for:

acquiring first geographic position information of a terminal;

obtaining at least one frame of first object image;

acquiring multimedia information recommended by a user of the terminal;

A processor and a memory;

determining second geographic position information of the terminal;

The at least one multimedia information is recommended.

In yet another aspect, the present application further provides a storage medium having stored therein computer executable instructions that, when loaded and executed by a processor, implement a multimedia recommendation method as described in any one of the above.

According to the technical scheme, the multimedia information can be recommended by combining the geographic position information of the terminal and the obtained object image, so that a novel multimedia recommendation mode is provided. Meanwhile, the geographic position information of the terminal actually characterizes the geographic environment of the user, and the object image can reflect the object focused by the user currently, so that multimedia is recommended based on the geographic position and the object image, and therefore, the multimedia suitable for the scene of the user is shared by the user, and the multimedia suitable for the scene of the user is recommended to the user more reasonably, and the multimedia recommendation effect is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram showing the composition and structure of an application scenario of a multimedia recommendation method of the present application;

FIG. 2 is a flow chart of a multimedia recommendation method of the present application;

FIG. 3 is a schematic flow chart of a multimedia recommendation method according to the present application;

FIG. 4 is a schematic flow chart of a multimedia recommendation method according to the present application;

FIG. 5 is a schematic diagram of a multimedia recommendation method in an application scenario according to the present application;

FIG. 6 is a schematic diagram showing an interaction of a multimedia recommendation method of the present application;

FIG. 7 is a flow chart of another multimedia recommendation method according to the present application;

FIG. 8 is a schematic view showing another process interaction of another multimedia recommendation method of the present application;

FIGS. 9a and 9b show two interface schematic diagrams in a terminal, respectively;

FIG. 10 is a schematic flow chart of another multimedia recommendation method of the present application;

FIG. 11 is a schematic diagram of another multimedia recommendation method according to the present application in an application scenario;

FIG. 12 is a schematic diagram showing an interaction of yet another multimedia recommendation method of the present application;

FIG. 13 is a schematic diagram showing another recommendation flow in yet another multimedia recommendation method of the present application;

FIG. 14 is a schematic diagram showing a structure of a multimedia recommending apparatus according to the present application;

FIG. 15 is a schematic diagram showing another structure of a multimedia recommending apparatus according to the present application;

fig. 16 is a schematic diagram showing a composition structure of a multimedia recommendation apparatus of the present application.

Detailed Description

The scheme of the application is suitable for recommending the multimedia selected by the user to the multimedia service system by the terminal and recommending the multimedia to the user of the terminal by the multimedia service system, so as to realize the recommendation of the multimedia by combining the environment in which the user is positioned, the facing scenes or things and the like.

Wherein the multimedia may be music, video or images, etc.

The multimedia service system of the application can be an instant messaging system with multimedia service, an audio/video playing system and the like. For easy understanding, the composition of the multimedia recommendation system to which the multimedia recommendation method of the embodiment of the present application is applied will be described.

As shown in fig. 1, the multimedia recommendation system may include: at least one terminal 101 and at least one server 102.

The terminal 101 may be a mobile phone, a tablet computer, a notebook computer, an intelligent sound device, etc.

The terminal 101 is installed with an Application (APP), based on which the terminal can establish a communication connection with a server 102 to which the APP belongs, and request multimedia from the server 102 or receive multimedia recommended by the server. For example, the application program may be an instant messaging application, and the instant messaging application may include a multimedia service function or an applet with audio and video playing function; as another example, the application may be an audio playing application or a video playing application, etc.

The server 102 may return the multimedia to the terminal when detecting that the terminal establishes a communication connection with the server, or return the multimedia to the terminal after receiving the multimedia request sent by the terminal.

Alternatively, the multimedia recommendation system may be provided with a plurality of servers, which may constitute a server cluster or a distributed server system.

It will be appreciated that in the present application, a multimedia resource may be stored in a server, such as a multimedia library stored in the server, where a plurality of multimedia is stored.

Optionally, the multimedia recommendation system may further include: a data storage device 103, which may establish a communication connection with a server for storing a multimedia library. Accordingly, the server 102 may query the multimedia library of the data storage device for multimedia and feed it back to the terminal.

In addition, the terminal may send multimedia information of a user selection recommendation (also understood as sharing) of the terminal to the server. Accordingly, the service

The server stores the multimedia information recommended (or otherwise shared) by the user so that the server recommends the multimedia information to other users in combination with the multimedia recommended by the user.

The multimedia recommendation method according to the embodiment of the present application can be applied to the terminal or the server mentioned above, and the multimedia recommendation method according to the present application is described below with reference to the flowchart.

The multimedia recommendation of the application relates to the recommendation of two cases, wherein one case is that a terminal recommends multimedia information selected by a user of the terminal to a server so as to share the multimedia information recommended by the user to other users of a multimedia recommendation system; and recommending the multimedia to the user of the terminal for the server so as to reasonably recommend the multimedia suitable for the user.

The following describes first a case where a terminal recommends to a server a multimedia selected by a user of the terminal, i.e. the user shares the multimedia.

As shown in fig. 2, which is a schematic flow chart illustrating an embodiment of a multimedia recommendation method of the present application, the embodiment may be applied to the terminal or the server as mentioned above, and the method of the present embodiment may include:

s201, acquiring first geographic position information of a terminal.

The first geographic position information is information representing the current geographic position of the terminal.

For example, in one possible scenario, the first geographic location information may be latitude and longitude information of the terminal, for example, latitude and longitude information of the terminal determined by a global positioning system (Global Positioning System, GPS) technology.

In yet another possible scenario, the first geographic location information may be first point of interest information characterizing a geographic location in which the terminal is located. Among these, points of interest (Point of Interest, POIs) are some geographic objects that can be abstracted as points, especially geographic entities that are closely related to people's lives. It can be seen that the point of interest itself includes latitude and longitude information and geographic object information. For example, the point of interest may be a supermarket, a bank, a restaurant, etc. at a location. The description capability and the query capability of the object or event position can be enhanced through the interest points, and the accuracy of geographic positioning is improved.

It can be understood that the first interest point information may be determined by combining a first geographic location corresponding to the latitude and longitude where the terminal is located, or may be information of an interest point selected by a user of the terminal.

Alternatively, the obtaining the first interest point information may be: and outputting a first map in the terminal based on the geographic position of the terminal. Then, information of the selected first interest point in the first map is acquired.

It should be noted that, in order to facilitate distinguishing from the subsequent recommendation of the multimedia to the user of the terminal, in the embodiment of the present application, in a scenario in which the user shares the multimedia by recommending the multimedia, the geographic location information of the terminal is referred to as first geographic location information, and the information of the point of interest where the terminal is located is referred to as first point of interest information. Correspondingly, in the process of recommending the multimedia to the user of the terminal, the geographic position information of the terminal is called second geographic position information, and the information of the interest point where the terminal is located is called second interest point information.

S202, at least one frame of first object image is obtained.

The first object image may include an image of an object, where the object may be various items or entities, such as trees, flowers, equipment, or buildings. The object may also be a scene, such as a sea or mountain scene.

Wherein the first object image may be used to characterize an object associated with multimedia information to be recommended by a user of the terminal. For example, the first object image may include an object of interest or interest to the user in order to associate the object as a multimedia presence for a desired recommendation.

It can be understood that in the process of sharing the multimedia by the user, the object image or the object video considered to be associated with the multimedia to be recommended by the user can be shared according to the need, so that the at least one frame of first object image can be one first object image or can be a first object video formed by multiple frames of first object images.

In addition, the first object image is an object image acquired by the terminal or the server during the process of sharing the multimedia by the user, and for convenience of distinction, the object image is referred to as a first object image, and the object image involved in the process of subsequently recommending the multimedia to the user of the terminal is referred to as a second object image.

And S203, acquiring the multimedia information recommended by the user selection of the terminal.

The multimedia information may be one or more of the name of the multimedia, the link address of the multimedia, the content of the multimedia, etc. which the user of the terminal needs to share.

It can be understood that, in the case where the present embodiment is applied to the terminal side, the terminal side may automatically acquire the above first geographical location information, at least one frame of the first object image, and the multimedia information according to the operation of the user.

In the case where the present embodiment is applied to the server side, the server may acquire the above first geographic location, at least one frame of the first object image, and the multimedia information transmitted by the terminal. For example, the server may acquire the three kinds of information at one time, or may acquire the three kinds of information sequentially according to a sequence.

And S204, at least the first geographic position information, the first object image and the multimedia information are stored in a server in a correlated mode.

For example, at least the first geographical location information, the first object image and the multimedia information are stored as associated information associated with each other in the server, e.g. the first geographical information, the first object image and the multimedia information are stored in a record in a table of the server.

For the terminal side, the terminal side may associate the first geographic location information, the first object image and the multimedia information to obtain information to be shared, and then send the information to be shared to the server.

In one possible case, the information to be shared may include the first geographic location information, the first object image and the multimedia information, and the recommendation of the multimedia information and the first object image and the first geographic location information associated with the multimedia information to the server is achieved by sending the information to be shared.

In yet another possible case, the information to be shared may be indication information indicating that the first geographical location information, the first object image, and the multimedia information are stored in association, and the indication information carries the multimedia information. The method is suitable for the terminal to sequentially send the first geographic position and the first object image to the server, and after the multimedia information is obtained, the information to be shared is sent to the server.

Particularly, if the information to be shared includes the multimedia information, and the server receives the multimedia information, the first geographic position information, the first object image and the multimedia information which are sequentially sent by the terminal are associated and stored.

For the server side, after acquiring the first geographic position, the first object and the multimedia information selected by the user of the terminal, which are sent by the terminal, the server may establish and store an association relationship between the first geographic position, the first object image and the multimedia information.

For example, the server sequentially receives the first geographic location, the first object image and the multimedia information, and stores the three in association after receiving the multimedia information.

For another example, the server receives information to be shared sent by the terminal, where the information to be shared may include the first geographic location, the first object image and the multimedia information, and of course, the information to be shared may also indicate that the three are stored in association. In this case, the server stores the first geographic location, the first object image, and the multimedia information in association in the server based on the information to be shared.

Optionally, the user of the terminal may wish to publish and share comments, insight, etc. related to the multimedia information while sharing the multimedia information, so that the user experience information for the multimedia information input may also be obtained before the step S204. Accordingly, in step S204, at least the first geographic location, the first object image, the user experience information, and the multimedia information may be stored in association with each other in the server.

Further, in order to more accurately reflect the position of the user of the terminal, the altitude of the terminal may also be obtained before the step S204, and in order to facilitate the distinction, the altitude of the terminal is referred to as the first altitude in the multimedia scene shared by the user. Correspondingly, the first geographic position, the first altitude, the first object image, the user experience information and the multimedia information are stored in a server in a correlated mode.

It will be appreciated that after the server stores the association between the multimedia information selected for recommendation by the user and the information such as the first geographical location, the first object image, etc., the server may recommend multimedia to other users based on the stored association, so as to recommend multimedia information related to the current location of the user, the object of interest or interest, etc.

Therefore, through the scheme of the embodiment, the user can recommend the object image focused or interested by the user at the position and the multimedia information to be shared to the server through the terminal, and the position, the focused or interested object and the multimedia information of the user are stored in the server in a correlated manner, so that a more novel mode for sharing the multimedia by the user is provided.

Meanwhile, the first geographic position information of the terminal actually characterizes the geographic environment of the user, and the first object image can reflect the object which the user pays attention to or is interested in currently, so that in the process of recommending the multimedia information by the user, the recommended multimedia information, the geographic position information of the user and the object image reflecting the object which the user pays attention to are associated and stored in the server, and the multimedia information suitable for the position of the user and the object which pays attention to can be shared to the server, so that multimedia sharing which is more suitable for the scene of the user is realized, and the multimedia recommending effect is improved.

And based on the multimedia information shared by the users and the associated geographic position and object image, the server is also beneficial to more reasonably recommending multimedia which is suitable for the positions of other users and related to the concerned object image to other users, and is beneficial to improving the effect of recommending the multimedia to the users.

In order to facilitate understanding of the specific implementation of the recommendation of multimedia to the server by the user via the terminal, this situation is described below from the terminal side and the server side, respectively.

Fig. 3 is a schematic flow chart of another embodiment of a multimedia recommendation method of the present application, where the method of the present embodiment is applied to a terminal, and the embodiment may include:

s301, determining a first geographic position and a first altitude of the terminal.

In this embodiment, the first geographic location is a first longitude and latitude of the terminal, and the first geographic location does not include information of the point of interest.

The first altitude is the altitude at which the terminal is located in the first geographic location. For example, the terminal may determine altitude using an altimeter or the like within the terminal.

In one possible implementation, the terminal may automatically determine its longitude and latitude and altitude upon detecting that the application enters a recommendation interface for multimedia recommendation. As shown in fig. 5, in the case of detecting an opening instruction of an application or presenting the recommended operation interface 510 of the application, the terminal automatically determines the first geographic location without any input of any operation by the user, so as to present a map containing the longitude and latitude of the terminal in the recommended operation interface 510.

In yet another possible implementation manner, the terminal may further determine the first geographic location and the first altitude when detecting the input sharing trigger operation. If the terminal detects that the user clicks an operation option for requesting sharing of the multimedia information, a first geographic position and a first altitude are determined.

For example, in fig. 5, the recommendation operation interface 510 may include a first operation option 511 for a user to request to share multimedia with a server, such as "my" in the recommendation operation interface 510, and a second operation option 512 for requesting the server to recommend multimedia for the user of the terminal, such as "find" in the recommendation operation interface 510, so if the user clicks "my", it is indicated that the user wants to implement multimedia sharing by recommending multimedia information to the server, in which case, the longitude and latitude and altitude of the terminal may be determined.

In this embodiment, the first altitude is obtained while the first geographic location is obtained, and in practical application, the first altitude may be obtained after the first geographic location is obtained. In addition, if sharing of multimedia is not desired, sharing of the altitude of the terminal can also obtain the first altitude of the terminal.

S302, acquiring a first map from a server based on the first geographic position and displaying the first map.

If the terminal sends the longitude and latitude information of the first geographic position to the server, the server can acquire the data of the first map according to the first geographic position. The terminal may present the first map after receiving the data of the first map.

The steps S301 and S302 above are one implementation manner in which the terminal side outputs the first map in the terminal based on the geographic location of the terminal, which is not limited herein, and other practical applications are possible.

S303, responding to the positioning triggering operation, and acquiring the selected first interest point information in the first map.

For example, the location trigger operation may be an operation of clicking or selecting a point of interest in the first map. Correspondingly, the terminal can determine the selected first interest point to obtain first interest point information.

The first interest point information may include an identifier of the first interest point and longitude and latitude information corresponding to the first interest point, and of course, may also include other information related to the first interest point, which is not limited herein.

It will be appreciated that steps S302 and S303 are merely one implementation way to obtain the first interest point information characterizing the location of the terminal, and that in practical applications, other ways are possible to obtain the first interest point information. If the positioning triggering operation does not need to be input, the terminal determines first interest point information according to the first longitude and latitude; or obtain the first interest point information input by the user, and the like, which are not described herein.

It may be understood that, in this embodiment, the obtained first geographical location information includes first interest point information as an example, in practical application, the terminal may not obtain information of the first interest point, but only obtain a first geographical location characterizing latitude and longitude of the terminal, where the terminal may automatically obtain the first geographical location information; the first geographic location information may also be obtained when a positioning trigger operation is obtained, where the positioning trigger operation may be the aforementioned sharing trigger operation.

S304, responding to input object acquisition operation, and acquiring at least one frame of first object image acquired by a camera of the terminal.

The object acquisition operation is used for triggering the terminal to start the camera and acquire images. Correspondingly, the terminal responds to the object acquisition operation, and at least one frame of first object image acquired by the camera can be obtained.

For example, a function option such as "swipe one-swipe" may be set in a recommendation operation interface of an application of multimedia recommendation, and when the terminal detects that the user touches the function option, it is determined that an input object acquisition operation is detected, so as to acquire a first object image. For example, referring to fig. 5, an image acquisition interface 530 is an interface schematic diagram of a terminal activated camera to acquire an image, and a preview image or an image of an acquired object is displayed in the image acquisition interface 530.

It is understood that step S304 is only one implementation of obtaining at least one frame of the first object image. In practical application, the terminal may further obtain the selected at least one frame of the first object image from the image library of the terminal in response to the input object selection operation. For example, an option for triggering image uploading or image selection may be set in the terminal, and when the user clicks the option, it is determined that an input object selection operation is detected, so that an image library is displayed, so that the user can select an image or video as at least one frame of first object image.

S305, responding to the input multimedia selection operation, and determining the multimedia information of the selected recommendation from the presented multimedia list.

The multimedia information may include one or more of a name of the multimedia, a link address of the multimedia, and the like.

If the terminal detects the multimedia selecting operation, the terminal displays the multimedia list, determines the selected multimedia in the multimedia list and obtains the information of the selected multimedia. For example, the multimedia selection operation may be clicking on an operation option for triggering the selection of multimedia.

For another example, after the terminal acquires at least one frame of the first image, a multimedia list may be presented for selection by the user. In this case, the multimedia selecting operation may be an operation of selecting multimedia from a multimedia list.

It is to be understood that the multimedia information of this embodiment may also be input to obtain the input multimedia information, for example, the name or the link address of the multimedia to be recommended may be directly input by the user. As another example, multimedia information provided by a user through searching or the like is determined.

S306, responding to the information editing operation, and obtaining user experience information for the multimedia information input.

The user experience information may be user comments, expressed emotions, etc., and the form of the user experience information may include one or more of character strings (such as characters, etc.) and pictures.

For example, after an information editing operation for the multimedia information is detected, input user experience information is obtained. For example, the information editing operation may be an operation of inputting user feel information, or an operation of requesting input of user feel information.

For example, after determining the multimedia information selected by the user, an operation interface of the multimedia information may be presented, an information editing option may be included in the operation interface, the user clicks the information editing option, the terminal confirms that the information editing operation is received, and in response to the information editing operation, an information editing window is presented, and user experience information input in the information editing window is obtained.

It will be appreciated that this step S306 is an optional step, and in practical applications, the user may not share the user experience information.

It should be noted that, the order of determining the first interest point information, the multimedia information, and the user experience information by the terminal may be interchanged, and is not limited to the one shown in fig. 3.

S307, in response to the first recommendation confirming operation, an associated recommendation indication of the multimedia information is sent to the server.

The first recommendation confirmation operation is used for indicating to execute multimedia sharing, and when the terminal detects the input first recommendation confirmation operation, the user confirms that the multimedia information is shared, the first geographic position, the first object image, the user experience information and the like.

The associated recommendation indication is used for indicating that the first interest point information, the first altitude, the first object image, the user experience information and the multimedia information are associated and stored in a server.

There are many possible specific implementations of the implementation of the associated storage of the above information by the associated recommendation indication server:

For example, in one possible case, in response to the first recommendation confirmation operation, the terminal associates the first geographic location information, at least one frame of the first object image, user experience information and multimedia information to obtain information to be shared. And then, the terminal sends an associated recommendation instruction carrying the information to be shared to the server, so that the server stores the first geographic position information, the first object image, the user experience information and the multimedia information in an associated manner.

In yet another possible case, each time the terminal acquires information of one dimension associated with the multimedia information to be recommended, the acquired corresponding information is transmitted to the server. That is, after this step S301, the terminal transmits the first geographical location (first longitude and latitude) and the first altitude to the server; after the step S303, the terminal transmits the first point of interest information to the server; after the step S304, the terminal transmits the at least one frame of the first object image to the server; after this step S305, the terminal transmits the multimedia information to the server, and after this step S306, the terminal transmits the user experience information to the server. Accordingly, in the step S307, the associated recommendation indication may indicate that the server has completed sharing the multimedia information, so that the server may store the multimedia information in association with the first point of interest information, the first altitude, the first object image, and the like.

In step S307, after detecting the input first recommendation confirmation operation, the multimedia information is sent to the server, and in practical application, the terminal may automatically trigger to send the associated recommendation indication of the multimedia information to the server after detecting the user experience information.

According to the embodiment of the application, when the user recommends (shares) the multimedia information to the server through the terminal, the point-of-interest information and the altitude of the user and the user experience information of the user are simultaneously recommended to the server, so that the situation of the user recommending the multimedia is reflected based on the point-of-interest information, the altitude and the user experience information, and the more flexible sharing of the multimedia is realized, and the interaction among different users and the interestingness of the multimedia recommendation are facilitated.

For example, at a square, a user sees a statue very special, and when seeing the statue, the user wants a piece of music suitable for the current situation, in which case, the user can recommend the information of the music, the interest point of the user and the image of the statue to the server by way of the embodiment, so that the server can store the information in association.

In addition, the multimedia is recommended by combining the information of the interest points where the user is located and the altitude, so that the user can recommend the multimedia which is suitable for listening or watching in the current situation, and the server can accurately determine the multimedia which the user prefers under different situations.

The following description is made from the server side for the case where the user recommends multimedia to the server through the terminal. As shown in fig. 4, which shows a further flowchart of a multimedia recommendation method of the present application, the present embodiment is applied to a server, and the present embodiment may include:

S401, obtaining a first geographic position and a first altitude sent by a terminal.

In this embodiment, the first geographic location is used to characterize a first longitude and latitude where the terminal is located.

And S402, returning a first map to the terminal based on the first geographic position so as to output the first map at the terminal.

S403, obtaining first interest point information sent by the terminal.

It will be appreciated that, similar to the operation on the terminal side in fig. 3, in the case where the terminal obtains the first point of interest information input by the user, the server may not need to perform the operation of returning the terminal to the first map.

In the embodiment, taking the terminal sharing the first interest point information as an example, in practical application, if the terminal only shares the longitude and latitude of the terminal when sharing the multimedia information, the steps S401 to S403 may be replaced by obtaining the first geographic location information and the first altitude sent by the terminal.

S404, at least one frame of first object image sent by the terminal is obtained.

S405, obtaining multimedia information to be recommended, which is sent by the terminal.

S406, obtaining user experience information for the multimedia information sent by the terminal.

Wherein, this step S406 is an optional step.

The determination manners of the parameters in the above steps S401 to S406 may be referred to the related descriptions of the embodiments of fig. 3 and fig. 4, and are not repeated herein.

In one possible case, in the above steps S401 to S406, the server may sequentially receive the related information transmitted by the terminal.

In yet another possible scenario, the server receives the transmitted information to be shared, where the information to be shared includes the first point of interest information, the first altitude, the at least one frame of the first object image, the multimedia information, and the user experience information. Correspondingly, the server analyzes the information to be shared, and obtains the first interest point information, the first altitude, at least one frame of first object image, multimedia information and user experience information sent by the terminal.

And S407, in response to the associated recommendation indication sent by the terminal, storing the first interest point information, the first altitude, the first object image, the user experience information and the multimedia information in an associated manner.

The associated recommendation indication may be referred to in relation to the embodiment of fig. 3.

For example, after the terminal sequentially transmits the information related in S401 to S406 to the server, the terminal may transmit an association recommendation indication to the server, and the server may acquire and store the information received in advance.

For another example, when the association recommendation indication sent by the terminal carries the information to be shared, the server responds to the association recommendation information to obtain and store the first interest point information, the first altitude, the multimedia information and the like from the information to be shared carried in the association recommendation information.

Alternatively, it is considered that the images of the same object photographed by different users may also be different, and when sharing the multimedia information, the users actually wish to share the information of the object included in the first object image. Therefore, the server may identify the information of the object included in the at least one frame of the first object image, for example, the name of the object, the identifier of the object, or the truncated image of the truncated object, and then store the multimedia information in association with the information of the object, the first point of interest information, the first altitude, and so on.

Optionally, the server may record association relations between different multimedia information and the information such as the first interest point through a table. For example, taking multimedia as music, and the user experience information is a music story, the following table 1 may be used to record the associated information of the multimedia information shared by different users respectively:

TABLE 1

As can be seen from table 1, each of the table 1 is associated information such as multimedia information and related points of interest and objects. For example, the first interest point information associated with the music "lovely" includes that the interest point POI is "XX building" and the geographical location information "latitude and longitude 1, altitude 1". Meanwhile, the music story shared by the users associated with the music lovely is a 'lovely dog'.

For easy understanding, the case where the user recommends multimedia information to the server through the terminal will be described below with reference to an application scenario where the user shares music to the server through the terminal. Fig. 5 is a schematic diagram showing an application scenario of the multimedia recommendation method of the present application.

In fig. 5, music and related information that a user has issued a desired recommendation to a server through a terminal are illustrated as an example.

The application scenario of fig. 5 is described in detail below with reference to fig. 5, from the interaction of the terminal with the server side. Fig. 6 is a schematic flow interaction diagram illustrating the application of the multimedia recommendation method of the present application to the scene shown in fig. 5. The method of the embodiment can comprise the following steps:

s601, the terminal responds to the sharing triggering operation, and the first longitude and latitude and the first altitude where the terminal is located are determined.

If, in fig. 5, the terminal detects a sharing trigger operation for requesting to enter the recommendation operation interface, the recommendation operation interface 510 is presented, and in this case, the terminal may default to be in the recommendation operation interface 510 for multimedia sharing, such as the my option 511 in fig. 5 being in a selected state, where the user may continue to operate in the recommendation operation interface to implement publishing the music information that the user wishes to recommend to the server, so as to implement music sharing.

As another example, in the case of presenting the recommendation operation interface 510 of fig. 1, when the user is detected to click on the first operation option 511 for triggering music sharing, such as "my" in fig. 5, the terminal confirms that the sharing triggering operation is detected, thereby determining the longitude and latitude and altitude at which the terminal is located.

S602, the terminal sends the first longitude and latitude and the first altitude to a server.

S603, the server obtains a first map based on the first longitude and latitude, and returns the first map to the terminal.

S604, the terminal displays a first map returned by the server.

The first map may represent a location point having a first longitude and latitude.

S605, the terminal responds to the interest point selection operation to obtain information of a first interest point selected by a user from the first map.

This point of interest selection operation corresponds to the location trigger operation in the embodiment of fig. 3.

S606, the terminal sends the information of the first interest point to the server so that the server caches the information of the first interest point.

For example, in fig. 5, a first map is displayed in the displayed recommended operation interface 510, and a location point 513 of a first longitude and latitude where the terminal is actually located is marked in the first map. In the recommendation operation interface 510, the user may select a point of interest in the first map as a first point of interest associated with sharing music. Accordingly, the terminal may send the information of the first interest point to the server, and at the same time, the interest point sharing interface 520 as shown in fig. 5 may be displayed in the terminal. As can be seen in FIG. 5, a first user-selected point of interest 521 is indicated in the point of interest sharing interface 520. Meanwhile, the terminal sends the information of the first interest point to the server.

S607, the terminal responds to the image acquisition operation and acquires the first object image through the camera.

For convenience of description, this embodiment will be described by taking the acquisition of a first object image as an example.

And S608, the terminal sends the first object image to the server so that the server can identify the object in the first object image.

For example, the user may initiate image acquisition by clicking on the "swipe" option.

As described in connection with fig. 5, a "swipe" option (not shown in fig. 5) for triggering image acquisition may be set in the point of interest sharing interface 520 in fig. 5. Accordingly, after the terminal starts to collect the image, the terminal enters the image collection interface 530, and the image collection interface 530 displays a preview image of a collected flower 531 in fig. 5. After the user inputs the image confirmation command, the terminal may acquire the acquired first object image, and the terminal sends the first object image to the server, as shown by a connection between the image acquisition interface 530 and the server in fig. 5.

S609, the terminal responds to the multimedia selection operation to determine the shared multimedia information selected by the user.

And S610, the terminal sends the information of the multimedia to be shared to the server.

As described in connection with fig. 5, the terminal may present the multimedia sharing interface 540 after transmitting the first object image. In fig. 5, the multimedia sharing interface 540 may include a multimedia search bar 541 for users to search for multimedia such as music that is recommended. Alternatively, the multimedia sharing interface also includes a music list 542 for the user to select the desired recommended music. After detecting that the user selects or selects the music to be shared, the terminal obtains the music information and sends the music information to the server.

It can be understood that the embodiment of the application is illustrated by sequentially sending the first longitude and latitude, the first altitude and the first interest point of the terminal to the server according to the acquired time sequence. The same applies to the embodiment for the case of transmitting a plurality of kinds of information at one time as mentioned above.

S611, the terminal responds to the first recommendation confirming operation and sends an associated recommendation indication to the server.

If the user selects the multimedia information in the multimedia sharing interface 540 of fig. 5, a dialog box including "confirm" and "cancel" may be popped up in the multimedia sharing interface, and if the user clicks "confirm", the multimedia information is confirmed to be associated and shared with the first interest point information and the first object image obtained above.

Of course, before this step S611, the terminal may also obtain the user experience information shared by the user, which may be specifically described in the foregoing related description.

S612, the server stores the multimedia information in association with the first longitude and latitude, information of the object in the first object image, first interest point information, and first altitude in response to the association recommendation indication.

It may be understood that, in practical applications, after the terminal acquires the multimedia information and sends the multimedia information to the server, the server may also store the multimedia information and the information such as the first interest point in association without executing the step S611.

The following describes a case of recommending multimedia to a user of a terminal.

For example, referring to fig. 7, which shows a flowchart of still another method for recommending multimedia according to the present application, the present embodiment may be applied to a terminal or a server, and the present embodiment may include:

s701, determining second geographic position information of the terminal.

The second geographic location information may be latitude and longitude information where the terminal is located. The second geographic location information may further include: and the second interest point information representing the geographic position of the terminal. The second interest point information may include longitude and latitude where the terminal is located, and identification of the second interest point, and the like.

It can be understood that the second interest point information may be determined by combining the geographic position corresponding to the second longitude and latitude where the terminal is located, or may be information of an interest point selected by the user of the terminal. Alternatively, the obtaining the second interest point information may be: and outputting a second map in the terminal based on the current geographic position (such as longitude and latitude) of the terminal. Then, the selected second interest point information in the second map is acquired.

S702, at least one frame of second object image according to which the multimedia is recommended is obtained.

Wherein the second object image is likewise an image comprising an object, the details of which can be seen from the above description.

Similar to the first object image, the second object image is used to characterize the object with which the multimedia that the user wishes to obtain is associated. For example, the second object image may comprise an object of interest or interest to the user, such as an image of an object currently seen by the user of the terminal, or the like.

The at least one frame of second object image may be one second object image or may be a second object video composed of a plurality of frames of second object images, similar to the first object image.

And S703, matching at least one multimedia information at least according to the second geographic position information and the at least one frame of second object image.

The multimedia information may be one or more of a name, an icon, and a link address of the multimedia.

For example, in the case where the terminal side performs the present embodiment, the terminal may request at least one multimedia information matching at least the second geographical location information and the at least one frame of the second object image from the server based at least on the second geographical location information and the at least one frame of the second object image.

As another example, in the case of executing the embodiment on the server side, the server may acquire the matched at least one multimedia information from the multimedia library or the multimedia list according to the second geographical location information and the at least one frame of the second object image.

It will be appreciated that the specific implementation of the matched at least one multimedia information may be possible, for example, in the case that the server stores the association relationship between the multimedia information and the first geographic location and the at least one frame of the first object image in the embodiment of fig. 2 to 6, at least one multimedia matching at least the second geographic location and the at least one frame of the second object image may be obtained according to the association relationship between the multimedia and the geographic location and the object image.

In addition to combining the association relation stored in the server in advance, the second geographic position and the second object image can be combined, a machine learning algorithm is utilized to determine the feature type of the multimedia matched with the second geographic position and the second object image, and then the multimedia belonging to the feature type is matched from a multimedia library.

It can be understood that the second geographic location and the second object image can reflect the environment where the user is located and the object generating the sense of touch, and can intuitively reflect the situation where the user is located and the sense of touch, so that the matched multimedia can be related to the geographic location where the user is located and the objects such as the scenery or the object of interest by combining the second geographic location and the second object image, so that the multimedia can be more fit with the actual sense of the current situation of the user.

For example, the feelings of the user facing different objects in different geographic locations are different, and the music suitable for the user in different situations is also different, and if the user faces a fountain in a square, the music possibly related to the fountain is more suitable for the user, so that the music more suitable for the situation of the user can be obtained by combining the geographic location and the object image containing the fountain.

As an alternative, after determining the second geographical location information where the terminal is located in step S701, at least one multimedia information to be recommended that matches the second geographical location information may also be acquired first. Accordingly, in the step S703, at least one multimedia information that matches may be determined from the at least one multimedia information to be recommended at least according to the at least one frame of the second object image. The multimedia information to be recommended is matched according to the second geographic position of the terminal, and then the matched at least one multimedia information to be recommended is screened based on the at least one frame of second object image.

Optionally, according to the at least one frame of the second object image, a piece of multimedia information may be matched from the at least one piece of multimedia information to be recommended.

And S704, recommending the at least one piece of multimedia information.

For example, for the server side, the server may recommend the at least one multimedia to the terminal such that the terminal presents information of the at least one multimedia.

For the terminal side, the terminal outputs the at least one multimedia to achieve the purpose of recommending the at least one multimedia to the user.

Therefore, in the embodiment of the application, when the multimedia is recommended to the user of the terminal, at least one multimedia message is matched according to the second geographic position of the terminal and the obtained at least one frame of second object image, so that a more novel mode for recommending the multimedia to the user is provided.

In addition, as the second geographic position of the terminal actually characterizes the geographic environment of the user, and the second object image can characterize the object interested by the user in the geographic position, the recommended multimedia is determined based on the second geographic position and the second object image, so that the multimedia suitable for the scene of the user is recommended to the user more reasonably, the degree of interest of the user in the recommended multimedia is improved, the probability of playing the recommended multimedia by the user is improved, and the multimedia recommendation effect is improved.

Meanwhile, multimedia which can be recommended is determined based on the second geographic position and the second object image, multimedia which is shared by other users in the same place and focusing on the same object image can be recommended to the user, interaction among different users can be improved, and interestingness of multimedia recommendation is improved.

In order to facilitate understanding of the specific implementation of the recommendation of multimedia to the user of the terminal, this situation is described below from the terminal side and the server side, respectively.

Fig. 8 is a schematic flow chart of another multimedia recommendation method according to the present application, where the method of the present embodiment is applied to a terminal, and the method may include:

s801, a second geographic location and a second altitude of the terminal are determined.

The second geographic location may be a second longitude and latitude of the terminal, where the second geographic location does not include information about the point of interest.

It should be understood that, in this embodiment, the second altitude is obtained while the second geographic location is obtained, and in practical application, the second altitude may also be obtained before or after the second geographic location is obtained.

In one implementation, the terminal may automatically determine its longitude and latitude and altitude upon detecting that the application enters a recommendation interface for multimedia recommendation. Under the condition that an opening instruction of an application is detected or a recommended operation interface of the application is displayed, the terminal can determine the second longitude and latitude and the second altitude of the terminal without detecting positioning triggering operation of a user.

As shown in fig. 9a, when the application is detected to display the recommended operation interface, a second longitude and latitude and a second altitude are automatically acquired, so as to update the map of the recommended operation interface based on the second longitude and latitude.

In yet another implementation, the terminal detects a recommended trigger operation and determines the second geographic location information and a second altitude. If the terminal detects that the user clicks on an operation option for requesting recommendation of multimedia, a second geographic location and a second altitude are determined.

For example, in fig. 9a, the recommendation operation interface 910 may include a first operation option 911 for a user to request to share multimedia with a server, such as my in the figure, and a second operation option 912 for requesting to recommend multimedia to the user of the terminal, such as find in the figure, so that if the user clicks find, it is indicated that the user wants to recommend multimedia information to the user, the terminal determines longitude, latitude and altitude.

It will be appreciated that in the same geographical location, the heights of the users may be different, and the actual location or environment in which the users are located may be different. For example, a geographic location may be directed to a commercial building, and some floors of the commercial building may be malls, while some floors may be different companies, etc. The users can be in different states of shopping in the mall and working or overtime in the company, and the multimedia such as music which the users wish to hear can be different. Based on the method, the second altitude of the terminal is obtained, so that the follow-up more accurate and reasonable multimedia recommendation for the user is facilitated.

Of course, obtaining this second altitude is an alternative.

S802, acquiring a second map from the server based on the second geographic position and displaying the second map.

If the terminal sends the second longitude and latitude information corresponding to the second geographic position to the server, the server obtains the data of a second map according to the second longitude and latitude information. The terminal may present the second map after receiving the data of the second map.

Optionally, the second map may be marked with information of a second longitude and latitude.

Of course, the above is merely one implementation of outputting the second map in the terminal based on the geographical location of the terminal, and the present application is not limited to other possible situations.

S803, responding to the positioning triggering operation, and acquiring the selected second interest point information in the second map.

For example, the location trigger operation may be an operation of clicking or selecting a point of interest in the second map. Correspondingly, the terminal can determine the selected second interest point to obtain second interest point information.

The second interest point information may include at least an identifier of the second interest point and longitude and latitude information corresponding to the second interest point, and of course, other information related to the second interest point may also be included.

It is understood that step S803 is merely one implementation of acquiring second geographic location information including second point of interest information in response to the input location trigger operation. If the positioning triggering operation does not need to be input, the terminal determines second interest point information related to the second longitude and latitude according to the second longitude and latitude; or obtain second interest point information input by the user, etc., and will not be described in detail herein.

It can be understood that in practical application, the terminal may not acquire the information of the second interest point, but only acquire the information of the second geographic position representing the longitude and latitude of the terminal, where the terminal may automatically acquire the information of the second geographic position; the second geographical location information may also be obtained when a positioning trigger operation is obtained, where the positioning trigger operation may be the aforementioned recommended trigger operation.

Optionally, in order to increase the information dimension according to which the multimedia is recommended, the terminal may further obtain the selected second interest point information on the basis of obtaining the second geographical location representing the latitude and longitude where the terminal is located.

S804, responding to input object acquisition operation, and acquiring at least one frame of second object image acquired by a camera of the terminal.

The object acquisition operation is used for triggering the terminal to start the camera and acquire images. The process of acquiring the second object image in response to the object acquisition operation is similar to that of acquiring the first object image, and will not be described again.

Similarly, the terminal may further acquire the selected at least one frame of the second object image from the image library of the terminal in response to the input object selection operation.

And S805, transmitting a multimedia recommendation indication to the server in response to the second recommendation confirmation operation.

The second recommendation confirming operation is used for indicating the server to execute multimedia recommendation.

And when the terminal detects the input second recommendation confirmation operation, the terminal indicates that the user confirms the information of various dimensions according to which the multimedia recommendation is required, and if the user confirms that the multimedia recommendation is acquired based on the second geographic position and the second object image.

Wherein the multimedia recommendation indication is for instructing the server to match at least one multimedia message based at least on the second object image according to at least the second geographical location information and the at least one frame.

The specific implementation of the multimedia recommendation indication implementation indication server to store the above information in association with each other is possible in a plurality of ways:

For example, in one possible case, in response to the second recommendation confirmation operation, the terminal sends a multimedia recommendation indication carrying the second geographic location and at least one frame of second object image to the server, so that the server obtains at least one multimedia information to be recommended to the user of the terminal according to the second geographic location information and the second object image. That is, upon detecting the input of the second recommendation confirming operation, the terminal transmits the second geographical location information and the second object image to the server to instruct the server to match the multimedia information.

In yet another possible scenario, after step S801, the terminal sends the second longitude and latitude and the second altitude to the server; after step S803, the terminal transmits the second point of interest information to the server; after step S804, the terminal transmits the at least one frame of the second object image to the server. In this case, in step S805, the terminal sends the multimedia recommendation indication to the server, which may indicate that the information on which the server recommends multimedia is all sent, so that the server matches at least one multimedia according to the second point of interest information, the second altitude, and at least one frame of the second object image.

It should be noted that, on the premise that the terminal sequentially sends corresponding information to the server according to the sequence obtained by the second interest point and the at least one frame of the second object image, the step S805 may not be executed after the terminal sends the at least one frame of the second object image to the server, and the server side may automatically match at least one multimedia information according to the received second interest point information and the at least one frame of the second object image.

Correspondingly, similar to the previous embodiment, after the terminal obtains the second interest point information and sends the second interest point information to the server, the server may also automatically match at least one multimedia information to be recommended, which is matched with the second interest point information, and send the multimedia information to the terminal. The terminal may cache the at least one multimedia to be recommended, and of course, may also present the at least one multimedia to be recommended information. In this case, after the terminal transmits at least one frame of the second object image to the server, the server may match at least one multimedia information from the at least one multimedia information to be recommended based on the at least one frame of the second object image and transmit the matched at least one multimedia information to the terminal. And the terminal may obtain the matched at least one multimedia information from the server.

S806, user experience information respectively associated with the at least one multimedia information and the at least one multimedia information returned by the server is obtained.

It can be understood that, in the case that the point of interest information, the object image (or the object information in the object image) and the user experience information associated with the multimedia are stored at the server side, the matched at least one piece of multimedia information is returned to the user, and meanwhile, the matched user experience information associated with the multimedia can also be returned to the user, so that the user can intuitively know the user experience of other users on the at least one piece of multimedia information.

S807 displays the at least one multimedia information and user experience information associated with each of the at least one multimedia information to recommend the at least one multimedia information and the user experience information to the user.

Wherein, considering the limitation of the terminal display interface, the terminal displays the at least one multimedia information and only displays partial content of the user experience information associated with the multimedia information. It is also possible that: and marking a prompt identifier for prompting that the user experience information is associated with each displayed multimedia information according to whether the user experience information is associated with the multimedia information or not.

Accordingly, after the at least one multimedia message is displayed, a target multimedia selected by the user from the at least one multimedia is determined. Then, the terminal can display the detail page of the target multimedia and display the user experience information associated with the target multimedia in the detail page.

It will be appreciated that matching the user experience information associated with at least one multimedia information and feeding back to the terminal while the server matches the at least one multimedia information is only one implementation. In practical applications, the server may just feed back the at least one multimedia message to the terminal. After the terminal displays the at least one multimedia information, the terminal may determine a target multimedia selected by the user from the at least one multimedia, and then request the server for user experience information associated with the target multimedia; correspondingly, the terminal can display the detail page of the target multimedia according to the user experience information of the target multimedia association returned by the server, and display the user experience information of the target multimedia association in the detail page.

Optionally, after the terminal displays at least one multimedia information, the user of the terminal may also comment on a certain multimedia in the at least one multimedia or express emotion information of the user, etc. Accordingly, the terminal may determine a target multimedia selected by the user from the at least one multimedia after presenting the at least one multimedia information; then, the terminal can obtain user experience information of the user aiming at the target multimedia input, and send the user experience information input by the user to the server, so that the server can store the user experience information sent by the terminal and the target multimedia information in an associated mode. For example, the terminal acquires user experience information for the target multimedia input in response to an input experience editing operation.

Of course, after the server confirms that the user experience information of the target multimedia is stored, the server notifies the terminal, and the terminal spoils the user experience information input by the user of the terminal displayed in the detail page of the target multimedia.

For example, referring to FIG. 9b, a schematic diagram of an interface is shown in which a user publishes user experience information.

As can be seen from fig. 9b, after the user selects a multimedia, the terminal presents a multimedia detail page 920, in which not only the presentation area 921 of the multimedia can be included, for example, the presentation area can present a play identifier of the multimedia, and the play identifier can be a music link, a music icon, or the like for implementing music play. Also displayed in the multimedia details page 920 are a plurality of pieces of user experience information 922 associated with the multimedia.

In addition, there is also an information sharing edit item 923 on the multimedia detail page, such as "write your story" in fig. 9 b. After the terminal detects that the user clicks the information sharing editing item of 'write your story', the terminal can display an information editing column or an information editing interface and acquire user experience information input by the user in the information editing column or the information editing interface. Then, the terminal can send the user experience information to the server; meanwhile, after the server passes the examination, the terminal can display the user experience information edited by the user in the multimedia detail page.

It can be seen that, in this embodiment, after the terminal sends the second interest point information representing the geographic location of the terminal and the obtained at least one frame of second object image to the server, the terminal may obtain the multimedia information matched with the second interest point information and the at least one frame of second object image from the server, so as to obtain the multimedia information matched with the environment in which the user is located and the object concerned or facing the user, so that the user may obtain the multimedia more fitting the situation in which the user is located.

In addition, the server can match and recommend the second geographical position information of the user and the multimedia matched with the focused second object image to the user according to the association relationship between the multimedia shared by other users, the geographical position information and the object image, so that the user can acquire the multimedia information shared by other users under the same situation, the preference of other users under the same situation can be known, the interaction of the multimedia between different users can be improved, and the diversity and the interestingness of the multimedia recommendation can be improved.

For example, where the user is in a corporate building and the user is overtime, the user is faced with a computer, in which case the user may wish to learn the music that others are listening to while the corporate building is overtime. On the basis, the user can send the second interest point selected by the user to the server through the terminal, and after the terminal is utilized to shoot the image of the computer, the image of the computer is sent to the server. Correspondingly, the server returns music and user feeling information related to the company building and computer images shared by other users to the terminal, so that the user can acquire music liked by other users when the company is overtime.

The following description is made from the server side for the case of recommending multimedia to the user of the terminal. As shown in fig. 10, which shows a further flowchart of a further multimedia recommendation method of the present application, the present embodiment is applied to a server, and the present embodiment may include:

s1001, a second geographic position and a second altitude sent by the terminal are obtained.

In this embodiment, the second geographic location is used to characterize a second longitude and latitude where the terminal is located.

And S1002, returning a second map to the terminal based on the second geographic position so as to output the second map at the terminal.

S1003, obtaining second interest point information sent by the terminal.

Similar to the operation at the terminal side in fig. 8, in the case where the second interest point information input by the user is obtained at the terminal side, the server does not need to return the second map for the terminal either.

Optionally, after obtaining the second interest point information, the server may further match at least one multimedia information to be recommended that matches the second interest point, and send the at least one multimedia information to be recommended to the server.

It may be understood that, in this embodiment, taking the example that the second geographical location information includes the second interest point information, in the case that the second geographical location information is merely the longitude and latitude recommendation multimedia of the terminal, it is not necessary to perform the steps S1002 and S21002. In this case, the server may also acquire at least one multimedia information to be recommended that matches the second geographical location information and send the multimedia information to the terminal when the second geographical location is acquired.

S1004, at least one frame of second object image sent by the terminal is obtained.

S1005, responding to a multimedia recommendation instruction sent by the terminal, and obtaining at least one piece of multimedia information matched with the second interest point information, the second altitude and the at least one frame of second object image and user experience information respectively associated with the at least one piece of multimedia information according to the association relation between the stored multimedia information and the interest point information, the at least one frame of object image and the altitude.

The association between the multimedia information and the interest point information, the at least one frame of object image and the altitude may be obtained according to the association between the multimedia recommended to the server by the user of the terminal and the first interest point information, the at least one frame of first object image and the altitude in the embodiments of fig. 2-6. Of course, the association relationship may be set by a manager of the server or obtained by other means, and is not limited thereto.

In addition, matching the at least one multimedia information based on the object relation is only one implementation, and other ways are also applicable to the present embodiment.

The situation of the multimedia recommendation indication can be referred to in the related description of fig. 8. If the multimedia recommendation indication carries the second interest point information, the second altitude and at least one frame of the second object image, in the above steps S1004 to S1005, it may be understood that the server obtains the second interest point information, the second altitude and at least one frame of the second object image sent by the terminal by parsing the multimedia recommendation indication.

If the multimedia recommendation indication simply indicates that the server matches multimedia based on the received second point of interest information, second altitude, and at least one frame of second object image, the server actually receives the second point of interest information, second altitude, and at least one frame of second object image sent by the terminal before receiving the multimedia recommendation indication.

It can be understood that in this embodiment, after the terminal sends the multimedia recommendation indication, the server matches the at least one multimedia message, and in practical application, after the server obtains the at least one frame of the second object image, the server may also

S1006, returning the at least one piece of multimedia information and the user experience information respectively associated with the at least one piece of multimedia information to the terminal.

The user experience information is also acquired as an optional operation in this embodiment.

For ease of understanding, the case of recommending multimedia to the user of the terminal is described below in connection with an application scenario. Taking an application scenario of recommending music to a user based on a music playing application as an example, fig. 11 shows a schematic diagram of still another multimedia recommendation method of the present application in an application scenario.

In fig. 11, a plurality of interfaces presented by the terminal under the condition of acquiring different information are displayed, namely a recommendation operation interface 1110, a point of interest selection interface 1120, an image scanning interface 1130, a music recommendation interface 1140 and an interface 1150 of a music detail page. Meanwhile, an interaction indication of the terminal and the server under different interfaces is given.

To facilitate an understanding of fig. 11, the following description is provided in connection with the flow interaction diagram of fig. 12. Fig. 12 is a schematic flow interaction diagram of still another multimedia recommendation method of the present application in a scenario of being applied to recommending music to a user, where the embodiment may include:

S1201, the terminal determines a second longitude and latitude and a second altitude of the terminal.

As described in connection with fig. 11, after the terminal detects that the user opens the music playing application, a recommended operation interface 1110 is presented, in which case the terminal may determine the second longitude and latitude and the second altitude. Alternatively, the user may click on a trigger option in the recommendation operation interface 1110 for requesting to recommend music, such as a "find" option in the interface 1110, and then trigger the terminal to determine the second longitude and latitude and the second altitude.

And S1202, the terminal sends the second longitude and latitude and the second altitude to the server.

S1203, the server acquires a second map based on the second longitude and latitude, and acquires at least one first multimedia information to be recommended, wherein the second longitude and latitude and the second altitude match.

For convenience of distinguishing, the multimedia to be recommended, which is matched with the second longitude and latitude and the second altitude, is called first multimedia information to be recommended, and the multimedia to be recommended, which is screened out based on the second interest point information, is called second multimedia information to be recommended.

And S1204, the server sends the second map and the at least one piece of first multimedia information to be recommended to the terminal.

And S1205, the terminal displays the second map and displays the at least one piece of multimedia information to be recommended on the second map.

Still referring to fig. 11, when the "find" option is in the selected state in the recommendation operation interface 1110, the terminal is in a state of requesting recommendation of multimedia, in which case the second map is displayed in the recommendation operation interface. The longitude and latitude 1111 where the terminal is located and some points of interest 1112 existing around the longitude and latitude 111 are marked in the second map.

Meanwhile, in order to enable the user to know which interest points around the current geographic position of the terminal are associated with the multimedia shared by other users, the interest points with associated multimedia can be identified in the second map. As shown in fig. 11, a prompt identifier 1113 is further identified beside a part of the interest points, and the prompt identifier 1113 is used for prompting that the interest points are associated with music information shared by other users.

In addition, in order to enable the user to know the multimedia information matching the second longitude and latitude and the second altitude, a music recommendation preview area 1114 is displayed in the multimedia recommendation interface 110, and at least one piece of music information matching the second longitude and latitude and the second altitude may be displayed in the music recommendation preview area.

Of course, the server may also match and return the user experience information associated with the second multimedia information to be recommended while returning the at least one second multimedia information to be recommended to the terminal. As in fig. 11, in this music preview area 1114, in addition to the information of music, a music story "overtime change fate" is displayed.

S1206, the terminal responds to the interest point selection operation to acquire information of a second interest point selected by the user from the second map.

And S1207, the terminal sends the information of the second interest point to the server.

S1208, the server matches at least one piece of second multimedia information to be recommended from the at least one piece of first multimedia information to be recommended according to the information of the second interest point, and sends the at least one piece of second multimedia information to be recommended to the terminal.

S1209, the terminal displays the at least one piece of second multimedia information to be recommended, which is matched with the second interest point information, in a second map.

As described in connection with FIG. 11, if the user can select the interest point of the user in the operation recommendation interface 1110 or want to view the interest points of the music shared by other users, a second interest point selected by the user can be marked on the operation recommendation interface according to the interest points selected by the user, as shown in the interest point selection interface 1120 in FIG. 8. The second point of interest 1121 selected by the user is marked as "XX park" in this point of interest selection interface 1120.

Meanwhile, after the terminal sends the information of the second interest point to the server, at least one piece of second multimedia information to be recommended, which is returned by the server and matched with the second interest point, is displayed below the interest point selection interface. Such as the recommended music information and the music stories under the point of interest selection interface 1120, which are similar to the operation recommendation interface, are not described herein.

S1210, the terminal responds to the image acquisition operation and acquires a second object image through the camera.

As described in connection with fig. 11, assuming the user is watching a rose in the "XX park", if the user wishes to know that other users are in the same park watching the music that the rose is listening to, or in order to be able to obtain music that fits the user's current scene, the user may click on the "swipe" option 1122 in the interest selection interface 1120. In this case, the terminal will initiate a camera scan of the image and enter the image scan interface 1130.

As shown in fig. 11, an image of a scanned rose 1131 is displayed on the image scanning interface. Correspondingly, when the user confirms that the image of the rose is taken as the second object image, the terminal sends the image of the rose to the server.

Of course, the interest selection interface 1120 may not set a "swipe" like option, and the user may open a function option field in the interest selection interface and set a function item triggering image scanning in the function option field.

S1211, the terminal transmits the second object image to the server.

S1212, the server matches at least one piece of multimedia information from the at least one piece of second multimedia information to be recommended according to the second object image.

The server transmits the at least one multimedia information to the terminal S1213.

S1214, the terminal displays the at least one piece of multimedia information.

As described with reference to fig. 11, after the terminal sends the scanned image of one rose to the server, the server screens out the multimedia information matching with the rose from at least one second multimedia to be recommended, so as to finally obtain a recommendation list of the music information matching with the XX park and the rose and return the recommendation list to the terminal.

Accordingly, the terminal will present a recommendation list of the music information, as shown in the music recommendation interface 1140 in fig. 11. Of course, the server may also return the music information and return the music story matched with the music information to the terminal so that the terminal displays the music story on the music recommendation interface.

In the music recommendation interface 1140, the user may select the target music for which playing or viewing of details is desired, and the terminal may request a music story associated with the target music from the server, where the music story may be information experienced by some users of other users sharing for the target music. Accordingly, after the server returns the music story shared by each user corresponding to the target music for the terminal, the terminal may present the music detail page 1150 of the target music.

The music detail page 1150 includes basic information 1151 of the target music, such as play buttons, names, and the like. Also, music stories 1152 posted by different users may be included in the music detail page.

In addition, after the user clicks on the music detail page, which may also include the "leave music story" option 1153, the user may enter a music story to be edited.

It can be appreciated that in the above embodiments of the present application, if the server does not match the multimedia according to the second geographic location information and at least one frame of the second object image, the server may further reasonably recommend the multimedia in combination with the historical behavior of the user or the current location of the user. For example, referring to fig. 13, which shows another recommendation flow in another multimedia recommendation method, the present embodiment may be applied to a server, and the method of the present embodiment may include:

S1301, acquiring an environment image acquired by the terminal and user characteristic information of the user stored in the multimedia recommendation platform under the condition that at least one multimedia information matched with the second geographic position information and at least one frame of second object does not exist.

The user characteristic information is information related to one or more of attribute information of the user and behavior data of the user on a network platform. For example, the attribute information of the user may be user tag data such as the sex, age, school, taste, etc. of the user. The behavioral data may include: the user can select multimedia in the multimedia recommendation platform in a historical manner or can send out a talk.

The environment image is an image which is acquired by the indication terminal after the server cannot match the multimedia in the previous mode. The environmental image may include an item, a scene, and the like.

Wherein the ambient image is optional.

S1302, matching the multimedia information from the multimedia library according to the environment image, the user characteristic information and the recommendation reference information.

Wherein the recommendation reference information includes: the one or more of the second geographic location, the second object image, the second point of interest information, and the second altitude.

For example, the machine learning algorithm is used to identify the environment image, the user feature information and the feature information of the multimedia matched with the recommendation reference information, and then the multimedia matched with the feature information is queried from the multimedia library. Of course, other ways are also applicable to the present embodiment, and will not be described herein.

It can be understood that the embodiment matches multimedia by combining the environment image, the user characteristic information and the recommended reference information, but in practical application, any two of the three information may be combined, which is not limited herein.

And S1303, recommending the matched multimedia information.

The application also provides a multimedia recommending device corresponding to the multimedia recommending method. For example, referring to fig. 14, which shows a schematic structural diagram of a multimedia recommendation device of the present application, the device of the present embodiment may be applied to a terminal or a server, and includes:

a first location acquiring unit 1401 configured to acquire first geographical location information of a terminal;

a first image obtaining unit 1402 for obtaining at least one frame of a first object image;

a multimedia obtaining unit 1403 for obtaining multimedia information recommended by a user of the terminal;

A recommendation storage unit 1404 is configured to store at least the first geographic location information, the first object image, and the multimedia information in a server.

In one possible implementation manner, the first location obtaining unit is specifically configured to obtain first geographic location information of the terminal in response to an input positioning trigger operation.

Optionally, the first location obtaining unit is specifically configured to obtain first interest point information for characterizing a geographic location of the terminal when obtaining first geographic location information of the terminal.

Optionally, the first location obtaining unit is configured to, when obtaining the first point of interest information for characterizing the geographic location of the terminal, specifically for,

Outputting a first map in the terminal based on the geographic position of the terminal;

and acquiring the selected first interest point information in the first map.

In yet another possible implementation manner, the first image acquiring unit is specifically configured to acquire at least one frame of a first object image acquired by a camera of the terminal in response to an input object acquisition operation; or in response to the input object selection operation, acquiring the selected at least one frame of first object image from the image library of the terminal.

Optionally, in the above apparatus, it may further include:

A feeling information acquisition unit for acquiring user feeling information input for the multimedia information after the multimedia acquisition unit acquires the multimedia information recommended by the user selection of the terminal;

The recommendation storage unit is specifically configured to store the first geographic location, the first object image, the user experience information, and the multimedia information in a server in an associated manner.

The application also provides a multimedia recommending device corresponding to the multimedia recommending method. Fig. 15 is a schematic diagram showing the composition structure of yet another multimedia recommendation method of the present application, and the apparatus may be applied to a terminal or a server, and may include:

a second location obtaining unit 1501, configured to determine second geographical location information where the terminal is located;

a second image obtaining unit 1502, configured to obtain at least one frame of a second object image according to which multimedia is recommended;

A multimedia matching unit 1503, configured to match at least one multimedia information according to at least the second geographic location information and the at least one frame of the second object image;

A multimedia recommending unit 1504 is configured to recommend the at least one multimedia information.

Optionally, the apparatus may further include:

The pre-matching unit is used for acquiring at least one piece of multimedia information to be recommended, which is matched with the second geographic position information, after the second geographic position information of the terminal is determined by the second position acquisition unit;

The multimedia matching unit is specifically configured to determine, at least according to the at least one frame of the second object image, at least one piece of matched multimedia information from the at least one piece of multimedia information to be recommended.

In one possible implementation manner, the second location obtaining unit is specifically configured to obtain the second geographical location information of the terminal in response to the input positioning trigger operation.

Optionally, the second location obtaining unit is specifically configured to obtain second interest point information for characterizing a geographic location of the terminal when obtaining second geographic location information of the terminal.

Optionally, the second location obtaining unit is specifically configured to output a second map in the terminal based on the geographic location of the terminal when obtaining second interest point information for characterizing the geographic location of the terminal; and acquiring the selected second interest point information in the second map.

In yet another possible implementation manner, the second image obtaining unit is specifically configured to obtain at least one frame of a second object image acquired by a camera of the terminal in response to an input object acquisition operation; or in response to the input object selection operation, acquiring the selected at least one frame of second object image from the image library of the terminal.

Optionally, in an embodiment of the foregoing apparatus, the multimedia matching unit is specifically configured to match at least one multimedia information and user experience information associated with each of the at least one multimedia information at least according to the second geographic location information and at least one frame of the second object image;

the apparatus may further include: and the experience information recommending unit is used for recommending the user experience information respectively associated with the at least one piece of multimedia information at the same time of recommending the at least one piece of multimedia information by the multimedia recommending unit.

In the embodiment of the application, a multimedia recommendation device is also provided, and the multimedia recommendation device can be the terminal or the server. For example, referring to fig. 16, a schematic diagram of a composition structure of a multimedia recommendation device according to an embodiment of the present application is shown. In fig. 16, the multimedia recommendation device may include: a processor 1601, and a memory 1602.

Optionally, the apparatus may further include: a communication interface 1603, an input unit 1604 and a display 1605, and a communication bus 1606. The processor 1601, the memory 1602, the communication interface 1603, the input unit 1604, the display 1605, and all communicate with each other via the communication bus 1606.

In an embodiment of the present application, the processor 1601 may be a central processing unit (Central Processing Unit, CPU), an asic, or the like.

The processor may call a program stored in memory 1602. The memory 1602 is used to store one or more programs, which may include program code including computer operating instructions.

In one possible case, corresponding to the multimedia recommendation method for sharing multimedia by the user of the present application, the memory stores at least a program for implementing the following functions:

acquiring first geographic position information of a terminal;

obtaining at least one frame of first object image;

acquiring multimedia information recommended by a user of the terminal;

In a further possible case, a multimedia recommendation method for recommending multimedia to a user of a terminal according to the present application, the memory having stored therein at least a degree for realizing the following functions:

determining second geographic position information of the terminal;

Matching at least one multimedia message based at least on the second geographic location information and the at least one frame of the second object image; the at least one multimedia information is recommended.

Wherein the memory 1602 may include a stored program area and a stored data area, wherein the stored program area may store an operating system, the above-mentioned programs, and the like; the storage data area may store data created during operation of the multimedia recommendation device.

Further, the memory 1602 may include high-speed random access memory, nonvolatile memory, and the like.

The communication interface 1603 may be an interface of a communication module or the like.

The input unit may include a touch sensing unit sensing a touch event on the touch display panel, a keyboard, and the like.

The display 1605 includes a display panel, such as a touch display panel or the like.

Of course, the device structure shown in fig. 16 does not limit the multimedia recommendation device according to the embodiment of the present application, and the multimedia recommendation device may include more or less components than those shown in fig. 16 or may combine some components in practical applications.

In another aspect, the present application further provides a storage medium having stored therein computer executable instructions that, when loaded and executed by a processor, implement the multimedia recommendation method according to any one of the embodiments above.

It should be noted that, in the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other. For the apparatus class embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference is made to the description of the method embodiments for relevant points.

The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.

Claims

1. A multimedia recommendation method, applied to recommending music, comprising:

Determining a first geographic position and a first altitude of a terminal when detecting that a user clicks an operation option for requesting sharing of multimedia information;

Acquiring a first map from a server based on the first geographic position and displaying the first map;

Responding to a positioning triggering operation, and acquiring first interest point information selected from the first map, wherein the first interest point information comprises an identifier of a first interest point and longitude and latitude information corresponding to the first interest point;

Responding to input object acquisition operation, acquiring at least one frame of first object image acquired by a camera of a terminal, wherein the first object image is used for representing an object associated with multimedia information to be recommended of the terminal;

determining the multimedia information of the selected recommendation from the presented multimedia list in response to the input multimedia selection operation;

an operation interface for displaying the multimedia information, wherein the operation interface comprises an information editing option;

Responding to the information editing operation obtained by clicking the information editing options, and obtaining user experience information aiming at multimedia information input;

And sending an associated recommendation indication of the multimedia information to a server in response to the first recommendation confirmation operation, wherein the associated recommendation indication is used for indicating that the first interest point information, the first altitude, the first object image, the user experience information and the multimedia information are associated and stored in the server, and after the server stores the association relation between the multimedia information selected to be recommended by the user and the first geographic position, the first object image and the user experience information, the multimedia information is recommended to other users based on the stored association relation so as to recommend the multimedia information related to the current position, the concerned or interested object and the user experience information of the user.

2. A multimedia recommendation method, applied to recommending music, comprising:

determining second geographic position information of the terminal, wherein the second geographic position information is second interest point information representing the geographic position of the terminal;

Obtaining at least one frame of second object image according to which the multimedia is required to be recommended, wherein the second object image is used for representing an object associated with multimedia information to be recommended of the terminal;

Matching at least one multimedia message according to at least the second geographic position information and the at least one frame of second object image, wherein the server is used for storing the association relation between the multimedia message selected and recommended by the user and the first interest point information, the first altitude, the first object image and the user feeling information, the association relation is the association relation obtained according to the claim 1, and the multimedia message related to the second geographic position information and the at least one frame of second object image is obtained;

The at least one multimedia information is recommended.

3. The method of claim 2, further comprising, after said determining the second geographic location information in which the terminal is located:

Acquiring at least one piece of multimedia information to be recommended, which is matched with the second geographic position information;

Said matching at least one multimedia message based at least on said second geographical location information and said at least one frame of second object image, comprising:

And determining at least one matched multimedia information from the at least one multimedia information to be recommended at least according to the at least one frame of second object image.

4. The method of claim 2, wherein determining the second geographic location information of the terminal comprises:

And responding to the input positioning triggering operation, and acquiring second geographic position information of the terminal.

5. The method according to claim 2 or 4, wherein the obtaining at least one frame of the second object image according to which the recommended multimedia is required includes:

responding to input object acquisition operation, and acquiring at least one frame of second object image acquired by a camera of the terminal;

Or in response to the input object selection operation, acquiring the selected at least one frame of second object image from the image library of the terminal.

6. The method for multimedia recommendation according to claim 2 or 4, wherein said obtaining the second geographical location information of the terminal comprises:

And acquiring second interest point information used for representing the geographic position of the terminal.

7. The method of claim 6, wherein the obtaining the second point of interest information for characterizing the geographic location of the terminal comprises:

outputting a second map in the terminal based on the geographic position of the terminal;

And acquiring the selected second interest point information in the second map.

8. The method of claim 2, wherein said matching at least one multimedia message based at least on said second geographic location information and said at least one frame of second object image comprises:

Matching at least one piece of multimedia information and user experience information respectively associated with the at least one piece of multimedia information at least according to the second geographic position information and at least one frame of second object image;

Simultaneously with said recommending said at least one multimedia information, further comprising:

And recommending the user experience information respectively associated with the at least one piece of multimedia information.

9. A multimedia recommendation device, applied to recommending music, comprising:

The first position acquisition unit is used for determining a first geographic position and a first altitude of the terminal when detecting that a user clicks an operation option for requesting sharing of the multimedia information; acquiring a first map from a server based on the first geographic position and displaying the first map; responding to a positioning triggering operation, and acquiring first interest point information selected from the first map, wherein the first interest point information comprises an identifier of a first interest point and longitude and latitude information corresponding to the first interest point;

the first image acquisition unit is used for responding to input object acquisition operation, acquiring at least one frame of first object image acquired by a camera of the terminal, wherein the first object image is used for representing an object associated with multimedia information to be recommended of the terminal;

A multimedia obtaining unit for determining the selected recommended multimedia information from the presented multimedia list in response to the input multimedia selection operation;

The experience information acquisition unit is used for displaying an operation interface of the multimedia information, wherein the operation interface comprises information editing options; responding to the information editing operation obtained by clicking the information editing options, and obtaining user experience information aiming at multimedia information input;

And the recommendation storage unit is used for responding to the first recommendation confirmation operation, sending an associated recommendation indication of the multimedia information to the server, wherein the associated recommendation indication is used for indicating to store the first interest point information, the first altitude, the first object image, the user experience information and the multimedia information in the server in an associated manner, and after the server stores the association relation between the multimedia information selected to be recommended by the user and the first geographic position, the first object image and the user experience information, the multimedia information is recommended to other users based on the stored association relation so as to recommend the multimedia information related to the current position, the concerned or interested object and the user experience information of the user.

10. A multimedia recommendation device, applied to recommending music, comprising:

the second position acquisition unit is used for determining second geographic position information of the terminal, wherein the second geographic position information is second interest point information representing the geographic position of the terminal;

The second image obtaining unit is used for obtaining at least one frame of second object image according to which the multimedia is required to be recommended, and the second object image is used for representing an object associated with the multimedia information to be recommended of the terminal;

A multimedia matching unit, configured to match at least one multimedia information according to at least the second geographic location information and the at least one frame of second object image, where the server stores an association relationship between the multimedia information selected for recommendation by the user and the first interest point information, the first altitude, the first object image, and the user experience information, where the association relationship is an association relationship obtained according to claim 1, and the server obtains the multimedia information related to the second geographic location information and the at least one frame of second object image;

11. The apparatus of claim 10, wherein the apparatus further comprises:

The pre-matching unit is used for acquiring at least one piece of multimedia information to be recommended, which is matched with the second geographic position information, after the second geographic position information of the terminal is determined;

The multimedia matching unit is specifically configured to:

12. The device according to claim 10, wherein the second position acquisition unit is in particular adapted to

13. The apparatus according to claim 10 or 12, wherein the second image acquisition unit is in particular adapted to

14. The apparatus according to claim 10 or 12, wherein the second location obtaining unit is specifically configured to obtain second point of interest information for characterizing a geographic location where the terminal is located.

15. The apparatus according to claim 14, wherein the second position acquisition unit is specifically configured to:

And acquiring the selected second interest point information in the second map.

16. The apparatus according to claim 10, wherein the multimedia matching unit is specifically configured to:

17. A multimedia recommendation device, characterized by being applied to recommending music, comprising:

A processor and a memory;

18. A multimedia recommendation device, characterized by being applied to recommending music, comprising:

A processor and a memory;

The at least one multimedia information is recommended.

19. A storage medium having stored therein computer executable instructions which when loaded and executed by a processor implement the multimedia recommendation method of any one of claims 1 or 2 to 8.