WO2022048398A1

WO2022048398A1 - Multimedia data photographing method and terminal

Info

Publication number: WO2022048398A1
Application number: PCT/CN2021/111139
Authority: WO
Inventors: 李倩; 舒莹; 姜海洋
Original assignee: 北京达佳互联信息技术有限公司
Priority date: 2020-09-03
Filing date: 2021-08-06
Publication date: 2022-03-10
Also published as: CN112052897B; CN112052897A

Abstract

The present invention relates to the technical field of computers, and relates to a multimedia data photographing method and a terminal. The solution provided in the present invention comprises: the terminal collects a first image by means of a photographing interface; a server acquires the first image collected by the terminal by means of the photographing interface; the server recognizes the first image to obtain object information comprised in the first image; the server acquires at least one piece of template information matching with the object information, the at least one piece of template information corresponding to at least one template which provides an element used for compositing with multimedia data; the server sends the at least one piece of template information to the terminal; the terminal displays, in the photographing interface, the at least one piece of template information; in response to an operation of selecting target template information, the terminal photographs on the basis of a target template corresponding to the target template information, to obtain multimedia data comprising the target template. A user does not need to browse a larger number of templates, the operation is simple, and the operation efficiency is improved.

Description

Multimedia data shooting method and terminal

The present disclosure claims priority to Chinese Patent Application No. 202010915878.3 filed on September 3, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of computer technologies, and in particular, to a method and a terminal for shooting multimedia data.

Background technique

With the development of Internet technology and the popularization of intelligent terminals, the data sharing function has been widely used, and many users will share their own multimedia data (such as videos, pictures, etc.) with others, or watch the multimedia data shared by others, thus The interaction between different users is realized through multimedia data.

In order to improve the shooting effect of multimedia data, users are usually provided with a large number of templates, such as magic expressions, stickers, etc. The user selects a template related to the shooting content from a large number of templates, and then shoots based on the selected template to obtain multimedia data. .

SUMMARY OF THE INVENTION

The present disclosure provides a multimedia data shooting method and terminal. The technical solutions of the present disclosure are as follows:

According to a first aspect of the embodiments of the present disclosure, there is provided a method for capturing multimedia data, the method comprising:

Collect the first image through the shooting interface;

In the shooting interface, at least one template information is displayed, the at least one template information matches the item information contained in the first image, the at least one template information corresponds to at least one template, and the at least one template is provided for matching with multimedia data. synthetic elements;

In response to the selection operation on the target template information, shooting is performed based on the target template corresponding to the target template information, and multimedia data including the target template is obtained.

In the solution provided by the present disclosure, by displaying template information matching the item information contained in the first image in the shooting interface, and then shooting based on the target template corresponding to the target template information selected by the user, multimedia data including the target template is obtained. , the user does not need to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

According to a second aspect of the embodiments of the present disclosure, there is provided a method for capturing multimedia data, the method comprising:

obtaining the first image collected by the terminal through the shooting interface;

Identifying the first image to obtain item information contained in the first image;

acquiring at least one template information matching the item information, the at least one template information corresponding to at least one template, the at least one template providing elements for synthesizing with multimedia data;

The at least one template information is sent to the terminal.

In the solution provided by the present disclosure, by identifying the first image collected by the terminal, the item information contained in the first image is obtained, and then the template information matching the item information is obtained, and the template information is sent to the terminal, so that the user can browse the Template information and selection from it, without the need for users to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

According to a third aspect of the embodiments of the present disclosure, there is provided an apparatus for capturing multimedia data, the apparatus comprising:

an acquisition unit, configured to acquire the first image through the photographing interface;

a display unit, configured to display at least one template information in the shooting interface, the at least one template information matches the item information included in the first image, the at least one template information corresponds to at least one template, the at least one template information provide elements for synthesizing with multimedia data;

The photographing unit is configured to, in response to the selection operation of the target template information, photograph based on the target template corresponding to the target template information, and obtain multimedia data including the target template.

According to a fourth aspect of the embodiments of the present disclosure, there is provided an apparatus for capturing multimedia data, the apparatus comprising:

an acquisition unit, configured to acquire the first image acquired by the terminal through the shooting interface;

an identification unit, configured to identify the first image, and obtain item information contained in the first image;

The obtaining unit is further configured to obtain at least one template information matching the item information, the at least one template information corresponding to at least one template, and the at least one template provides elements for synthesizing with multimedia data;

a sending unit, configured to send the at least one template information to the terminal.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a terminal, the terminal comprising:

one or more processors;

memory for storing instructions executable by the processor;

Wherein, the processor is configured to execute the instruction, so as to realize the above-mentioned method for capturing multimedia data.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a server, the server comprising:

one or more processors;

memory for storing instructions executable by the processor;

According to a seventh aspect of the embodiments of the present disclosure, a non-volatile storage medium is provided, when the instructions in the non-volatile storage medium are executed by the processor of the terminal/server, the terminal/server can execute the above-mentioned multimedia data Shooting method.

According to an eighth aspect of the embodiments of the present disclosure, an application program product is provided. The application program product stores one or more instructions, and the one or more instructions can be executed by a processor of a terminal/server to complete the above multimedia data. Shooting method.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the principles of the present disclosure and do not unduly limit the present disclosure.

1 is a schematic diagram of an implementation environment of a method for capturing multimedia data according to an exemplary embodiment;

2 is a flowchart of a method for capturing multimedia data according to an exemplary embodiment;

3 is a flowchart of a method for capturing multimedia data according to an exemplary embodiment;

4 is a flowchart of a method for capturing multimedia data according to an exemplary embodiment;

5 is a schematic interface diagram of a shooting interface according to an exemplary embodiment;

6 is a schematic diagram of an interface for displaying first prompt information according to an exemplary embodiment;

7 is a schematic diagram of an interface for displaying template information according to an exemplary embodiment;

8 is a schematic diagram of an interface for displaying third prompt information according to an exemplary embodiment;

9 is a schematic diagram of an interface for displaying fourth prompt information according to an exemplary embodiment;

10 is a schematic diagram of an interface for displaying item information according to an exemplary embodiment;

11 is a block diagram of a multimedia data capturing apparatus according to an exemplary embodiment;

12 is a block diagram of a multimedia data capturing apparatus according to an exemplary embodiment;

FIG. 13 is a block diagram of a terminal 1300 according to an exemplary embodiment;

FIG. 14 is a block diagram of a server 1400 according to an exemplary embodiment.

detailed description

The user information involved in this disclosure is the information authorized by the user or fully authorized by all parties.

FIG. 1 is a schematic diagram of an implementation environment of a method for capturing multimedia data according to an exemplary embodiment. Referring to FIG. 1 , the implementation environment includes: a terminal 101 and a server 102 .

The terminal 101 is a smart phone, a smart watch, a laptop computer, an MP3 player (Moving Picture Experts Group Audio Layer III, the standard audio level 3 of the moving image expert compression), MP4 (Moving Picture Experts Group Audio Layer IV, the moving image expert compression standard audio layer) Level 4) At least one of equipment such as player and laptop portable computer. In some embodiments, the terminal 101 and the server 102 communicate through a wired network or a wireless network, which is not limited in the present disclosure. The visual interface of the terminal 101 includes a template display control, the user triggers the template display control, the terminal 101 responds to the user's trigger operation, sends a template information acquisition request to the server 102, and receives the template information returned by the server 102, and then display and acquire through the visual interface. The obtained template information, so that the user can browse the template information displayed on the visual interface, and then select the appropriate template. In response to the user's selection operation, the terminal 101 sends a template acquisition request to the server 102 based on the selected template information, and receives the template returned by the server 102, and then shoots multimedia data based on the received template.

The terminal 101 generally refers to one of multiple terminals, and this embodiment only takes the terminal 101 as an example for illustration. Those skilled in the art can know that the number of the above-mentioned terminals is more or less. For example, the above-mentioned terminals are only a few, or the above-mentioned terminals are dozens or hundreds, or more, the embodiments of the present disclosure do not limit the number of terminals and device types.

The server 102 is at least one of a server, multiple servers, a cloud server, a cloud computing platform and a virtualization center. In some embodiments, the server 102 and the terminal 101 communicate through a wired network or a wireless network, which is not limited in the present disclosure. The server 102 is associated with a template database for storing a plurality of templates and corresponding template information. The server 102 receives the template information acquisition request sent by the terminal 101 , acquires a plurality of template information from the template database, and then sends the acquired template information to the terminal 101 . The server 102 receives the template acquisition request from the terminal 101 , acquires the corresponding template from the template database, and then sends the acquired template to the terminal 101 . In some embodiments, the number of the above servers is more or less, which is not limited by the embodiments of the present disclosure. In other embodiments, the server 102 also includes other functional servers in order to provide more comprehensive and diverse services.

FIG. 2 is a flowchart of a method for capturing multimedia data according to an exemplary embodiment. Referring to FIG. 2 , the method includes the following steps:

In step S201, the terminal collects the first image through the photographing interface.

In step S202, the terminal displays at least one template information in the shooting interface, the at least one template information matches the item information included in the first image, the at least one template information corresponds to at least one template, the at least one template information Provides elements for synthesizing with multimedia data.

In step S203, in response to the selection operation on the target template information, the terminal performs shooting based on the target template corresponding to the target template information, and obtains multimedia data including the target template.

In some embodiments, the method further includes:

Based on the item information contained in the first image, at least one template information matching the item information is acquired.

In some embodiments, acquiring at least one template information matching the item information based on the item information included in the first image includes:

Obtain at least one template information matching the item information.

In some embodiments, each template information corresponds to a template tag;

Obtain at least one template information matching the item information, including:

Determine the template information corresponding to the template tag matching the item information.

In some embodiments, acquiring at least one template information matching the item information includes:

Send an item identification request to the server, where the item identification request carries the first image, and the item identification request is used to instruct the server to identify the item information contained in the first image, and obtain at least one template information that matches the item information;

The at least one template information returned by the server is received.

In some embodiments, the template information includes a template identifier and a corresponding thumbnail;

Receive the at least one template information returned by the server, including:

At least one template identifier and a corresponding thumbnail returned by the server are received.

In some embodiments, the method further includes:

In response to the selected operation of the target template information, a template acquisition request is sent to the server, and the template acquisition request carries the selected target template information;

Receive the target template returned by the server.

In some embodiments, the number of the template information is multiple, and each template information includes a thumbnail image;

In the shooting interface, at least one template information is displayed, including:

The plurality of thumbnails are displayed in sequence in the first target area of the shooting interface according to the arrangement order of the thumbnails, and the arrangement order is determined based on the matching degree between the template tag corresponding to each template information and the item information.

In the first target area of the photographing interface, any thumbnail is displayed, and in the second target area of the photographing interface, thumbnails other than any one of the thumbnails are displayed.

In some embodiments, in the first target area of the shooting interface, any thumbnail is displayed, and in the second target area of the shooting interface, thumbnails other than any one of the thumbnails are displayed, including:

In the first target area, display the first thumbnail;

In the second target area, thumbnail images other than the first thumbnail image are displayed.

In some embodiments, the method further includes any of the following:

In response to the sliding operation in the second target area, according to the sliding direction indicated by the sliding operation, adjust the display position of the thumbnail image displayed in the first target area and the thumbnail image in the second target area;

In response to a selection operation on any one of the thumbnails, the selected thumbnail is displayed in the first target area.

In some embodiments, shooting is performed based on the target template corresponding to the target template information to obtain multimedia data including the target template, including:

In response to the triggering operation on the first target area, determining the template corresponding to the thumbnail image currently displayed in the first target area as the target template;

Shooting is performed based on the target template to obtain multimedia data including the target template.

The target template is synthesized with the photographed multimedia data to obtain multimedia data including the target template.

In some embodiments, the method further includes:

Through the shooting interface, first prompt information is displayed, and the first prompt information is used to prompt that the first image is being recognized.

In some embodiments, the method further includes:

Through the shooting interface, second prompt information is displayed, and the second prompt information is used to prompt that template information matching the item information has been obtained.

In some embodiments, the capture interface further includes a re-identification control;

The method also includes:

re-acquiring the second image in response to the triggering operation of the re-identification control;

In the photographing interface, at least one template information matching the item information contained in the second image is displayed.

In some embodiments, the method further includes:

In response to the triggering operation on the blank area in the photographing interface, the second image is re-collected, and the blank area refers to an area in the photographing interface that does not include controls.

In some embodiments, the method further includes:

In the second target area of the shooting interface, an object identification control is displayed, and the object identification control is used to display the item information contained in the first image in the shooting interface after being triggered.

In some embodiments, the method further includes any of the following:

In response to the sliding operation in the second target area, the identification control is displayed in the first target area of the shooting interface;

In response to the selection operation of the identification control, the identification control is displayed in the first target area.

In some embodiments, the method further includes:

In response to the triggering operation of the object identification control, the object information contained in the first image is displayed through the photographing interface.

In some embodiments, the method further includes:

When the object identification control is triggered and the second image is collected through the shooting interface, obtain the item information contained in the second image;

Through the photographing interface, the item information included in the second image is displayed.

FIG. 3 is a flowchart of a method for capturing multimedia data according to an exemplary embodiment. Referring to FIG. 3 , the method includes the following steps:

In step S301, the server obtains the first image collected by the terminal through the shooting interface.

In step S302, the server identifies the first image, and obtains item information contained in the first image.

In step S303, the server acquires at least one template information matching the item information, the at least one template information corresponds to at least one template, and the at least one template provides elements for synthesizing with multimedia data.

In step S304, the server sends the at least one template information to the terminal.

In the solution provided by the embodiments of the present disclosure, by identifying the first image collected by the terminal, the item information contained in the first image is obtained, and then the template information matching the item information is obtained, and the template information is sent to the terminal, so that the user can Browsing and selecting from these template information does not require the user to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

In some embodiments, each template information corresponds to a template tag;

Determine at least one template tag matching the item information based on the template tag corresponding to each template information;

Acquire at least one template information corresponding to the at least one template tag.

A template identifier and a corresponding thumbnail image included in at least one template information matching the item information are acquired.

In some embodiments, acquiring the first image collected by the terminal through the shooting interface includes:

receiving an item identification request sent by the terminal, where the item identification request carries the first image;

Identifying the first image to obtain item information contained in the first image, including:

In response to receiving the item identification request, the first image is identified to obtain item information contained in the first image.

In some embodiments, the method further includes:

receiving a template acquisition request sent by the terminal, where the template acquisition request carries the target template information selected by the terminal;

Send the target template corresponding to the target template information to the terminal.

FIG. 4 is a flowchart of a method for capturing multimedia data according to an exemplary embodiment. Referring to FIG. 4 , the method includes:

In step S401, the terminal collects the first image through the photographing interface.

Wherein, the shooting interface is a display interface corresponding to the shooting function of the terminal, or, the shooting interface is a display interface of a client terminal with a shooting function, and the shooting interface is used to provide multiple functions such as shooting, beautification, music, and template display, etc. It is not only possible to shoot through the shooting interface, but also to beautify images, add music to multimedia data, or display templates, etc. through the shooting interface.

The first image collected through the shooting interface, that is, when the terminal is displaying the shooting interface, the picture image collected by the camera component itself, without the need for the user to trigger the shooting control, the terminal detects that the current display interface is the shooting interface, and can Collection occurs automatically.

In some embodiments, the user turns on the shooting function of the terminal or the client with the shooting function, the terminal responds to the user's operation, and displays a shooting interface, the shooting interface includes a smart shooting control, the user triggers the smart shooting control, and the terminal responds to the user's operation. The triggering operation of the intelligent photographing control collects the first image through the photographing interface. For example, the intelligent photographing control is an entrance of the intelligent photographing function, or the intelligent photographing control is of another type, which is not limited in the embodiments of the present disclosure.

Referring to FIG. 5, FIG. 5 is a schematic interface diagram of a shooting interface according to an exemplary embodiment. An intelligent shooting control is provided in the upper right corner of the shooting interface. The user can activate the intelligent shooting function by triggering the intelligent shooting control, so as to The terminal acquires the first image by itself, and acquires the item information contained in the first image.

In other embodiments, the shooting interface is configured with a smart shooting function by default, the user opens the shooting function of the terminal or a client with shooting function, and the terminal responds to the user's operation, displays the shooting interface, and invokes the intelligent shooting function to collect the first an image.

Wherein, when the user triggers the smart shooting control, or enters the shooting interface configured with the smart shooting function by default, the smart shooting control in the shooting interface is displayed as the successful check status, and the user triggers the smart shooting control displayed as the check successful status. Shooting controls, the terminal exits the intelligent shooting function in response to the user's trigger operation, and refreshes the display of the shooting interface. At this time, the intelligent shooting controls in the shooting interface are displayed in an unchecked state.

In step S402, the terminal sends an item identification request to the server, where the item identification request carries the first image, and the item identification request is used to instruct the server to identify the item information contained in the first image, and obtain information matching the item information of at least one template information.

The server is used to store multimedia data captured by the terminal, such as pictures and videos. The server is also associated with a template database. The template database stores multiple template tags. Each template tag stores multiple templates and template information corresponding to each template. The template information includes template identifiers and template thumbnails so that the server can According to a template tag, multiple templates corresponding to the template tag and template information corresponding to each template can be obtained.

The template tag is used to indicate the type of the template, the type of elements included in the template, and the like. For example, the template tag is flowers, that is, the template is a template related to flowers, or there is a flower element in the template corresponding to the template tag.

By sending an item identification request to the server, so that the server obtains the first image to be identified, and then identifies the obtained first image, the template recommendation based on the first image is implemented.

In step S403, the server receives the item identification request sent by the terminal.

In step S404, the server identifies the first image in response to the item identification request, and obtains item information contained in the first image.

Wherein, the item information includes item name and item explanation information, or the item information includes other contents, which are not limited in the embodiments of the present disclosure. The item information can represent the category to which the item belongs, and can explain the relevant information of the item, such as color, status, origin, price, and so on.

In some embodiments, the server inputs the first image into an item recognition model, and identifies the first image through the item recognition model to obtain item information contained in the first image.

Wherein, the image recognition model is pre-trained based on the following training process:

The server obtains multiple sample images and the sample item information contained in each sample image, the server inputs the multiple sample images into the initial model one by one, identifies the multiple sample images through the initial model, and obtains the item information contained in the sample image, Then, based on the sample item information contained in the obtained sample image and the item information contained in the sample image identified by the model, the loss function value of the initial model is determined, and the initial model is adjusted based on the loss function value through the gradient descent method. , and then continue to process the next sample image in the same way as the above process, until the adjusted initial model satisfies the preset conditions, then the initial model that satisfies the preset conditions is used as the trained image recognition model.

In some embodiments, the item recognition model is any type of model, such as a neural network model. Taking the item recognition model as a neural network model as an example, the item recognition model includes a convolution layer, a sampling layer and a classifier, and the process of identifying the item information contained in the first image by the item recognition model includes: the server passes the item through the item. Recognize the convolution layer of the model, extract the convolution feature of the target image, extract the sample feature of the convolution feature through the sampling layer of the item recognition model, and obtain the sample feature based on the classifier of the item recognition model. Item information contained in the target image.

For an item recognition model including a convolutional layer, a sampling layer and a classifier, the training process of the image recognition model is as follows: the server inputs the obtained multiple sample images into the initial model one by one, and extracts the sample through the convolutional layer of the initial model The sample convolution feature of the image, through the sampling layer of the initial model, extract the sample sampling feature of the sample convolution feature, through the classifier of the initial model, according to the sample sampling feature, obtain the item information contained in the sample image, Then, based on the sample item information contained in the obtained sample image and the item information contained in the sample image identified by the model, the loss function value of the initial model is determined, and the initial model is adjusted based on the loss function value through the gradient descent method. The parameters are adjusted, and then continue to process the next sample image in the same way as the above process, until the adjusted initial model satisfies the preset conditions, then the initial model that satisfies the preset conditions is used as the trained image recognition model.

The preset condition is that the accuracy of the identified item information satisfies the iteration cutoff condition, or the loss function value satisfies the iteration cutoff condition, or the number of iterations reaches the preset number of times, the embodiment of the present disclosure specifically adopts which condition It is not limited as a preset condition.

The above is an exemplary method for identifying the item information contained in the first image. In other embodiments, other methods are used to identify the item information in the first image, which is not limited in the embodiments of the present disclosure. .

In step S405, the server acquires at least one template information, the at least one template information matches the item information contained in the first image, the at least one template information corresponds to at least one template, and the at least one template is provided for matching with multimedia data synthetic elements.

In some embodiments, the server determines at least one template tag matching the item information based on the template tag of each template, and acquires at least one template information corresponding to the at least one template tag. Since the template tag of each template can represent the type of each template, the elements included in each template, etc., the template tag that is most similar to the identified item information can be determined by matching the item information with the template tag. , so as to obtain a template matching the item information, and realize the determination of the template to be recommended.

The template information includes template identifiers and corresponding thumbnails, or the template information includes other content, such as template publisher, template publishing time, template type, etc., which are not limited in the embodiments of the present disclosure. Since one template identifier corresponds to one template, and the thumbnails of each template can reflect the elements included in the template, and the amount of data is relatively small compared to the template itself, by obtaining the template identifier, the corresponding template can be determined according to the template identifier, and then the corresponding template can be obtained. Thumbnails to show the styles of each template through thumbnails.

In some embodiments, after determining the plurality of template information matching the item information, the server sorts the plurality of template information. For example, the server sorts the template information corresponding to each template tag according to the degree of matching between each template tag and the item information, and in descending order of the matching degree.

Wherein, when determining the sorting of each template information, the server stores the sorted template information in the form of a table, so that the sorting result in the form of a table is subsequently sent to the terminal. For example, according to the matching degree between each template tag and item information, the template information corresponding to the template tag with the highest matching degree is stored in the first row of the table, and the template information corresponding to the template tag with the second matching degree is stored in the second row of the table. And so on, so that the terminal determines the display order of each template information based on the storage position of each template information in the table. In other embodiments, other manners are used to store the template information, which is not limited by the embodiments of the present disclosure.

In step S406, the server sends the at least one template information to the terminal.

Since one template identifier corresponds to one template, and the thumbnails of each template can reflect the content included in the template, and the data volume is smaller than that of the template itself, the server sends the template identifier and thumbnail to the terminal without sending the template itself. The amount of data transmitted can be reduced, network resources can be saved, and the user can learn the style of the template through the thumbnail image displayed on the terminal.

In the process from step S402 to step S406 above, the terminal displays first prompt information through the photographing interface, where the first prompt information is used to prompt that the first image is being recognized. Through the first prompt information, the user is prompted based on the progress being recognized, so that the user can obtain the recognition progress in time and improve user experience.

The first prompt information includes prompt special effects and text prompt content. Referring to FIG. 6, FIG. 6 is a schematic diagram of an interface for displaying the first prompt information according to an exemplary embodiment, and the terminal displays the special effects of "Dian Dian Dian Dian" and the prompt "Aim at the target, automatically identifying. ..". By displaying special effects and prompts, it is possible to enhance the atmosphere when recognizing the target image, thereby improving the user experience.

In step S407, the terminal receives the at least one template information returned by the server.

The above process from step S402 to step S408 is described by taking the interaction between the terminal and the server as an example to obtain at least one template information that matches the item information contained in the first image. In other embodiments, , after collecting the first image, the terminal identifies the item contained in the first image by itself, and obtains the item information contained in the first image. Since the first image can represent the content to be photographed by the user, the item information identified based on the first image can represent the items included in the content to be photographed by the user. Therefore, obtaining template information matching the item information can realize the The template recommendation of the content to be shot by the user improves the template recommendation efficiency. After identifying the item information, the terminal determines the template information corresponding to the template tag matching the item information based on the template tag of each template. The embodiment of the present disclosure does not limit which method is adopted. Since the template tag of each template can represent the characteristics of each template, the template tag that is most similar to the identified item information can be determined by matching the item information with the template tag, and then the template matching the item information can be obtained. information, realize template recommendation, and improve the recommendation accuracy.

In step S408, the terminal displays the at least one template information in the shooting interface.

In the above step S405, after determining the arrangement order of the multiple template information, the server sends the table generated according to the arrangement order of the multiple template information to the terminal, so that the terminal can not only receive the multiple template information, but also obtain According to the arrangement order of the plurality of template information, the plurality of template information can be subsequently displayed according to the arrangement order.

In some embodiments, the terminal determines the arrangement order of each template information based on the storage position of each received template information in the table, determines the arrangement order of the template information stored in the first row of the table as 1, and stores the template information in the table as 1. The arrangement order of the template information in the second row is determined to be 2, and by analogy, the arrangement order of each template information is determined.

In some embodiments, each template information includes a thumbnail, and the arrangement order of the plurality of template information, that is, the arrangement order of the plurality of thumbnails. When displaying at least one template information, the terminal displays the plurality of thumbnails in sequence in the first target area of the shooting interface according to the arrangement order of the plurality of thumbnails, and the arrangement order is based on the corresponding template label and each template information. The matching degree of item information is determined. By displaying different thumbnails in turn in the first target area, it is convenient for the user to select the desired thumbnail, and it can also avoid displaying multiple thumbnails at the same time and occupying too much display space, simplifying the interface display elements and avoiding excessive display. content and cause disruption to users.

In some other embodiments, the terminal displays any thumbnail in the first target area of the photographing interface, and displays thumbnails other than any thumbnail in the second target area of the photographing interface.

By displaying the thumbnails in order, it is convenient for the user to select the desired thumbnail, and one of the thumbnails is displayed in the first target area, which has the effect of highlighting, and can prompt the user to select the thumbnail in the first target area. .

For example, in the first target area, the terminal displays the first thumbnail of the plurality of thumbnails, and in the second target area, displays the thumbnails of the plurality of thumbnails except the first thumbnail Sketch map.

The first target area is different from the second target area, the second target area is located on the left side of the first target area, or the second target area is located on the right side of the first target area, or the second target area includes two There are two sub-regions, and the two sub-regions are respectively located on both sides of the first target region, etc. The embodiment of the present disclosure does not limit the specific positional relationship between the first target region and the second target region.

Referring to FIG. 7, FIG. 7 is a schematic diagram of an interface for displaying template information according to an exemplary embodiment, wherein the shooting control is the first target area, and the left and right sides of the shooting control are the second target area, the terminal displays the thumbnail corresponding to the default recommended template in the first target area of the shooting interface, that is, the shooting control, that is, the first thumbnail, and the thumbnails corresponding to other templates are in the shooting control. The row on the right is arranged one by one for the user to view. By displaying the thumbnail with the highest degree of matching with the item information in the first target area according to the arrangement order, the user can see the thumbnail with the highest matching degree first, which can improve the recommendation efficiency, facilitate the user's selection, and improve the user experience.

The terminal can automatically provide a preview function of any template when any thumbnail is displayed in the first target area. That is, the terminal sends a template acquisition request to the server, the template acquisition request carries the template identifier corresponding to any thumbnail, and the server responds to the received template acquisition request, acquires the template corresponding to any thumbnail, and then retrieves the acquired template. The template is sent to the terminal, and the terminal displays the template corresponding to any thumbnail in the shooting interface based on the received template.

By acquiring the template corresponding to any thumbnail, the user can intuitively see the display effect of the template, thereby improving user experience.

In some embodiments, when the terminal displays the first thumbnail in the first target area, the terminal sends a template acquisition request to the server, where the template acquisition request carries the template identifier corresponding to the first thumbnail, and the server responds to receiving the template acquisition request, acquires the template corresponding to the first thumbnail, and then sends the acquired template to the terminal, and the terminal displays the template corresponding to the first thumbnail in the shooting interface based on the received template.

The template corresponding to the first thumbnail is the one that best matches the item information in the target image, and the user has the highest probability of using this template. By acquiring the template in advance, when the user decides to use the template, there is no need to acquire it again, reducing the need for terminals The number of interactions with the server reduces the processing pressure on the terminal and the server.

The above process is described by taking the example of displaying thumbnails through the shooting interface. In other embodiments, the terminal displays template identifiers and corresponding thumbnails through the shooting interface according to the arrangement order of template information. Embodiments of the present disclosure There is no limitation on which method is adopted. By displaying the template information with the highest degree of matching with the item information in the first target area according to the arrangement order, the template information of the template with the highest matching degree with the item information can be displayed preferentially, and the user can directly see the template with the highest matching degree information, improve recommendation efficiency, and thus improve user experience.

The user can change the thumbnail displayed in the target area by performing a sliding operation on the second target area where multiple thumbnails are displayed, or by performing a selection operation on any thumbnail.

In some embodiments, the user performs a sliding operation in the second target area for displaying the plurality of thumbnails, and in response to the sliding operation in the second target area, the terminal adjusts the sliding direction according to the sliding direction indicated by the sliding operation. The thumbnails displayed in the first target area and the display positions of the thumbnails in the second target area.

In other embodiments, the user selects any one of the thumbnails displayed in the second target area, and the terminal displays the selected thumbnail in the target area in response to the selection operation on any one of the thumbnails thumbnail.

The thumbnail displayed in the first target area can be changed by sliding or selecting, so as to realize the user's selection of the thumbnail, and then realize the user's selection of the template.

In some embodiments, when displaying at least one template information, the terminal displays second prompt information through the shooting interface, where the second prompt information is used to prompt that template information matching the item information has been obtained. Through the second prompt information, the user is prompted based on the progress of the obtained result, so that the user can obtain the recognition progress in time and improve the user experience. Referring to FIG. 7 , the terminal displays the prompt “[flowers] are recognized, the following gameplay is recommended” in the shooting interface as shown in FIG. 7 , so that the user can know that the result has been recognized currently.

The terminal displays the prompt "click the screen to re-identify" through the photographing interface shown in FIG. 6 , so that the user can re-identify when the identified item information does not meet his requirements, or when the user changes the photographing content. In addition, it can be seen from the comparison between Figure 5 and Figure 7 that when the smart shooting function is enabled, the beautification function entry and the music function entry are moved down, ensuring that the beautification and music function entrances are displayed while the recommended template information is displayed. , so that users can choose the beautification and music function entrances and improve the user experience.

In some embodiments, the user triggers a blank area on the screen, and the terminal re-captures the second image in response to the user's triggering operation on the blank area in the shooting interface, and then performs the above steps S401 to S408 to obtain the second image The included item information matches the template information, wherein the blank area refers to an area in the shooting interface that does not include controls. By setting the re-identification function for the blank area of the shooting interface, when the user wants to change the multimedia data to be shot, the blank area can be triggered to re-acquire the template matching the item information contained in the newly collected target image, without the need for the user to browse a lot of templates to improve operational efficiency.

In other embodiments, the photographing interface further includes a re-identification control, the user triggers the re-identification control, and the terminal re-collects the second image in response to the triggering operation of the re-identification control, and then performs the above steps S401 to S408, to obtain template information that matches the item information contained in the second image. The re-identification control is set on the shooting interface, so that when the user wants to change the shooting content, the template that matches the item information contained in the newly collected second image can be re-obtained through the re-identification control, without the need for the user to browse a large number of templates, and the operation is improved. effectiveness.

Through the above steps S402 to S408, the terminal can obtain the template information matching the item information in the target image, and then recommend the obtained template information to the user, so as to realize the personalized recommendation based on the content to be photographed by the user, and improve the user experience .

In some embodiments, when the collected first image does not contain an item, after recognizing the first image, the server sends an item recognition failure prompt to the terminal, where the item recognition failure prompt is used to indicate that there is no item in the first image. After recognizing the item information, the terminal displays third prompt information through the shooting interface in response to the received notification of failure to recognize the item, where the third prompt information is used to prompt that the item information is not recognized in the first image. Referring to FIG. 8, FIG. 8 is a schematic diagram of an interface for displaying third prompt information according to an exemplary embodiment. Through the shooting interface, the terminal displays the prompt "No recognition result, try shooting other items", so that the user can Shoot again.

Alternatively, when the terminal does not receive any information returned by the server within the first preset time period, the terminal displays fourth prompt information in the shooting interface, where the fourth prompt information is used to prompt that the network state is not good. Referring to FIG. 9, FIG. 9 is a schematic diagram of an interface for displaying fourth prompt information according to an exemplary embodiment. The terminal displays the prompt “network problem, recognition failure” through the shooting interface, so that the user can timely check the network of the terminal. condition to be checked.

The photographing interface further includes an object identification control, the terminal displays an object identification control in the second target area of the photographing interface, and the object identification control is used to display the object identification control included in the first image in the photographing interface after being triggered item information. Referring to FIG. 7 , the terminal displays the object identification control in the area on the right side of the shooting control. By setting the object identification control on the shooting interface, when the user wants to know the object information contained in the target image, the object information can be displayed through the object identification control, the operation efficiency is improved, and the user experience is further improved. By displaying the object identification control in the first target area, the user can enable the object identification function, so that the user can know the object information contained in the first image.

In some embodiments, the user performs a sliding operation in the second target area of the shooting interface, and the terminal displays the identification control in the first target area in response to the sliding operation in the second target area.

In other embodiments, the user directly selects the identification control, and the terminal displays the identification control in the first target area in response to the selection operation of the identification control.

By sliding the object recognition control to the first target area, or selecting the object recognition control, the terminal can enable the object recognition function based on the user's trigger operation, and then provide the user with the display of the item information, so that the user can know what the target image contains. Item information, improve operation efficiency, and then improve user experience.

In step S409, in response to the selection operation on the target template information, the terminal sends a template acquisition request to the server, where the template acquisition request carries the selected target template information.

Wherein, the target template information is any template information in a plurality of template information.

In some embodiments, in response to the triggering operation on the first target area, the terminal determines the template corresponding to the thumbnail image currently displayed in the first target area as the target template, and sends the template to the server based on the target template. Template get request.

Wherein, in some embodiments, the first target area is the area where the photographing controls are located, and the user triggers the first target area, which is equivalent to triggering the photographing controls, then the user performs triggering on the first target area. In the case of operation, it is equivalent to not only selecting the target template, but also starting the shooting process of multimedia data. Display the thumbnail in the first target area, and shoot when the first target area is triggered. This method enables the user to perform a trigger operation on the target area, and the terminal can automatically obtain the thumbnail image currently displayed in the first target area. The template corresponding to the thumbnail image can be used to start shooting at the same time, without the need for the user to perform the operations of selecting the template and starting the shooting, which simplifies the user operation, saves the operation time and improves the operation efficiency.

In the above step S408, when the terminal simultaneously displays the template identifier and the corresponding thumbnail in the first target area, the terminal can send the template to the server to obtain the template in response to the selection operation on either the template identifier or the thumbnail. ask.

In another embodiment, in the above step S408, when the terminal displays the object recognition control in the first target area, the user performs a trigger operation on the first target area, that is, triggers the object recognition control operation, the terminal displays the item information of the first image through the photographing interface in response to the user's triggering operation on the object identification control. By triggering the object recognition control, the terminal can display the item information, so that the user can know the item information contained in the target image, improve the operation efficiency, and further improve the user experience. Referring to FIG. 10, FIG. 10 is a schematic diagram of an interface for displaying item information according to an exemplary embodiment. Through the photographing interface, the terminal displays the identified item information, that is, displays the item name "Tulip" and the corresponding item information. Relevant explanation information, so that the user can know the relevant information of the item in the target image.

After the user triggers the object recognition control, the terminal starts to recognize the collected image in real time, the terminal collects the image in real time, and detects the collected image. In the case of an image, the item information included in the second image is acquired, and the item information included in the second image is displayed through the shooting interface. When the collected image changes, the item information of the newly collected image is re-acquired, and the new item information is displayed, so as to realize the automatic refresh of the recognition result, improve the operation efficiency, and further improve the user experience.

In some embodiments, the terminal periodically collects images every preset time period, and the preset time period is an arbitrary value, which is not limited in the embodiments of the present disclosure.

By collecting images in real time or periodically, the item information contained in the images can be acquired in real time or periodically. Under the condition that the viewing screen of the terminal is stable, the item information displayed by the terminal will not change; When the framing screen is switched to another item, the terminal will automatically refresh the displayed item information to ensure the real-time and accuracy of the recognition result and improve the user experience.

In step S410, the server receives the template acquisition request sent by the terminal.

By receiving a template acquisition request from the terminal, the server knows which template the user has selected, and then sends the template selected by the user to the terminal, so that the terminal can shoot multimedia data based on the received template.

In step S411, the server obtains the target template corresponding to the target template information in response to the template obtaining request.

In some embodiments, in response to the target template information carried in the received template obtaining request, that is, the target template identifier, the server obtains the target template corresponding to the target template identifier from the template database.

In step S412, the server sends the target template to the terminal.

Since the target template information can uniquely identify the selected target template, a template acquisition request carrying the target template information is sent to the server, so as to acquire the target template selected by the user. In this way, the server only needs to return the selected target template to the terminal without returning all the recommended templates, which reduces the amount of transmitted data and saves network resources.

In step S413, the terminal performs photography based on the target template to obtain multimedia data including the target template.

The target template includes elements that match the item information, such as picture elements, text elements, etc., or the target template includes other content, which is not limited in this embodiment of the present disclosure.

The picture elements are leaves, flowers, animals, etc., and are used to form the frame of the target template. The text element is the text in the target template, such as common sayings, poems and songs, famous quotes and so on.

In some embodiments, the terminal collects images through a camera assembly to obtain multimedia data, and then synthesizes the target template with the photographed multimedia data to obtain multimedia data including the target template. By synthesizing the target template and the multimedia data, the selected target template is applied to the photographed multimedia data, and the display effect of the multimedia data is improved.

Wherein, the multimedia data is a video, a picture, etc., including the multimedia data of the target template, and including picture elements, text elements, etc. that match the item information identified in the target image, so as to realize personalized shooting based on user shooting content, Improve user experience.

In some embodiments, after receiving the target template, the terminal displays the target template through a shooting interface, so that the user can intuitively see the shooting effect of each frame of image.

The solutions provided by the embodiments of the present disclosure can be applied to various fields, such as the field of live broadcast, the field of short video, and so on. Taking the application of the embodiments of the present disclosure in the field of short videos as an example, the solutions provided by the embodiments of the present disclosure utilize the scanning object recognition technology, combined with short video shooting, to provide users with the function of displaying item information and recommending templates, and innovatively develops The tool capabilities of the short video camera provide users with added value, and use the unique creative interaction in the industry to recommend templates that match the shooting content for users, improving the creative experience of video producers.

In the solution provided by the embodiments of the present disclosure, the template information matching the item information contained in the first image is displayed in the shooting interface, and then the shooting is performed based on the target template corresponding to the target template information selected by the user, so as to obtain the target template including the target template. It is easy to operate and improves the operation efficiency without requiring users to browse a large number of templates. Through the solution provided by the embodiments of the present disclosure, when a user finds a novel item, he can identify the novel item through the object recognition control under the intelligent shooting function, and obtain the item information of the novel item, so as to satisfy the user's curiosity and exploration. According to the current identified items, it can recommend templates in a targeted manner, fully combining camera shooting, scanning recognition and intelligent recommendation algorithms to achieve personalized recommendations based on user shooting content, giving users personalized perception , and also reduces the cost of user creation, providing users with inspiration and a convenient creation experience.

FIG. 11 is a block diagram of an apparatus for capturing multimedia data according to an exemplary embodiment. Referring to FIG. 11 , the apparatus includes:

The acquisition unit 1101 is configured to acquire the first image through the photographing interface;

The display unit 1102 is configured to display at least one template information in the shooting interface, the at least one template information matches the item information contained in the first image, the at least one template information corresponds to at least one template, the at least one template information Templates provide elements for compositing with multimedia data;

The photographing unit 1103 is configured to, in response to the selection operation on the target template information, photograph based on the target template corresponding to the target template information, and obtain multimedia data including the target template.

The device provided by the present disclosure obtains multimedia data including the target template by displaying template information matching the item information contained in the first image in the shooting interface, and then shooting based on the target template corresponding to the target template information selected by the user. , the user does not need to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

In some embodiments, the apparatus further includes:

The first acquiring unit is configured to acquire at least one template information matching the item information based on the item information contained in the first image.

In some embodiments, the first acquisition unit includes an identification subunit and an acquisition subunit;

The identifying subunit is configured to identify the first image and obtain item information contained in the first image;

The obtaining subunit is configured to obtain at least one template information matching the item information.

In some embodiments, each template information corresponds to a template tag;

The obtaining subunit is configured to determine template information corresponding to the template tag matching the item information.

In some embodiments, the first obtaining unit includes a sending subunit and a receiving subunit;

The sending subunit is configured to send an item identification request to the server, where the item identification request carries the first image, and the item identification request is used to instruct the server to identify the item information contained in the first image, and obtain information related to the item. Information matching at least one template information;

The receiving subunit is configured to receive the at least one template information returned by the server.

The receiving subunit is configured to receive at least one template identifier and a corresponding thumbnail returned by the server.

In some embodiments, the apparatus further includes:

a sending unit, configured to send a template acquisition request to the server in response to the selection operation of the target template information, where the template acquisition request carries the selected target template information;

A receiving unit, configured to receive the target template returned by the server.

The display unit 1102 is configured to sequentially display the plurality of thumbnails in the first target area of the shooting interface according to the arrangement order of the plurality of thumbnails, and the arrangement order is based on the template tags and items corresponding to each template information The degree of matching of the information is determined.

The display unit 1102 is configured to display any thumbnail in the first target area of the photographing interface, and display thumbnails other than any thumbnail in the second target area of the photographing interface.

In some embodiments, the display unit 1102 is configured to display a first thumbnail in the first target area; and display thumbnails other than the first thumbnail in the second target area.

In some embodiments, the apparatus further includes:

The adjustment unit is configured to, in response to the sliding operation in the second target area, adjust the thumbnail image displayed in the first target area and the thumbnail image displayed in the second target area according to the sliding direction indicated by the sliding operation. the display position of the thumbnail;

The display unit 1102 is further configured to display the selected thumbnail in the first target area in response to a selection operation on any thumbnail.

In some embodiments, the photographing unit 1103 is configured to, in response to a triggering operation on the first target area, determine a template corresponding to the thumbnail image currently displayed in the first target area as the target template; based on The target template is photographed to obtain multimedia data including the target template.

In some embodiments, the photographing unit 1103 is configured to synthesize the target template and photographed multimedia data to obtain multimedia data including the target template.

In some embodiments, the display unit 1102 is further configured to display first prompt information through the photographing interface, where the first prompt information is used to prompt that the first image is being recognized.

In some embodiments, the display unit 1102 is further configured to display second prompt information through the photographing interface, where the second prompt information is used to prompt that template information matching the item information has been obtained.

The acquisition unit 1101 is further configured to re-acquire the second image in response to the triggering operation of the re-identification control;

The display unit 1102 is further configured to display at least one template information matching the item information contained in the second image in the shooting interface.

In some embodiments, the acquisition unit 1101 is further configured to re-acquire the second image in response to a triggering operation on a blank area in the photographing interface, where the blank area refers to an area of the photographing interface that does not include controls.

In some embodiments, the display unit 1102 is further configured to display an object identification control in the second target area of the shooting interface, and the object identification control is used to display the first object in the shooting interface after being triggered. Item information contained in an image.

In some embodiments, the display unit 1102 is further configured to perform any of the following:

In some embodiments, the display unit 1102 is further configured to display the item information contained in the first image through the photographing interface in response to a triggering operation of the item identification control.

In some embodiments, the apparatus further includes:

a second acquiring unit, configured to acquire item information contained in the second image when the object identification control is triggered and the second image is captured through the shooting interface;

The display unit 1102 is further configured to display the item information contained in the second image through the photographing interface.

Fig. 12 is a block diagram of an apparatus for capturing multimedia data according to an exemplary embodiment. Referring to Fig. 12, the apparatus includes:

The obtaining unit 1201 is configured to obtain the first image collected by the terminal through the shooting interface;

The identification unit 1202 is configured to identify the first image and obtain the item information contained in the first image;

The obtaining unit 1201 is configured to obtain at least one template information matching the item information, the at least one template information corresponding to at least one template, and the at least one template provides elements for synthesizing with multimedia data;

The sending unit 1203 is configured to send the at least one template information to the terminal.

The device provided by the embodiment of the present disclosure obtains the item information contained in the first image by recognizing the first image collected by the terminal, then obtains template information matching the item information, and sends the template information to the terminal, so that the user can Browsing and selecting from these template information does not require the user to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

In some embodiments, each template information corresponds to a template tag;

The obtaining unit 1201 is configured to determine at least one template label matching the item information based on the template label corresponding to each template information, and obtain at least one template information corresponding to the at least one template label.

The obtaining unit 1201 is configured to obtain a template identifier and a corresponding thumbnail image included in at least one template information matching the item information.

In some embodiments, the obtaining unit 1201 is configured to receive an item identification request sent by the terminal, where the item identification request carries the first image;

The identification unit 1202 is configured to, in response to receiving the item identification request, identify the first image to obtain item information contained in the first image.

In some embodiments, the apparatus further includes:

a receiving unit, further configured to receive a template acquisition request sent by the terminal, where the template acquisition request carries target template information selected by the terminal;

The sending unit 1203 is further configured to send the target template corresponding to the target template information to the terminal.

FIG. 13 is a block diagram of an electronic device 1300 according to an exemplary embodiment. The electronic device 1300 is: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, the standard audio level 3 of the moving picture expert compression), MP4 (Moving Picture Experts Group Audio Layer IV, the moving picture expert compressed standard audio Level 4) Player, laptop or desktop computer. Electronic device 1300 may also be called user equipment, portable electronic device, laptop electronic device, desktop electronic device, and the like by other names.

Generally, the electronic device 1300 includes: one or more processors 1301 and one or more memories 1302 .

The processor 1301 includes one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1301 is implemented by at least one hardware form among DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), and PLA (Programmable Logic Array, programmable logic array). . The processor 1301 also includes a main processor and a coprocessor. The main processor is a processor used to process data in the wake-up state, also called CPU (Central Processing Unit, central processing unit); A low-power processor for processing data in a standby state. In some embodiments, the processor 1301 can be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is responsible for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, the processor 1301 further includes an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.

Memory 1302 includes one or more non-volatile storage media that are non-transitory. Memory 1302 also includes high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, the non-volatile storage medium in the memory 1302 is used to store at least one program code, and the at least one program code is used to be executed by the processor 1301 to realize the multimedia data shooting provided by the method embodiments of the present disclosure. method.

In some embodiments, the electronic device 1300 further includes: a peripheral device interface 1303 and at least one peripheral device. The processor 1301, the memory 1302 and the peripheral device interface 1303 are connected through a bus or a signal line. Each peripheral device is connected to the peripheral device interface 1303 through a bus, a signal line or a circuit board. In some embodiments, the peripheral device includes at least one of a radio frequency circuit 1304 , a display screen 1305 , a camera 1306 , an audio circuit 1307 , a positioning component 1308 and a power supply 1309 .

The peripheral device interface 1303 is used to connect at least one peripheral device related to I/O (Input/Output) to the processor 1301 and the memory 1302 . In some embodiments, processor 1301, memory 1302, and peripherals interface 1303 are integrated on the same chip or circuit board; in some other embodiments, any one of processor 1301, memory 1302, and peripherals interface 1303 or The two are implemented on a separate chip or circuit board, which is not limited by the embodiments of the present disclosure.

The radio frequency circuit 1304 is used for receiving and transmitting RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 1304 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1304 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, radio frequency circuitry 1304 includes: an antenna system, an RF transceiver, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and the like. The radio frequency circuit 1304 communicates with other electronic devices through at least one wireless communication protocol. The wireless communication protocols include, but are not limited to, metropolitan area networks, mobile communication networks of various generations (2G, 3G, 4G and 5G), wireless local area networks and/or WiFi (Wireless Fidelity, wireless fidelity) networks. In some embodiments, the radio frequency circuit 1304 further includes a circuit related to NFC (Near Field Communication, short-range wireless communication), which is not limited in the present disclosure.

The display screen 1305 is used to display UI (User Interface, user interface). The UI includes graphics, text, icons, video, and any combination thereof. Where display screen 1305 is a touch display screen, display screen 1305 also has the ability to acquire touch signals on or above the surface of display screen 1305 . The touch signal can be input to the processor 1301 as a control signal for processing. At this time, the display screen 1305 can also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, there is one display screen 1305, which is arranged on the front panel of the electronic device 1300; in other embodiments, there are at least two display screens 1305, which are respectively arranged on different surfaces of the electronic device 1300 or in a folded design; In still other embodiments, the display screen 1305 is a flexible display screen disposed on a curved or folded surface of the electronic device 1300 . Even, the display screen 1305 is set as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 1305 is made of materials such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light emitting diode).

The camera assembly 1306 is used to capture images or video. In some embodiments, camera assembly 1306 includes a front-facing camera and a rear-facing camera. Usually, the front camera is arranged on the front panel of the electronic device, and the rear camera is arranged on the back of the electronic device. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, the main camera It is integrated with the wide-angle camera to achieve panoramic shooting and VR (Virtual Reality, virtual reality) shooting functions or other integrated shooting functions. In some embodiments, the camera assembly 1306 also includes a flash. The flash is a single color temperature flash or a dual color temperature flash. Dual color temperature flash refers to the combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

Audio circuit 1307 includes a microphone and a speaker. The microphone is used to collect the sound waves of the user and the environment, convert the sound waves into electrical signals, and input them to the processor 1301 for processing, or to the radio frequency circuit 1304 to realize voice communication. For the purpose of stereo acquisition or noise reduction, there are multiple microphones, which are respectively disposed in different parts of the electronic device 1300 . The microphones are array microphones or omnidirectional acquisition microphones. The speaker is used to convert the electrical signal from the processor 1301 or the radio frequency circuit 1304 into sound waves. The loudspeaker is a traditional thin-film loudspeaker or a piezoelectric ceramic loudspeaker. When the loudspeaker is a piezoelectric ceramic loudspeaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 1307 also includes a headphone jack.

The positioning component 1308 is used to locate the current geographic location of the electronic device 1300 to implement navigation or LBS (Location Based Service). The positioning component 1308 is a positioning component based on the GPS (Global Positioning System, global positioning system) of the United States, the Beidou system of China, the Grenas system of Russia, or the Galileo system of the European Union.

Power supply 1309 is used to power various components in electronic device 1300 . The power source 1309 is alternating current, direct current, a primary battery or a rechargeable battery. Where the power source 1309 includes a rechargeable battery, the rechargeable battery can support wired or wireless charging. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the electronic device 1300 also includes one or more sensors 1310 . The one or more sensors 1310 include, but are not limited to, an acceleration sensor 1311 , a gyro sensor 1312 , a pressure sensor 1313 , a fingerprint sensor 1314 , an optical sensor 1315 and a proximity sensor 1316 .

The acceleration sensor 1311 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the electronic device 1300 . For example, the acceleration sensor 1311 can be used to detect the components of the gravitational acceleration on the three coordinate axes. The processor 1301 can control the display screen 1305 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1311 . The acceleration sensor 1311 can also be used for game or user movement data collection.

The gyroscope sensor 1312 can detect the body direction and rotation angle of the electronic device 1300 , and the gyroscope sensor 1312 can cooperate with the acceleration sensor 1311 to collect the 3D actions of the user on the electronic device 1300 . The processor 1301 can implement the following functions according to the data collected by the gyro sensor 1312: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 1313 is disposed on the side frame of the electronic device 1300 and/or the lower layer of the display screen 1305 . When the pressure sensor 1313 is disposed on the side frame of the electronic device 1300 , it can detect the user's holding signal of the electronic device 1300 , and the processor 1301 can perform left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1313 . In the case where the pressure sensor 1313 is disposed on the lower layer of the display screen 1305 , the processor 1301 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 1305 . The operability controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

The fingerprint sensor 1314 is used to collect the user's fingerprint, and the processor 1301 identifies the user's identity according to the fingerprint collected by the fingerprint sensor 1314, or the fingerprint sensor 1314 identifies the user's identity according to the collected fingerprint. In the case that the user's identity is identified as a trusted identity, the processor 1301 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. Fingerprint sensor 1314 is provided on the front, back, or side of electronic device 1300. In the case where the electronic device 1300 is provided with physical buttons or the manufacturer's logo, the fingerprint sensor 1314 is integrated with the physical buttons or the manufacturer's logo.

Optical sensor 1315 is used to collect ambient light intensity. In one embodiment, the processor 1301 can control the display brightness of the display screen 1305 according to the ambient light intensity collected by the optical sensor 1315 . In some embodiments, when the ambient light intensity is high, the display brightness of the display screen 1305 is increased; when the ambient light intensity is low, the display brightness of the display screen 1305 is decreased. In another embodiment, the processor 1301 can also dynamically adjust the shooting parameters of the camera assembly 1306 according to the ambient light intensity collected by the optical sensor 1315 .

Proximity sensor 1316 , also referred to as a distance sensor, is typically provided on the front panel of electronic device 1300 . Proximity sensor 1316 is used to collect the distance between the user and the front of electronic device 1300 . In one embodiment, when the proximity sensor 1316 detects that the distance between the user and the front of the electronic device 1300 is gradually decreasing, the processor 1301 controls the display screen 1305 to switch from the bright screen state to the off screen state; When the sensor 1316 detects that the distance between the user and the front of the electronic device 1300 is gradually increasing, the processor 1301 controls the display screen 1305 to switch from the off-screen state to the bright-screen state.

Those skilled in the art can understand that the structure shown in FIG. 13 does not constitute a limitation on the electronic device 1300. In other embodiments, the electronic device 1300 includes more or less components than those shown in the figure, or a combination of some components, or a different arrangement of components.

FIG. 14 is a block diagram of a server 1400 according to an exemplary embodiment. The server 1400 may vary greatly due to different configurations or performance. In some embodiments, the server 1400 includes one or more processors (Central Processing Units, CPU) 1401 and one or more memories 1402, wherein, the one or more memories 1402 store at least one piece of program code, the at least one piece of program code is loaded by the one or more processors 1401 and The method is executed to realize the multimedia data shooting method provided by each of the above method embodiments. In other embodiments, the server 1400 also has components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output, and the server 1400 also includes other components for realizing device functions, which will not be repeated here. .

In an exemplary embodiment, a non-volatile storage medium including instructions is also provided, such as a memory 1302 and a memory 1402 including instructions, and the instructions are executed by the processor 1301 of the terminal 1300 or the processor 1401 of the server 1400 to The above multimedia data shooting method is completed. In some embodiments, the non-volatile storage medium is a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium is a read-only memory (Read-Only Memory, ROM), a random access memory ( Random Access Memory, RAM), Compact Disc Read-Only Memory (CD-ROM), magnetic tapes, floppy disks, and optical data storage devices, etc.

In an exemplary embodiment, an application program product is also provided, and the application program product stores one or more instructions, and the one or more instructions are executed by the processor 1301 of the terminal 1300 or the processor 1401 of the server 1400, To complete the method steps of the multimedia data shooting method provided in the above embodiments.

All the embodiments of the present disclosure can be implemented independently or in combination with other embodiments, which are all regarded as the protection scope required by the present disclosure.

Claims

A method for photographing multimedia data, wherein the method comprises:

Collect the first image through the shooting interface;

In the shooting interface, at least one template information is displayed, the at least one template information matches the item information included in the first image, the at least one template information corresponds to at least one template, and the at least one template provides elements for synthesizing with multimedia data;

In response to the selection operation on the target template information, shooting is performed based on the target template corresponding to the target template information, and multimedia data including the target template is obtained.
The multimedia data shooting method according to claim 1, wherein the method further comprises:

At least one template information matching the item information is acquired based on the item information contained in the first image.
The method for capturing multimedia data according to claim 2, wherein the acquiring at least one template information matching the item information based on the item information included in the first image comprises:

Identifying the first image to obtain item information contained in the first image;

Acquire at least one template information matching the item information.
The multimedia data shooting method according to claim 3, wherein each template information corresponds to a template label;

The acquiring at least one template information matching the item information includes:

Template information corresponding to the template tag matching the item information is determined.
The multimedia data shooting method according to claim 2, wherein the acquiring at least one template information matching the item information comprises:

Send an item identification request to the server, where the item identification request carries the first image, and the item identification request is used to instruct the server to identify the item information contained in the first image, and obtain a match with the item information at least one template information of ;

The at least one template information returned by the server is received.
The multimedia data shooting method according to claim 5, wherein the template information includes a template identifier and a corresponding thumbnail;

The receiving the at least one template information returned by the server includes:

At least one template identifier and a corresponding thumbnail image returned by the server are received.
The multimedia data shooting method according to claim 1, wherein the method further comprises:

In response to the selection operation on the target template information, a template acquisition request is sent to the server, and the template acquisition request carries the selected target template information;

The target template returned by the server is received.
The multimedia data shooting method according to claim 1, wherein the template information is multiple in number, and each template information includes a thumbnail image;

In the shooting interface, at least one template information is displayed, including:

The plurality of thumbnails are displayed in sequence in the first target area of the shooting interface according to the arrangement order of the plurality of thumbnails, and the arrangement order is determined based on the matching degree between the template tag corresponding to each template information and the item information .
The multimedia data shooting method according to claim 1, wherein the template information is multiple in number, and each template information includes a thumbnail image;

In the shooting interface, at least one template information is displayed, including:

In the first target area of the photographing interface, any thumbnail is displayed, and in the second target area of the photographing interface, thumbnails other than any one of the thumbnails are displayed.
The multimedia data photographing method according to claim 9, wherein, in the first target area of the photographing interface, any thumbnail image is displayed, and in the second target area of the photographing interface, any thumbnail image is displayed except any one. Thumbnails other than thumbnails, including:

in the first target area, displaying the first thumbnail;

In the second target area, thumbnail images other than the first thumbnail image are displayed.
The multimedia data shooting method according to claim 9, wherein the method further comprises any one of the following:

In response to the sliding operation in the second target area, according to the sliding direction indicated by the sliding operation, the thumbnail images displayed in the first target area and the thumbnail images in the second target area are adjusted. display location;

In response to a selection operation on any thumbnail, the selected thumbnail is displayed in the first target area.
The multimedia data shooting method according to claim 8 or 9, wherein the shooting based on the target template corresponding to the target template information to obtain the multimedia data including the target template, comprising:

In response to the triggering operation on the first target area, determining the template corresponding to the thumbnail image currently displayed in the first target area as the target template;

Shooting is performed based on the target template to obtain multimedia data including the target template.
The multimedia data shooting method according to claim 1, wherein the shooting based on the target template corresponding to the target template information to obtain the multimedia data including the target template, comprising:

Synthesizing the target template with the photographed multimedia data to obtain multimedia data including the target template.
The multimedia data shooting method according to claim 1, wherein the method further comprises:

Through the photographing interface, first prompt information is displayed, where the first prompt information is used to prompt that the first image is being recognized.
The multimedia data shooting method according to claim 1, wherein the method further comprises:

Through the shooting interface, second prompt information is displayed, where the second prompt information is used to prompt that template information matching the item information has been obtained.
The multimedia data shooting method according to claim 1, wherein the shooting interface further comprises a re-identification control;

The method also includes:

re-acquiring the second image in response to a triggering operation on the re-identification control;

In the photographing interface, at least one template information matching the item information included in the second image is displayed.
The multimedia data shooting method according to claim 1, wherein the method further comprises:

In response to a triggering operation on a blank area in the photographing interface, the second image is re-captured, and the blank area refers to an area in the photographing interface that does not include controls.
The multimedia data shooting method according to claim 1, wherein the method further comprises:

In the second target area of the shooting interface, an object identification control is displayed, and the object identification control is used to display the item information contained in the first image in the shooting interface after being triggered.
The multimedia data shooting method according to claim 18, wherein the method further comprises any one of the following:

In response to the sliding operation in the second target area, displaying the object recognition control in the first target area of the shooting interface;

In response to the selection operation on the identification control, the identification control is displayed in the first target area.
The multimedia data shooting method according to claim 19, wherein the method further comprises:

In response to the triggering operation on the object identification control, the object information included in the first image is displayed through the photographing interface.
The multimedia data shooting method according to claim 20, wherein the method further comprises:

In the case that the object identification control is triggered and the second image is collected through the shooting interface, acquiring the item information included in the second image;

Through the shooting interface, the item information included in the second image is displayed.
A method for photographing multimedia data, wherein the method comprises:

obtaining the first image collected by the terminal through the shooting interface;

Identifying the first image to obtain item information contained in the first image;

acquiring at least one template information matching the item information, the at least one template information corresponding to at least one template, the at least one template providing elements for synthesizing with multimedia data;

The at least one template information is sent to the terminal.
The multimedia data shooting method according to claim 22, wherein each template information corresponds to a template tag;

The acquiring at least one template information matching the item information includes:

determining at least one template tag matching the item information based on the template tag corresponding to each template information;

Acquire at least one template information corresponding to the at least one template tag.
The multimedia data shooting method according to claim 22, wherein the template information includes a template identifier and a corresponding thumbnail;

The acquiring at least one template information matching the item information includes:

A template identifier and a corresponding thumbnail included in at least one template information matching the item information are acquired.
The method for photographing multimedia data according to claim 22, wherein the obtaining of the first image collected by the terminal through the photographing interface comprises:

receiving an item identification request sent by the terminal, where the item identification request carries the first image;

The identifying the first image to obtain item information contained in the first image includes:

In response to receiving the item identification request, the first image is identified to obtain item information included in the first image.
The multimedia data shooting method according to claim 22, wherein the method further comprises:

receiving a template acquisition request sent by the terminal, where the template acquisition request carries target template information selected by the terminal;

Send the target template corresponding to the target template information to the terminal.
A multimedia data shooting device, wherein the device comprises:

an acquisition unit, configured to acquire the first image through the photographing interface;

a display unit, configured to display at least one template information in the shooting interface, the at least one template information matches the item information included in the first image, the at least one template information corresponds to at least one template, the at least one template provides elements for synthesizing with multimedia data;

The photographing unit is configured to, in response to the selection operation on the target template information, photograph based on the target template corresponding to the target template information, and obtain multimedia data including the target template.
The apparatus for capturing multimedia data according to claim 27, wherein the apparatus further comprises:

The first acquiring unit is configured to acquire at least one template information matching the item information based on the item information included in the first image.
The multimedia data photographing device according to claim 28, wherein the first acquisition unit comprises an identification subunit and an acquisition subunit;

The identifying subunit is configured to identify the first image to obtain item information contained in the first image;

The obtaining subunit is configured to obtain at least one template information matching the item information.
The multimedia data photographing device according to claim 29, wherein each template information corresponds to a template tag;

The obtaining subunit is configured to determine template information corresponding to the template tag matched with the item information.
The multimedia data photographing device according to claim 28, wherein the first acquiring unit comprises a sending subunit and a receiving subunit;

The sending subunit is configured to send an item identification request to the server, where the item identification request carries the first image, and the item identification request is used to instruct the server to identify the item information contained in the first image , and obtain at least one template information that matches the item information;

The receiving subunit is configured to receive the at least one template information returned by the server.
The multimedia data capturing device according to claim 31, wherein the template information includes a template identifier and a corresponding thumbnail;

The receiving subunit is configured to receive at least one template identifier and a corresponding thumbnail returned by the server.
The apparatus for capturing multimedia data according to claim 27, wherein the apparatus further comprises:

a sending unit, configured to send a template acquisition request to the server in response to the selection operation on the target template information, where the template acquisition request carries the selected target template information;

A receiving unit, configured to receive the target template returned by the server.
The multimedia data capturing device according to claim 27, wherein the template information is plural in number, and each template information includes a thumbnail image;

The display unit is configured to sequentially display the plurality of thumbnails in the first target area of the shooting interface according to the arrangement order of the plurality of thumbnails, and the arrangement order is based on the template corresponding to each template information The degree of matching between the label and the item information is determined.
The multimedia data capturing device according to claim 27, wherein the template information is plural in number, and each template information includes a thumbnail image;

The display unit is configured to display any one of the thumbnails in the first target area of the shooting interface, and to display thumbnails other than any one of the thumbnails in the second target area of the shooting interface.
The multimedia data capturing apparatus according to claim 35, wherein the display unit is configured to display a first thumbnail image in the first target area; and display all thumbnail images in the second target area Thumbnails other than the first thumbnail mentioned.
The apparatus for capturing multimedia data according to claim 35, wherein the apparatus further comprises:

an adjustment unit, configured to adjust the thumbnail image displayed in the first target area and the second target according to the sliding direction indicated by the sliding operation in response to the sliding operation in the second target area The display position of the thumbnails in the area;

The display unit is further configured to display the selected thumbnail in the first target area in response to a selection operation on any thumbnail.
The multimedia data photographing apparatus according to claim 34 or 35, wherein the photographing unit is configured to, in response to a triggering operation on the first target area, display the thumbnail image currently displayed in the first target area. The template corresponding to the thumbnail is determined to be the target template; shooting is performed based on the target template to obtain multimedia data including the target template.
The apparatus for capturing multimedia data according to claim 27, wherein the capturing unit is configured to synthesize the target template and the captured multimedia data to obtain multimedia data including the target template.
The multimedia data shooting device according to claim 27, wherein the display unit is further configured to display first prompt information through the shooting interface, the first prompt information is used to prompt that the first prompt information is being recognized image.
The multimedia data shooting device according to claim 27, wherein the display unit is further configured to display second prompt information through the shooting interface, the second prompt information is used to prompt that the acquisition and the Template information matched by item information.
The multimedia data photographing device according to claim 27, wherein the photographing interface further comprises a re-identification control;

The acquisition unit is further configured to re-acquire the second image in response to a triggering operation on the re-identification control;

The display unit is further configured to display at least one template information matching the item information included in the second image in the shooting interface.
The multimedia data photographing device according to claim 27, wherein the acquisition unit is further configured to re-acquire the second image in response to a triggering operation on a blank area in the photographing interface, and the blank area refers to the The area of the shooting interface that does not include controls.
The multimedia data shooting device according to claim 27, wherein the display unit is further configured to display an object identification control in the second target area of the shooting interface, and the object identification control is used when triggered Then, the item information included in the first image is displayed on the shooting interface.
The multimedia data capturing apparatus according to claim 44, wherein the display unit is further configured to perform any one of the following:

In response to the sliding operation in the second target area, displaying the object recognition control in the first target area of the shooting interface;

In response to the selection operation on the identification control, the identification control is displayed in the first target area.
The multimedia data shooting device according to claim 45, wherein the display unit is further configured to display the items included in the first image through the shooting interface in response to a triggering operation on the object identification control information.
The apparatus for capturing multimedia data according to claim 46, wherein the apparatus further comprises:

a second acquiring unit, configured to acquire item information contained in the second image when the object identification control is triggered and the second image is captured through the shooting interface;

The display unit is further configured to display the item information included in the second image through the photographing interface.
A multimedia data shooting device, wherein the device comprises:

an acquisition unit, configured to acquire the first image acquired by the terminal through the shooting interface;

an identification unit, configured to identify the first image to obtain item information contained in the first image;

The acquiring unit is further configured to acquire at least one template information matching the item information, the at least one template information corresponding to at least one template, and the at least one template provides elements for synthesizing with multimedia data;

A sending unit, configured to send the at least one template information to the terminal.
The multimedia data capturing apparatus according to claim 48, wherein each template information corresponds to a template tag;

The acquiring unit is configured to determine at least one template tag matching the item information based on the template tag corresponding to each template information, and acquire at least one template information corresponding to the at least one template tag.
The multimedia data capturing apparatus according to claim 48, wherein the template information includes a template identifier and a corresponding thumbnail;

The acquiring unit is configured to acquire a template identifier and a corresponding thumbnail image included in at least one template information matching the item information.
The multimedia data capturing device according to claim 48, wherein the acquiring unit is configured to receive an item identification request sent by the terminal, and the item identification request carries the first image;

The identification unit is configured to, in response to receiving the item identification request, identify the first image to obtain item information included in the first image.
The apparatus for capturing multimedia data according to claim 48, wherein the apparatus further comprises:

a receiving unit, configured to receive a template acquisition request sent by the terminal, where the template acquisition request carries target template information selected by the terminal;

The sending unit is further configured to send the target template corresponding to the target template information to the terminal.
A terminal, wherein the terminal includes:

processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the following steps:

Collect the first image through the shooting interface;

In the shooting interface, at least one template information is displayed, the at least one template information matches the item information included in the first image, the at least one template information corresponds to at least one template, and the at least one template provides elements for synthesizing with multimedia data;

In response to the selection operation on the target template information, shooting is performed based on the target template corresponding to the target template information, and multimedia data including the target template is obtained.
The terminal of claim 53, wherein the processor is further configured to execute the instructions to implement the steps of:

At least one template information matching the item information is acquired based on the item information contained in the first image.
The terminal of claim 54, wherein the processor is further configured to execute the instructions to implement the steps of:

Identifying the first image to obtain item information contained in the first image;

Acquire at least one template information matching the item information.
The terminal according to claim 55, wherein each template information corresponds to a template tag;

The processor is also configured to execute the instructions to implement the following steps:

Template information corresponding to the template tag matching the item information is determined.
The terminal of claim 54, wherein the processor is further configured to execute the instructions to implement the steps of:

Send an item identification request to the server, where the item identification request carries the first image, and the item identification request is used to instruct the server to identify the item information contained in the first image, and obtain a match with the item information at least one template information of ;

The at least one template information returned by the server is received.
The terminal according to claim 57, wherein the template information includes a template identifier and a corresponding thumbnail;

The processor is also configured to execute the instructions to implement the following steps:

At least one template identifier and a corresponding thumbnail image returned by the server are received.
The terminal of claim 53, wherein the processor is further configured to execute the instructions to implement the steps of:

In response to the selection operation on the target template information, a template acquisition request is sent to the server, and the template acquisition request carries the selected target template information;

The target template returned by the server is received.
The terminal according to claim 53, wherein the number of the template information is multiple, and each template information includes a thumbnail;

The processor is also configured to execute the instructions to implement the following steps:

The plurality of thumbnails are displayed in sequence in the first target area of the shooting interface according to the arrangement order of the plurality of thumbnails, and the arrangement order is determined based on the matching degree between the template tag corresponding to each template information and the item information .
The terminal according to claim 53, wherein the number of the template information is multiple, and each template information includes a thumbnail;

The processor is also configured to execute the instructions to implement the following steps:

In the first target area of the photographing interface, any thumbnail is displayed, and in the second target area of the photographing interface, thumbnails other than any one of the thumbnails are displayed.
The terminal of claim 61, wherein the processor is further configured to execute the instructions to implement the steps of:

in the first target area, displaying the first thumbnail;

In the second target area, thumbnail images other than the first thumbnail image are displayed.
The terminal of claim 61, wherein the processor is further configured to execute the instructions to implement any of the following:

In response to the sliding operation in the second target area, according to the sliding direction indicated by the sliding operation, the thumbnail images displayed in the first target area and the thumbnail images in the second target area are adjusted. display location;

In response to a selection operation on any thumbnail, the selected thumbnail is displayed in the first target area.
The terminal of claim 60 or 61, wherein the processor is further configured to execute the instructions to implement the steps of:

In response to the triggering operation on the first target area, determining the template corresponding to the thumbnail image currently displayed in the first target area as the target template;

Shooting is performed based on the target template to obtain multimedia data including the target template.
The terminal of claim 53, wherein the processor is further configured to execute the instructions to implement the steps of:

Synthesizing the target template with the photographed multimedia data to obtain multimedia data including the target template.
The terminal of claim 53, wherein the processor is further configured to execute the instructions to implement the steps of:

Through the photographing interface, first prompt information is displayed, where the first prompt information is used to prompt that the first image is being recognized.
The terminal of claim 53, wherein the processor is further configured to execute the instructions to implement the steps of:

Through the shooting interface, second prompt information is displayed, where the second prompt information is used to prompt that template information matching the item information has been obtained.
The terminal of claim 53, wherein the photographing interface further comprises a re-identification control;

The processor is also configured to execute the instructions to implement the following steps:

re-acquiring the second image in response to a triggering operation on the re-identification control;

In the photographing interface, at least one template information matching the item information included in the second image is displayed.
The terminal of claim 53, wherein the processor is further configured to execute the instructions to implement the steps of:

In response to a triggering operation on a blank area in the photographing interface, the second image is recaptured, and the blank area refers to an area in the photographing interface that does not include controls.
The terminal of claim 53, wherein the processor is further configured to execute the instructions to implement the steps of:

In the second target area of the shooting interface, an object identification control is displayed, and the object identification control is used to display the item information included in the first image in the shooting interface after being triggered.
The terminal of claim 70, wherein the processor is further configured to execute the instructions to implement any of the following:

In response to the sliding operation in the second target area, displaying the object recognition control in the first target area of the shooting interface;

In response to the selection operation on the identification control, the identification control is displayed in the first target area.
The terminal of claim 71, wherein the processor is further configured to execute the instructions to implement the steps of:

In response to the triggering operation on the object identification control, the object information included in the first image is displayed through the photographing interface.
The terminal of claim 72, wherein the processor is further configured to execute the instructions to implement the steps of:

In the case that the object identification control is triggered and the second image is collected through the shooting interface, acquiring the item information included in the second image;

Through the shooting interface, the item information included in the second image is displayed.
A server, wherein the server includes:

processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the following steps:

obtaining the first image collected by the terminal through the shooting interface;

Identifying the first image to obtain item information contained in the first image;

acquiring at least one template information matching the item information, the at least one template information corresponding to at least one template, the at least one template providing elements for synthesizing with multimedia data;

The at least one template information is sent to the terminal.
The server of claim 74, wherein each template information corresponds to a template tag;

The processor is also configured to execute the instructions to implement the following steps:

determining at least one template tag matching the item information based on the template tag corresponding to each template information;

Acquire at least one template information corresponding to the at least one template tag.
The server of claim 74, wherein the template information includes a template identifier and a corresponding thumbnail;

The processor is also configured to execute the instructions to implement the following steps:

A template identifier and a corresponding thumbnail included in at least one template information matching the item information are acquired.
The server of claim 74, wherein the processor is further configured to execute the instructions to implement the steps of:

receiving an item identification request sent by the terminal, where the item identification request carries the first image;

The identifying the first image to obtain item information contained in the first image includes:

In response to receiving the item identification request, the first image is identified to obtain item information included in the first image.
The server of claim 74, wherein the processor is further configured to execute the instructions to implement the steps of:

receiving a template acquisition request sent by the terminal, where the template acquisition request carries target template information selected by the terminal;

Send the target template corresponding to the target template information to the terminal.
A non-volatile storage medium, wherein when the instructions in the non-volatile storage medium are executed by a processor of a terminal, the terminal can perform the following steps:

Collect the first image through the shooting interface;

In the shooting interface, at least one template information is displayed, the at least one template information matches the item information included in the first image, the at least one template information corresponds to at least one template, and the at least one template provides elements for synthesizing with multimedia data;

In response to the selection operation on the target template information, shooting is performed based on the target template corresponding to the target template information, and multimedia data including the target template is obtained.
A non-volatile storage medium, wherein the instructions in the non-volatile storage medium, when executed by a processor of a server, enable the server to perform the following steps:

obtaining the first image collected by the terminal through the shooting interface;

Identifying the first image to obtain item information contained in the first image;

acquiring at least one template information matching the item information, the at least one template information corresponding to at least one template, the at least one template providing elements for synthesizing with multimedia data;

The at least one template information is sent to the terminal.
An application program product, comprising instructions, wherein, when the instructions are executed by a processor of a terminal, the following steps are implemented:

Collect the first image through the shooting interface;

In the shooting interface, at least one template information is displayed, the at least one template information matches the item information included in the first image, the at least one template information corresponds to at least one template, and the at least one template provides elements for synthesizing with multimedia data;

In response to the selection operation on the target template information, shooting is performed based on the target template corresponding to the target template information, and multimedia data including the target template is obtained.
An application program product, comprising instructions, wherein the instructions, when executed by a processor of a server, implement the following steps:

obtaining the first image collected by the terminal through the shooting interface;

Identifying the first image to obtain item information contained in the first image;

acquiring at least one template information matching the item information, the at least one template information corresponding to at least one template, the at least one template providing elements for synthesizing with multimedia data;

The at least one template information is sent to the terminal.