CN112052897B

CN112052897B - Multimedia data shooting method, device, terminal, server and storage medium

Info

Publication number: CN112052897B
Application number: CN202010915878.3A
Authority: CN
Inventors: 李倩; 舒莹; 姜海洋
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2020-09-03
Filing date: 2020-09-03
Publication date: 2022-06-03
Anticipated expiration: 2040-09-03
Also published as: CN112052897A; WO2022048398A1

Abstract

The disclosure relates to a multimedia data shooting method, a multimedia data shooting device, a terminal, a server and a storage medium, and belongs to the technical field of computers. According to the scheme, the object information contained in the target image collected in the shooting interface is identified, the template information matched with the object information is obtained, the templates corresponding to the template information are related to the object information, the template information is displayed, a user only needs to select from the displayed template information, the multimedia data can be shot based on the selected target template information, the user does not need to browse a large number of templates, the number of the templates needing to be browsed by the user is greatly reduced, the operation is simple, and the operation efficiency is improved.

Description

Multimedia data shooting method, device, terminal, server and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a multimedia data shooting method, an apparatus, a terminal, a server, and a storage medium.

Background

With the development of internet technology and the popularization of intelligent terminals, data sharing functions are widely applied, and a plurality of users can share the multimedia data shot by the users to other people, such as videos and pictures, or watch the multimedia data shared by other people, so that interaction among different users is realized through the multimedia data.

In order to improve the shooting effect of the multimedia data, a plurality of templates, such as magic expressions, sticker props and the like, are usually provided for a user, and the user can select a template related to shooting content and shoot the multimedia data based on the selected template.

In the implementation process, because the number of the templates is often huge, a user needs to select a proper template from a large number of templates, the operation is complex, and the operation efficiency is low.

Disclosure of Invention

The present disclosure provides a multimedia data photographing method, apparatus, terminal, server, and storage medium to simplify an operation when a template is selected, thereby improving operation efficiency. The technical scheme of the disclosure is as follows:

according to a first aspect of an embodiment of the present disclosure, there is provided a multimedia data photographing method, the method including:

acquiring a target image in a shooting range through a shooting interface;

acquiring at least one piece of template information according to the article information contained in the target image, wherein the template information is used for indicating a template matched with the article information;

displaying the at least one template information through the shooting interface;

shooting is carried out based on the selected target template information in the at least one template information, and multimedia data comprising the target template are obtained.

According to the scheme, the object information contained in the target image collected in the shooting interface is identified, the template information matched with the object information is obtained, the templates corresponding to the template information are related to the object information, the template information is displayed, a user only needs to select from the displayed template information, the multimedia data can be shot based on the selected target template information, the user does not need to browse a large number of templates, the number of the templates needing to be browsed by the user is greatly reduced, the operation is simple, and the operation efficiency is improved.

In a possible implementation manner, the obtaining at least one template information according to the item information included in the target image includes:

identifying the object image to obtain object information contained in the object image;

determining at least one template matching the item information;

template information of the at least one template is obtained.

The target image is the image corresponding to the shooting range and can represent the content to be shot by the user, so that the object information identified based on the target image can represent the object contained in the content to be shot by the user, the template information matched with the object information is obtained, the template recommendation based on the content to be shot by the user can be realized, and the template recommendation efficiency is improved.

In one possible implementation, the determining at least one template matching the item information includes:

and selecting the template corresponding to the template label matched with the article information according to the template label of each template.

The template label of each template can represent the characteristics of each template, so that the template label most similar to the identified article information is determined through matching the article information and the template label, that is, the template information matched with the article information can be obtained, the template recommendation is realized, and the recommendation accuracy is improved.

sending an article identification request to a server, wherein the article identification request carries the target image, and the article identification request is used for indicating the server to identify article information contained in the target image and acquiring template information of at least one template matched with the article information;

and receiving the at least one template information returned by the server.

The method comprises the steps that an article identification request is sent to a server, so that the server can obtain a target image to be identified, the obtained target image is identified, and template recommendation based on the target image is achieved.

In a possible implementation manner, the receiving the at least one template information returned by the server includes:

and receiving at least one template identifier and a corresponding thumbnail returned by the server.

Because one template identifier corresponds to one template and the thumbnails of the templates can embody the content in the templates and the data volume is smaller than that of the templates, the server sends the template identifiers and the thumbnails to the terminal instead of sending the templates, the data volume transmitted can be reduced, network resources are saved, and a user can know the template style through the thumbnails shown by the terminal.

In a possible implementation manner, after the displaying the at least one template information through the shooting interface, the method further includes:

responding to the selection operation of any template information in the at least one template information, and sending a template acquisition request to the server, wherein the template acquisition request carries the selected target template information;

and receiving the target template returned by the server.

The target template information can uniquely identify the selected target template, and the target template selected by the user is acquired by sending a template acquisition request carrying the target template information to the server. In the method, the server only needs to return the selected target template to the terminal, and all recommended templates do not need to be returned, so that the transmitted data volume is reduced, and the network resources are saved.

In one possible implementation, the at least one template information includes a plurality of template information, and each template information includes a thumbnail;

should through this shooting interface, show this at least one template information, include:

and sequentially displaying the plurality of thumbnails in the target area in the shooting interface according to the arrangement sequence of the plurality of thumbnails.

Different thumbnails are displayed in the target area in a rotating mode, so that a user can conveniently select a needed thumbnail, the situation that a plurality of thumbnails are displayed simultaneously to occupy too much display space can be avoided, interface display elements are simplified, and the situation that the user is disturbed due to too much content is prevented from being displayed.

through the shooting interface, a plurality of thumbnails arranged in sequence are displayed, and one of the thumbnails is located in the target area.

The thumbnails are displayed according to the arrangement sequence, so that a user can conveniently select a required thumbnail, one of the thumbnails is located in the target area, a highlighted effect is achieved, and the user can be prompted to select the thumbnail in the target area.

In one possible implementation manner, the displaying, through the shooting interface, a plurality of thumbnails arranged in sequence, wherein one of the thumbnails is located in the target area, includes:

displaying a first thumbnail of the plurality of thumbnails in the target area;

and displaying the thumbnails of the plurality of thumbnails except the first thumbnail in other areas except the target area.

The thumbnail with the highest matching degree with the item information is preferentially displayed in the target area according to the arrangement sequence, so that a user can see the thumbnail with the highest matching degree first, and the thumbnail with the highest matching degree is preferentially displayed because the thumbnail with the highest matching degree is the thumbnail which is most probably selected by the user, so that the recommendation efficiency can be improved, the selection of the user is facilitated, and the user experience is improved.

In one possible implementation, after displaying the thumbnails of the plurality of thumbnails other than the first thumbnail in the other area other than the target area, the method further includes any one of:

in response to a sliding operation on the plurality of thumbnails, adjusting the display positions of the plurality of thumbnails according to the sliding direction indicated by the sliding operation, wherein the thumbnails displayed in the target area are changed;

in response to a selection operation of any one of the plurality of thumbnails, the selected thumbnail is displayed in the target area.

The thumbnail displayed in the target area can be changed by sliding or selecting, the thumbnail displayed in the target area is replaced, and the user can conveniently select the thumbnail displayed in the target area subsequently.

In a possible implementation manner, the shooting based on the selected target template information in the at least one template information to obtain multimedia data including a target template includes:

responding to the trigger operation of the target area, and determining a template corresponding to the thumbnail currently displayed in the target area as the target template;

shooting is carried out based on the target template, and multimedia data comprising the target template are obtained.

The method has the advantages that the template corresponding to the thumbnail currently displayed in the target area can be automatically obtained only by once triggering operation of the user on the target area, and shooting is started simultaneously, so that the user does not need to respectively execute operations of selecting the template and starting shooting, user operation is simplified, operation time is saved, and operation efficiency is improved.

In a possible implementation manner, the performing shooting based on the target template to obtain multimedia data including the target template includes:

and synthesizing the target template and the shot multimedia data to obtain the multimedia data comprising the target template.

The selected target template is applied to the shot multimedia data by synthesizing the target template and the multimedia data, so that the display effect of the multimedia data is improved.

In a possible implementation manner, before the obtaining at least one template information according to the item information included in the target image, the method further includes:

and displaying first prompt information through the shooting interface, wherein the first prompt information is used for prompting that the target image is being identified.

Through the first prompt information, the user is prompted based on the identified progress, so that the user can obtain the identified progress in time, and the user experience is improved.

In a possible implementation manner, after obtaining at least one template information according to the item information included in the target image, the method further includes:

and displaying second prompt information through the shooting interface, wherein the second prompt information is used for prompting that the template matched with the article information is identified.

And prompting the user based on the progress of the recognized result through the second prompt information so that the user can obtain the recognition progress in time and the user experience is improved.

In one possible implementation, the shooting interface further includes a re-recognition control;

after the at least one template information is displayed through the shooting interface, the method further includes:

and in response to the triggering operation of the re-recognition control, re-acquiring the target image of the shooting range.

The re-recognition control is arranged on the shooting interface, so that when a user wants to replace shooting contents, the template matched with the article information contained in the newly acquired target image is obtained again through the re-recognition control, the user does not need to browse a large number of templates, and the operation efficiency is improved.

and responding to a triggering operation of a blank area in the shooting interface, and re-acquiring the target image of the shooting range, wherein the blank area refers to an area which does not include a control in the shooting interface.

The blank area of the shooting interface is provided with the re-identification function, so that when a user wants to replace multimedia data to be shot, the blank area is triggered, the template matched with the article information contained in the newly-collected target image is obtained again, the user does not need to browse a large number of templates, and the operation efficiency is improved.

and displaying an object recognizing control in the area except the target area in the shooting interface.

Through setting up the literacy controlling part at the shooting interface to when the user wants to know the article information that the target image contains, through this literacy controlling part, come to show article information, improve operating efficiency, and then improve user experience.

In a possible implementation manner, after the object recognition control is displayed in a region other than the target region in the shooting interface, the method further includes any one of:

responding to the sliding operation of the area except the target area in the shooting interface, and displaying the literacy control in the target area;

and responding to the selection operation of the knowledge control in the shooting interface, and displaying the knowledge control in the target area.

Through sliding the literacy controlling part to the target area, or selecting the literacy controlling part, the terminal can open the literacy function based on the triggering operation of the user, and then provide the demonstration of article information for the user, so that the user knows the article information that the target image contains, improves operating efficiency, and then improves user experience.

In a possible implementation manner, after the displaying the literacy control in the area other than the target area in the shooting interface, the method further includes:

and responding to the triggering operation of the literacy control in the shooting interface, and displaying the article information of the target image through the shooting interface.

Through triggering the object recognizing control, the terminal can display the object information, so that a user can know the object information contained in the target image, the operation efficiency is improved, and the user experience is improved.

In a possible implementation manner, after the item information of the target image is displayed through the shooting interface in response to the triggering operation of the literacy control in the shooting interface, the method further includes:

responding to the change of the target image in the shooting range, and acquiring the article information of the changed target image;

and displaying the article information of the changed target image through the shooting interface.

When the target image within the shooting range changes, the object information of the newly acquired target image is acquired again, and then the new object information is displayed, so that the automatic refreshing of the recognition result is realized, the operation efficiency is improved, and the user experience is improved.

According to a second aspect of the embodiments of the present disclosure, there is provided a multimedia data photographing method including:

receiving an article identification request sent by a terminal, wherein the article identification request carries a target image acquired by the terminal through a shooting interface;

responding to the item identification request, identifying the target image to obtain item information contained in the target image;

acquiring at least one template information, wherein the template information is used for indicating a template matched with the article information;

and transmitting the at least one template information to the terminal.

According to the scheme, when an article identification request of the terminal is received, article information contained in a target image carried by the article identification request is identified, and template information matched with the article information is obtained, because the target image is an image to be shot by a user, the article information contained in the target image can reflect data content to be shot by the user, and templates corresponding to the template information are related to the article information, the template information is sent to the terminal, the user only needs to select from the template information displayed by the terminal, and then multimedia data are shot based on the selected target template information, so that the number of the templates to be browsed by the user is greatly reduced, the user does not need to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

In a possible implementation manner, the obtaining at least one piece of template information includes:

determining at least one template label matched with the article information according to the template label of each template;

and acquiring at least one template information corresponding to the at least one template label.

The template tag of each template can represent the type of each template, elements included in each template and the like, so that the template tag most similar to the identified article information can be determined through matching of the article information and the template tag, the template matched with the article information can be obtained, and the determination of the template to be recommended is realized.

and acquiring the template identification of at least one template matched with the article information and the corresponding thumbnail.

Because one template identifier corresponds to one template, the thumbnail of each template can reflect elements contained in the template, the data volume is small, the corresponding template is determined according to the template identifier by obtaining the template identifier, and the style of each template is displayed through the thumbnail by obtaining the thumbnail.

In a possible implementation manner, after the sending of the at least one template information to the terminal, the method further includes:

receiving a template acquisition request sent by the terminal, wherein the template acquisition request carries target template information selected by the terminal;

and sending the target template to the terminal.

The server can conveniently acquire which template is selected by the user by receiving the template acquisition request of the terminal, and then the template selected by the user is sent to the terminal, so that the terminal can conveniently shoot the multimedia data based on the received template.

According to a third aspect of the embodiments of the present disclosure, there is provided a multimedia data photographing apparatus including:

the acquisition unit is configured to acquire a target image of a shooting range through a shooting interface;

an acquisition unit configured to perform acquisition of at least one template information indicating a template matching the item information, based on the item information contained in the target image;

a display unit configured to perform displaying the at least one template information through the photographing interface;

and the shooting unit is configured to perform shooting based on the selected target template information in the at least one template information to obtain multimedia data comprising the target template.

In one possible implementation, the obtaining unit includes an identifying subunit, a determining subunit, and an obtaining subunit;

the identification subunit is configured to perform article identification on the target image to obtain article information contained in the target image;

the determining subunit configured to perform determining at least one template matching the item information;

the obtaining subunit is configured to perform obtaining template information of the at least one template.

In a possible implementation manner, the determining subunit is configured to perform, according to the template tag of each template, selecting a template corresponding to the template tag matching the item information.

In one possible implementation, the obtaining unit includes a sending subunit and a receiving subunit;

the sending subunit is configured to execute sending, to a server, an item identification request, where the item identification request carries the target image, and the item identification request is used to instruct the server to identify item information included in the target image, and to acquire template information of at least one template matching the item information;

the receiving subunit is configured to perform receiving the at least one template information returned by the server.

In a possible implementation manner, the receiving subunit is configured to perform receiving of the at least one template identifier and the corresponding thumbnail returned by the server.

In one possible implementation, the apparatus further includes:

the sending unit is configured to execute a selection operation responding to any template information in the at least one template information, and send a template obtaining request to the server, wherein the template obtaining request carries selected target template information;

and the receiving unit is configured to execute receiving the target template returned by the server.

the display unit is configured to sequentially display a plurality of thumbnails in the target area in the shooting interface in the order of arrangement of the thumbnails.

the display unit is configured to display a plurality of thumbnails arranged in sequence through the shooting interface, wherein one thumbnail is located in the target area.

In one possible implementation manner, the display unit is configured to display a first thumbnail of the plurality of thumbnails in the target area, and display thumbnails of the plurality of thumbnails other than the first thumbnail in areas other than the target area.

In one possible implementation, the apparatus further includes:

an adjustment unit configured to perform adjustment of display positions of the plurality of thumbnails in accordance with a slide direction indicated by a slide operation in response to the slide operation on the plurality of thumbnails, wherein the thumbnails displayed in the target area are changed;

the display unit is further configured to perform displaying the selected thumbnail in the target area in response to a selection operation of any one of the plurality of thumbnails.

In one possible implementation, the photographing unit includes a determining subunit and a photographing subunit;

the determining subunit is configured to execute, in response to a trigger operation on the target area, determining a template corresponding to the thumbnail currently displayed in the target area as the target template;

and the shooting subunit is configured to execute shooting based on the target template to obtain multimedia data comprising the target template.

In a possible implementation manner, the shooting subunit is configured to perform synthesis of the target template and the shot multimedia data, and obtain the multimedia data including the target template.

In a possible implementation manner, the display unit is further configured to execute displaying, through the shooting interface, first prompt information for prompting that the target image is being recognized.

In a possible implementation manner, the display unit is further configured to execute displaying, through the shooting interface, second prompt information for prompting that a template matching the item information is identified.

In one possible implementation manner, the shooting interface further comprises a re-recognition control;

the acquisition unit is further configured to execute the triggering operation of the re-recognition control to re-acquire the target image of the shooting range.

In a possible implementation manner, the acquisition unit is further configured to perform re-acquisition of the target image of the shooting range in response to a trigger operation on a blank area in the shooting interface, where the blank area refers to an area in the shooting interface that does not include a control.

In a possible implementation manner, the display unit is further configured to execute displaying a literacy control in an area except the target area in the shooting interface.

In one possible implementation, the display unit is further configured to perform any one of:

In one possible implementation manner, the display unit is further configured to execute a triggering operation of the literacy control in the shooting interface, and display the item information of the target image through the shooting interface.

In a possible implementation manner, the acquiring unit is further configured to execute acquiring the article information of the changed target image in response to the target image of the shooting range being changed;

the display unit is further configured to display the article information of the changed target image through the shooting interface.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a multimedia data photographing apparatus including:

the receiving unit is configured to execute an article identification request sent by a receiving terminal, wherein the article identification request carries a target image acquired by the terminal through a shooting interface;

the identification unit is configured to identify the target image in response to the item identification request, and obtain item information contained in the target image;

an acquisition unit configured to perform acquisition of at least one template information indicating a template matching the item information;

a transmitting unit configured to perform transmitting the at least one template information to the terminal.

In a possible implementation manner, the obtaining unit is configured to determine at least one template tag matching the item information according to the template tag of each template, and obtain at least one template information corresponding to the at least one template tag.

In a possible implementation manner, the obtaining unit is configured to perform obtaining of a template identifier and a corresponding thumbnail of at least one template matching with the item information.

In a possible implementation manner, the receiving unit is further configured to execute receiving a template obtaining request sent by the terminal, where the template obtaining request carries target template information selected by the terminal;

the sending unit is further configured to perform sending the target template to the terminal.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a terminal, including:

one or more processors;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the multimedia data photographing method.

According to a sixth aspect of embodiments of the present disclosure, there is provided a server including:

one or more processors;

a memory for storing the processor-executable instructions;

According to a seventh aspect of the embodiments of the present disclosure, there is provided a storage medium having instructions that, when executed by a processor of a terminal/server, enable the terminal/server to perform the above-described multimedia data photographing method.

According to an eighth aspect of the embodiments of the present disclosure, there is provided an application program product storing one or more instructions executable by a processor of a terminal/server to perform the above-mentioned multimedia data photographing method.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a schematic diagram illustrating an implementation environment of a multimedia data photographing method according to an exemplary embodiment;

FIG. 2 is a flow chart illustrating a method of multimedia data capture according to an exemplary embodiment;

FIG. 3 is a flow chart illustrating a method of multimedia data capture according to an exemplary embodiment;

FIG. 4 is a flow chart illustrating a method of capturing multimedia data according to an exemplary embodiment;

FIG. 5 is an interface diagram illustrating a capture interface in accordance with an exemplary embodiment;

FIG. 6 is a diagram illustrating an interface displaying first prompt information, according to an exemplary embodiment;

FIG. 7 is a diagram illustrating an interface displaying template information in accordance with an illustrative embodiment;

FIG. 8 is a schematic illustration of an interface showing third prompt information, according to an exemplary embodiment;

FIG. 9 is a diagram illustrating an interface displaying a fourth prompt message in accordance with an illustrative embodiment;

FIG. 10 is a schematic illustration of an interface displaying item information, according to an exemplary embodiment;

FIG. 11 is a block diagram illustrating a multimedia data capture device according to an exemplary embodiment;

FIG. 12 is a block diagram illustrating a multimedia data capture device according to an exemplary embodiment;

fig. 13 is a block diagram illustrating a terminal 1300 in accordance with an example embodiment;

fig. 14 is a block diagram illustrating a server 1400 in accordance with an example embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the disclosure, as detailed in the appended claims.

The user information to which the present disclosure relates may be information authorized by the user or sufficiently authorized by each party.

Fig. 1 is a schematic diagram of an implementation environment of a multimedia data photographing method according to an exemplary embodiment, and referring to fig. 1, the implementation environment includes: a terminal 101 and a server 102.

The terminal 101 may be at least one of a smart phone, a smart watch, a portable computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts Group Audio Layer IV, motion Picture Experts Group Audio Layer 4), an MP4 player, a laptop computer, and the like. Optionally, the terminal 101 and the server 102 communicate through a wired network or a wireless network, which is not limited by the present disclosure. The visual interface of the terminal 101 comprises a template display control, a user triggers the template display control, the terminal 101 responds to the triggering operation of the user, sends a template information acquisition request to the server 102, receives the template information returned by the server 102, and displays the acquired template information through the visual interface, so that the user can browse the template information displayed on the visual interface and select a proper template from the template information. The terminal 101 transmits a template acquisition request to the server 102 based on the selected template information in response to a selection operation by the user, receives a template returned by the server 102, and further performs photographing of multimedia data based on the received template.

The terminal 101 may be generally referred to as one of a plurality of terminals, and the embodiment is only illustrated by the terminal 101. Those skilled in the art will appreciate that the number of terminals described above may be greater or fewer. For example, the number of the terminals may be only a few, or the number of the terminals may be several tens or hundreds, or more, and the number of the terminals and the type of the device are not limited in the embodiments of the present disclosure.

The server 102 may be at least one of a server, a plurality of servers, a cloud server, a cloud computing platform, and a virtualization center. Alternatively, the server 102 and the terminal 101 communicate through a wired network or a wireless network, which is not limited by the present disclosure. Server 102 has associated therewith a template database for storing a plurality of templates and corresponding template information. The server 102 receives a template information acquisition request sent by the terminal 101, acquires a plurality of template information from a template database, and further sends the acquired template information to the terminal 101. The server 102 receives the template acquisition request of the terminal 101, acquires a corresponding template from the template database, and further sends the acquired template to the terminal 101. Optionally, the number of the servers may be more or less, and the embodiment of the disclosure does not limit this. Of course, the server 102 may also include other functional servers to provide more comprehensive and diverse services.

Fig. 2 is a flowchart illustrating a multimedia data photographing method according to an exemplary embodiment, and referring to fig. 2, specific steps include:

in step S201, the terminal acquires a target image of a shooting range through a shooting interface.

In step S202, the terminal obtains at least one template information according to the item information included in the target image, where the template information is used to indicate a template matching the item information.

In step S203, the terminal displays the at least one template information through the shooting interface.

In step S204, the terminal performs shooting based on the selected target template information of the at least one template information, to obtain multimedia data including the target template.

determining at least one template matching the item information;

template information of the at least one template is obtained.

and receiving the at least one template information returned by the server.

and receiving the target template returned by the server.

displaying a first thumbnail of the plurality of thumbnails in the target area;

Fig. 3 is a flowchart illustrating a multimedia data photographing method according to an exemplary embodiment, and referring to fig. 3, the specific steps include:

in step S301, the server receives an item identification request sent by the terminal, where the item identification request carries a target image collected by the terminal through a shooting interface.

In step S302, the server identifies the target image in response to the item identification request, and obtains item information included in the target image.

In step S303, the server acquires at least one template information indicating a template matching the item information.

In step S304, the server transmits the at least one template information to the terminal.

According to the scheme provided by the embodiment of the disclosure, when an article identification request of a terminal is received, article information contained in a target image carried by the article identification request is identified, and template information matched with the article information is obtained, because the target image is an image to be shot by a user, the article information contained in the target image can reflect data content to be shot by the user, and templates corresponding to the template information are related to the article information, and the template information is sent to the terminal, the user only needs to select from the template information displayed by the terminal, and then multimedia data is shot based on the selected target template information, so that the number of the templates to be browsed by the user is greatly reduced, the user does not need to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

In a possible implementation manner, the obtaining at least one template information includes:

and sending the target template to the terminal.

Fig. 4 is a flowchart illustrating a multimedia data photographing method according to an exemplary embodiment, referring to fig. 4, the method including:

in step S401, the terminal acquires a target image of a shooting range through a shooting interface.

The shooting interface is a display interface corresponding to the shooting function of the terminal, or the shooting interface is a display interface of a client with the shooting function, and the shooting interface is used for providing multiple functions of shooting, beautifying, music, template display and the like, not only can shooting through the shooting interface, but also can beautify images, add music to multimedia data or display templates and the like. The target image in the shooting range, namely the picture image which is automatically collected by the camera assembly when the terminal displays the shooting interface, does not need a user to trigger the shooting control, and can be automatically collected when the terminal detects that the current display interface is the shooting interface.

In a possible implementation manner, a user opens a shooting function of a terminal or a client with the shooting function, the terminal responds to the operation of the user and displays a shooting interface, the shooting interface comprises an intelligent shooting control, the intelligent shooting control is an intelligent shooting function inlet, the user triggers the intelligent shooting control, and the terminal responds to the triggering operation of the user on the intelligent shooting control and collects a target image in a shooting range through the shooting interface. Referring to fig. 5, fig. 5 is an interface schematic diagram of a shooting interface according to an exemplary embodiment, an intelligent shooting control is arranged at an upper right corner of the shooting interface, and a user can enable an intelligent shooting function by triggering the intelligent shooting control, so that the terminal can obtain a target image by itself and obtain information of an article contained in the target image.

In another possible implementation manner, the shooting interface is configured with an intelligent shooting function by default, a user opens the shooting function of the terminal or a client with the shooting function, and the terminal responds to the operation of the user, displays the shooting interface, calls the intelligent shooting function, and collects a target image in a shooting range.

It should be noted that, when the user triggers the intelligent shooting control or enters a shooting interface configured with an intelligent shooting function by default, the intelligent shooting control in the shooting interface is displayed in a successful check state, the user triggers the intelligent shooting control displayed in the successful check state, the terminal responds to the triggering operation of the user, exits the intelligent shooting function, and refreshes the display of the shooting interface, and at this time, the intelligent shooting control in the shooting interface is displayed in an unselected state.

In step S402, the terminal sends an item identification request to the server, where the item identification request carries the target image, and the item identification request is used to instruct the server to identify item information included in the target image and to obtain template information of at least one template matching the item information.

It should be noted that the server is used for storing multimedia data, such as pictures, videos, etc., captured by the terminal. The server is also associated with a template database, a plurality of template tags are stored in the template database, and a plurality of templates and thumbnails corresponding to the templates are stored in the template tags correspondingly, so that the server can acquire the templates corresponding to the template tags and the thumbnails corresponding to the templates according to a certain template tag.

Wherein the template tag is used to indicate the type of template, the type of elements included in the template, and the like. For example, the template label is a flower, that is, the template is a template related to a flower, or a flower element exists in a template corresponding to the template label.

The method comprises the steps of sending an article identification request to a server so that the server can obtain a target image to be identified, identifying the obtained target image and realizing template recommendation based on the target image.

In step S403, the server receives the item identification request transmitted from the terminal.

In step S404, the server identifies the target image in response to the item identification request, and obtains item information included in the target image.

It should be noted that the item information includes an item name and item interpretation information, and optionally, the item information includes other contents, which is not limited in this disclosure. The article information can represent the type of the article and explain the related information of the article.

In a possible implementation manner, the server inputs the target image into an article identification model, and identifies the target image through the article identification model to obtain article information contained in the target image.

The image recognition model is obtained by pre-training based on the following training process:

the method comprises the steps that a server obtains a plurality of sample images and sample article information contained in each sample image, the server inputs the sample images into an initial model one by one, the sample images are identified through the initial model to obtain the article information contained in the sample images, then the loss function value of the initial model is determined according to the sample article information contained in the obtained sample images and the article information contained in the sample images obtained through model identification, parameters of the initial model are adjusted through a gradient descent method according to the loss function value, processing similar to the process is continuously carried out on the next sample image until the adjusted initial model meets preset conditions, and then the initial model meeting the preset conditions is used as a trained image identification model.

Optionally, the item identification model is any type of model, such as a neural network model. Taking the article identification model as a neural network model as an example, the article identification model comprises a convolutional layer, a sampling layer and a classifier. The server extracts the convolution characteristic of the target image through the convolution layer of the article identification model, extracts the sampling characteristic of the convolution characteristic through the sampling layer of the article identification model, and obtains the article information contained in the target image according to the sampling characteristic through the classifier of the article identification model.

For an article identification model comprising a convolutional layer, a sampling layer and a classifier, the training process of the image identification model is as follows: the server inputs the acquired sample images into the initial model one by one, extracts the sample convolution characteristics of the sample images through the convolution layer of the initial model, extracting sample sampling characteristics of the sample convolution characteristics through a sampling layer of the initial model, and obtaining the sample convolution characteristics through a classifier of the initial model, obtaining the article information contained in the sample image according to the sample sampling feature, further determining a loss function value of the initial model according to the sample article information contained in the obtained sample image and the article information contained in the sample image obtained by model identification, and according to the loss function value, by a gradient descent method, and adjusting the parameters of the initial model, and continuing to process the next sample image in the same way as the process until the adjusted initial model meets the preset conditions, and taking the initial model meeting the preset conditions as a trained image recognition model.

The preset condition may be that the accuracy of the prediction result meets an iteration cutoff condition, that the loss function value meets the iteration cutoff condition, and that the number of iterations reaches the preset number, and the embodiment of the present disclosure does not limit which condition is specifically adopted as the preset condition.

It should be noted that the above is only an exemplary method for identifying the item information included in the target image, and in a more possible implementation manner, other manners are adopted to identify the item information in the target image, which is not limited in the embodiment of the present disclosure.

In step S405, the server obtains at least one template information indicating a template matching the item information.

In a possible implementation manner, the server determines at least one template tag matched with the article information according to the template tag of each template, and obtains at least one template information corresponding to the at least one template tag. The template tag of each template can represent the type of each template, elements included in each template and the like, so that the template tag most similar to the identified article information can be determined through matching of the article information and the template tag, the template matched with the article information can be obtained, and the determination of the template to be recommended is realized.

The at least one template information includes at least one template identifier and a corresponding thumbnail, and optionally, the template information includes other contents, such as a publisher of the template, a publishing time of the template, a template type, and the like, which is not limited in this disclosure. Because one template identifier corresponds to one template and the thumbnail of each template can embody the elements included in the template and has small data volume, the corresponding template is determined according to the template identifier by acquiring the template identifier, and the style of each template is displayed through the thumbnail by acquiring the thumbnail.

Optionally, the server determines a plurality of template information matched with the item information, and then sorts the plurality of template information.

In a possible implementation manner, the server sorts the template information corresponding to each template tag according to the matching degree of each template tag and the article information and the sequence from high matching degree to low matching degree.

When determining the sequence of each template information, the server stores the acquired template information in a form of a table, stores the template information corresponding to the template label with the highest matching degree in a first row of the table according to the matching degree of each template label and the article information, stores the template information corresponding to the template label with the second matching degree in a second row of the table, and so on, so that the terminal determines the display sequence of each template information according to the storage position. Optionally, other ways are used to store the template information, which is not limited in this disclosure.

In step S406, the server transmits the at least one template information to the terminal.

Optionally, in the process from step S402 to step S406, the terminal displays, through the shooting interface, first prompt information, where the first prompt information is used to prompt that the target image is being recognized. Through the first prompt information, the user is prompted based on the identified progress, so that the user can obtain the identified progress in time, and the user experience is improved.

The first prompt message comprises a prompt special effect and text prompt contents. Referring to fig. 6, fig. 6 is a schematic diagram of an interface displaying first prompt information according to an exemplary embodiment, where a terminal displays a special effect of "point and point" and a prompt "aim at a target and automatically recognize. By displaying the special effect and the prompt words, the atmosphere sense during target image recognition can be improved, and the user experience is further improved.

In step S407, the terminal receives the at least one template information returned by the server.

It should be noted that, the process from step S402 to step S408 is described by taking as an example that at least one template information matched with the item information included in the target image is obtained through interaction between the terminal and the server, and in a more possible implementation manner, after the terminal acquires the target image, the terminal performs item identification on the target image by itself to obtain the item information included in the target image. The target image is the image corresponding to the shooting range and can represent the content to be shot by the user, so that the object information identified based on the target image can represent the object contained in the content to be shot by the user, the template information matched with the object information is obtained, the template recommendation based on the content to be shot by the user can be realized, and the template recommendation efficiency is improved. The terminal selects at least one template corresponding to the template tag matched with the article information according to the template tag of each template based on the identified article information, and obtains the template information of the at least one template. The template label of each template can represent the characteristics of each template, so that the template label most similar to the identified article information is determined through matching the article information and the template label, that is, the template information matched with the article information can be obtained, the template recommendation is realized, and the recommendation accuracy is improved.

In step S408, the terminal displays the at least one template information through the photographing interface.

It should be noted that, in step S405, if the server determines the arrangement order of the plurality of template information, the server may send the plurality of template information to the terminal according to the arrangement order, and the terminal may not only receive the plurality of template information, but also determine the arrangement order of the plurality of template information, and then may display the plurality of template information according to the arrangement order.

In a possible implementation manner, the terminal determines the arrangement order of each template information according to the storage position of each received template information in the table, determines the arrangement order of the template information stored in the first row of the table as 1, determines the arrangement order of the template information stored in the second row of the table as 2, and so on, and determines the arrangement order of each template information.

In a possible implementation manner, each template information includes thumbnails, and the thumbnails are sequentially displayed in the target area in the shooting interface according to an arrangement order of the template information, that is, an arrangement order of the thumbnails. Different thumbnails are displayed in the target area in a rotating mode, so that a user can conveniently select a needed thumbnail, the situation that a plurality of thumbnails are displayed simultaneously to occupy too much display space can be avoided, interface display elements are simplified, and the situation that the user is disturbed due to too much content is prevented from being displayed.

In another possible implementation manner, a plurality of thumbnails arranged in sequence are displayed through the shooting interface, and one of the thumbnails is located in the target area. The thumbnails are displayed according to the arrangement sequence, so that a user can conveniently select a required thumbnail, one of the thumbnails is located in the target area, a highlighted effect is achieved, and the user can be prompted to select the thumbnail in the target area. For example, the terminal displays a first thumbnail of the plurality of thumbnails in the target area, and displays thumbnails of the plurality of thumbnails other than the first thumbnail in areas other than the target area. Referring to fig. 7, fig. 7 is an interface schematic diagram showing template information according to an exemplary embodiment, where a terminal displays thumbnails corresponding to default recommended templates, that is, the first thumbnail, in a target area of the shooting interface, and thumbnails corresponding to other templates are arranged in a row at the right side of the shooting control for a user to view. The thumbnail with the highest matching degree with the item information is preferentially displayed in the target area according to the arrangement sequence, so that a user can see the thumbnail with the highest matching degree first, and the thumbnail with the highest matching degree is preferentially displayed because the thumbnail with the highest matching degree is the thumbnail which is most probably selected by the user, so that the recommendation efficiency can be improved, the selection of the user is facilitated, and the user experience is improved.

The terminal displays a first thumbnail in a target area, and simultaneously sends a template obtaining request to the server, wherein the template obtaining request carries a template identifier corresponding to the first thumbnail, the server responds to the received template obtaining request, obtains a template corresponding to the first thumbnail, and then sends the obtained template to the terminal, and the terminal displays the template in a shooting interface based on the received template. The template corresponding to the first thumbnail is obtained, so that a user can visually see the display effect of the template, user experience is improved, the template corresponding to the first thumbnail is most matched with the article information in the target image, the probability of the user adopting the template is the largest, and the template is obtained in advance, so that the template does not need to be obtained again when the user determines to use the template, interaction times between the terminal and the server are reduced, and processing pressure of the terminal and the server is reduced.

The above process is described by taking the example of displaying the thumbnails through the shooting interface, and in more possible implementation manners, the terminal displays the template identifier and the corresponding thumbnail together according to the arrangement sequence of the template information through the shooting interface. By displaying the template information with the highest matching degree with the article information in the target area according to the arrangement sequence, the template information of the template with the highest matching degree with the article information can be preferentially displayed, so that a user can directly see the template information with the highest matching degree, the recommendation efficiency is improved, and the user experience is improved.

The user can change the thumbnail displayed in the target area by performing a slide operation on a plurality of thumbnails or a selection operation on any of the thumbnails. In one possible implementation manner, the user performs a sliding operation on the plurality of thumbnails, and the terminal adjusts the display positions of the plurality of thumbnails according to the sliding direction indicated by the sliding operation in response to the sliding operation on the plurality of thumbnails, wherein the thumbnails displayed in the target area are changed. In another possible implementation manner, the user selects any thumbnail of a plurality of thumbnails displayed on the right side of the target area, and the terminal displays the selected thumbnail in the target area in response to the selection operation of any thumbnail of the plurality of thumbnails. The thumbnail displayed in the target area can be changed by sliding or selecting, the thumbnail displayed in the target area is replaced, and the user can conveniently select the thumbnail displayed in the target area subsequently.

Optionally, when the terminal displays at least one template information, displaying second prompt information through the shooting interface, where the second prompt information is used to prompt that the template matched with the article information is identified. And prompting the user based on the progress of the recognized result through the second prompt information so that the user can obtain the recognition progress in time and the user experience is improved. Referring to fig. 7, the terminal displays a prompt "identify [ flower ] in the photographing interface shown in fig. 7, and recommends the following play" so that the user knows that the result has been currently identified.

It should be noted that the terminal displays the prompt "re-identifiable by clicking the screen" through the shooting interface shown in fig. 6, so that the user can re-identify when the identified item information does not meet the requirements of the user or when the user changes the shooting content. In addition, it can be seen from a comparison between fig. 5 and fig. 7 that when the smart shooting function is turned on, the beautification function entry and the music function entry are moved down, so that the beautification and music function entry is displayed while the recommended template information is displayed, so that the user can select the beautification and music function entry, and the user experience is improved.

In a possible implementation manner, the user triggers a blank area on the screen, the terminal re-acquires the target image in the shooting range in response to a triggering operation of the user on the blank area in the shooting interface, and then performs the above steps S401 to S408 to obtain template information matched with the item information included in the re-acquired target image, where the blank area refers to an area in the shooting interface that does not include a control. The re-identification function is set for the blank area of the shooting interface, so that when a user wants to replace multimedia data to be shot, the blank area is triggered, the template matched with the article information contained in the newly-collected target image is obtained again, the user does not need to browse in a large number of templates, and the operation efficiency is improved.

In another possible implementation manner, the shooting interface further includes a re-identification control, the user triggers the re-identification control, the terminal re-acquires the target image in the shooting range in response to a triggering operation on the re-identification control, and further performs the above steps S401 to S408 to acquire the template information matched with the item information included in the re-acquired target image. The re-recognition control is arranged on the shooting interface, so that when a user wants to replace shooting contents, the template matched with the article information contained in the newly acquired target image is obtained again through the re-recognition control, the user does not need to browse a large number of templates, and the operation efficiency is improved.

Through the steps S402 to S408, the terminal can acquire the template information matched with the article information in the target image, and then recommend the acquired template information to the user, so that personalized recommendation based on the content to be shot by the user is realized, and the user experience is improved.

Optionally, if the target image in the captured shooting range does not contain an article, the server sends an article identification failure prompt to the terminal after identifying the target image, where the article identification failure prompt is used to indicate that article information is not identified in the target image, and the terminal displays, in response to the received article identification failure prompt, third prompt information through the shooting interface, where the third prompt information is used to prompt that article information is not identified in the target image. Referring to fig. 8, fig. 8 is a schematic diagram of an interface for displaying third prompt information according to an exemplary embodiment, where the terminal displays a prompt "do not identify the result, try to shoot other items" in the shooting interface, so that the user determines the shooting range again to acquire the target image. Or, if the terminal does not receive any information returned by the server within the first preset time length, the terminal displays fourth prompt information in the shooting interface, and the fourth prompt information is used for prompting that the network state is not good. Referring to fig. 9, fig. 9 is a schematic diagram of an interface displaying a fourth prompt message according to an exemplary embodiment, where the terminal displays the prompt "network problem, identification failure" through the shooting interface, so that the user can check the network status of the terminal in time.

It should be noted that the shooting interface further includes an object recognition control, and the terminal displays the object recognition control in an area other than the target area in the shooting interface. Referring to fig. 7, the terminal displays the literacy control in the area located on the right side of the target area. Through setting up the literacy controlling part at the shooting interface to when the user wants to know the article information that the target image contains, through this literacy controlling part, come to show article information, improve operating efficiency, and then improve user experience. The user can start the object recognizing function by displaying the object recognizing control in the target area, so that the user can know the object information contained in the target image.

In one possible implementation manner, a user performs sliding operation on a region except for a target region in the shooting interface, and the terminal displays the literacy control in the target region in response to the sliding operation on the region except for the target region in the shooting interface.

In another possible implementation manner, the user directly selects the literacy control, and the terminal responds to the selection operation of the literacy control in the shooting interface and displays the literacy control in the target area.

Through sliding the literacy controlling part to the target area, or selecting the literacy controlling part, the terminal can open the literacy function based on the triggering operation of the user, and then provides the display of article information for the user, so that the user knows the article information contained in the target image, the operation efficiency is improved, and the user experience is improved.

In step S409, the terminal responds to the operation of selecting any one of the at least one piece of template information, and sends a template acquisition request to the server, where the template acquisition request carries the selected target template information.

In a possible implementation manner, the terminal responds to the trigger operation on the target area, determines the template corresponding to the thumbnail currently displayed in the target area as the target template, and sends a template acquisition request to the server based on the target template.

In a possible implementation manner, the target area is an area where the shooting control is located, the user performs a trigger operation on the target area, which is equivalent to performing a trigger operation on the shooting control, and when the user performs the trigger operation on the target area, the user selects the target template and starts a process of shooting the multimedia data. The method can automatically acquire the template corresponding to the thumbnail currently displayed in the target area only by executing one triggering operation on the target area by a user, and simultaneously starts shooting without executing the operations of selecting the template and starting shooting by the user respectively, thereby simplifying the user operation, saving the operation time and improving the operation efficiency.

It should be noted that, in step S408, if the terminal simultaneously displays the template identifier and the corresponding thumbnail in the target area, the terminal may send a template obtaining request to the server in response to a selection operation on any one of the template identifier and the thumbnail.

In another embodiment, if the terminal displays the object recognizing control in the target area in step S408, the user performs a triggering operation on the target area, that is, performs a triggering operation on the object recognizing control, and the terminal displays the article information of the target image through the shooting interface in response to the triggering operation on the object recognizing control by the user. Through triggering the object recognizing control, the terminal can display the object information, so that a user can know the object information contained in the target image, the operation efficiency is improved, and the user experience is improved. Referring to fig. 10, fig. 10 is a schematic diagram illustrating an interface for displaying item information according to an exemplary embodiment, in which a terminal displays identified item information, that is, displays an item name "tulip" and interpretation information related to the tulip, so that a user can know related information of an item in a target image.

It should be noted that, after the user triggers the object recognition control, the terminal starts to recognize the acquired target image in real time, the terminal acquires the target image in the shooting range in real time and detects the acquired target image, if it is detected that the acquired target image changes, the terminal responds to the change of the target image in the shooting range to acquire the article information of the changed target image, and the article information of the changed target image is displayed through the shooting interface. When the target image within the shooting range changes, the object information of the newly acquired target image is acquired again, and then the new object information is displayed, so that the automatic refreshing of the recognition result is realized, the operation efficiency is improved, and the user experience is improved.

Optionally, the terminal periodically acquires the target image within the shooting range every preset time, where the preset time is any value, and the embodiment of the disclosure does not limit this.

The object information contained in the target image can be acquired in real time or periodically by acquiring the picture image of the shooting range in real time or periodically, and if the framing picture in the shooting range is stable and unchanged, the object information displayed by the terminal cannot be changed; if the framing picture in the shooting range is switched to other articles, the article information displayed by the terminal can be automatically refreshed, so that the real-time performance and accuracy of the recognition result are guaranteed, and the user experience is improved.

In step S410, the server receives the template acquisition request sent by the terminal.

In step S411, the server acquires the target template corresponding to the target template information in response to the template acquisition request.

In a possible implementation manner, the server responds to target template information carried by the received template acquisition request, that is, a target template identifier, and acquires a target template corresponding to the target template identifier from the template database.

In step S412, the server transmits the target template to the terminal.

The target template information can uniquely identify the selected target template, and the target template selected by the user can be conveniently acquired by sending a template acquisition request carrying the target template information to the server. In the method, the server only needs to return the selected target template to the terminal, and all recommended templates do not need to be returned, so that the transmitted data volume is reduced, and the network resources are saved.

In step S413, the terminal performs shooting based on the target template, and obtains multimedia data including the target template.

It should be noted that the target template includes elements, such as picture elements, text elements, and the like, which are matched with the item information, and optionally, the target template includes other contents, which is not limited in this disclosure.

The picture elements are leaves, flowers, animals and the like, and are used for forming the frame of the target template. The text elements are characters in a target template, such as colloquial language, poetry and singer, celebrity, and the like.

In a possible implementation manner, the terminal acquires an image within a shooting range through the camera assembly to obtain shot multimedia data, and then synthesizes the target template and the shot multimedia data to obtain the multimedia data comprising the target template. The selected target template is applied to the shot multimedia data by synthesizing the target template and the multimedia data, so that the display effect of the multimedia data is improved.

The multimedia data comprise videos, pictures and the like, the multimedia data comprising the target template comprise picture elements, text elements and the like matched with the object information identified in the target image, personalized shooting based on user shooting content is achieved, and user experience is improved.

Optionally, after receiving the target template, the terminal displays the target template through the shooting interface, so that the user can visually see the shooting effect of each frame of picture image.

It should be noted that the scheme provided by the embodiment of the present disclosure can be applied to various fields, such as a live broadcast field, a short video field, and the like. By taking the application of the embodiment of the disclosure in the field of short videos as an example, the scheme provided by the embodiment of the disclosure utilizes a scanning and object-identifying technology and combines short video shooting to provide a function of displaying article information and recommending templates for a user, innovatively exploits the tool capability of a short video camera, provides additional value for the user, recommends the templates matched with the shot content for the user by utilizing unique creative interaction in the industry, and improves the creation experience of video producers.

According to the scheme provided by the embodiment of the disclosure, the object information contained in the target image collected in the shooting interface is identified, the template information matched with the object information is obtained, the templates corresponding to the template information are related to the object information, the template information is displayed, a user only needs to select from the displayed template information, the multimedia data can be shot based on the selected target template information, the user does not need to browse a large number of templates, the number of the templates needing to be browsed by the user is greatly reduced, the operation is simple, and the operation efficiency is improved. Through the scheme provided by the embodiment of the disclosure, when a user discovers a novel article, the user can identify the novel article through the article identifying control under the intelligent shooting function, the article information of the novel article is obtained, the curiosity and exploratory requirements of the user are met, the template can be recommended in a targeted manner aiming at the currently identified article, the camera shooting, the object identifying scanning and the intelligent recommendation algorithm are fully combined, the personalized recommendation based on the shooting content of the user is realized, the personalized perception is given to the user, the authoring cost of the user is also reduced, and the inspiration and the convenient authoring experience are provided for the user.

Fig. 11 is a block diagram illustrating a multimedia data photographing apparatus according to an exemplary embodiment, referring to fig. 11, the apparatus including:

an acquisition unit 1101 configured to perform acquisition of a target image of a shooting range through a shooting interface;

an obtaining unit 1102 configured to perform obtaining at least one template information indicating a template matching the item information, according to the item information included in the target image;

a display unit 1103 configured to perform displaying the at least one template information through the photographing interface;

a shooting unit 1104 configured to perform shooting based on the selected object template information of the at least one template information, resulting in multimedia data including an object template.

The device provided by the disclosure identifies the object information contained in the target image collected in the shooting interface, and acquires the template information matched with the object information, the templates corresponding to the template information are related to the object information, and the template information is displayed, so that a user only needs to select from the displayed template information, the multimedia data can be shot based on the selected target template information, the user does not need to browse a large number of templates, the number of the templates needing to be browsed by the user is greatly reduced, the operation is simple, and the operation efficiency is improved.

In one possible implementation, the obtaining unit 1102 includes an identifying subunit, a determining subunit, and an obtaining subunit;

In a possible implementation manner, the obtaining unit 1102 includes a sending subunit and a receiving subunit;

In one possible implementation, the apparatus further includes:

the display unit 1103 is configured to perform display of a plurality of thumbnails sequentially in an arrangement order of the thumbnails in a target area in the shooting interface.

the display unit 1103 is configured to display a plurality of thumbnails arranged in order through the shooting interface, with one of the thumbnails located in the target area.

In one possible implementation, the display unit 1103 is configured to display a first thumbnail of the plurality of thumbnails in the target area, and display thumbnails of the plurality of thumbnails other than the first thumbnail in areas other than the target area.

In one possible implementation, the apparatus further includes:

the display unit 1103 is further configured to perform displaying of the selected thumbnail in the target area in response to a selection operation of any one of the plurality of thumbnails.

In one possible implementation, the capturing unit 1104 includes a determining subunit and a capturing subunit;

In a possible implementation manner, the display unit 1103 is further configured to execute displaying, through the shooting interface, first prompt information for prompting that the target image is being recognized.

In a possible implementation manner, the display unit 1103 is further configured to execute displaying, through the shooting interface, second prompt information for prompting that a template matching the item information is identified.

the acquisition unit 1101 is further configured to perform reacquisition of the target image of the shooting range in response to a trigger operation on the re-recognition control.

In a possible implementation manner, the acquiring unit 1101 is further configured to execute a triggering operation on a blank area in the shooting interface, where the blank area refers to an area in the shooting interface that does not include a control, and reacquire the target image of the shooting range.

In a possible implementation manner, the display unit 1103 is further configured to execute displaying a literacy control in a region other than the target region in the shooting interface.

In one possible implementation, the display unit 1103 is further configured to perform any one of:

In a possible implementation manner, the display unit 1103 is further configured to perform, in response to a trigger operation on the knowledge control in the shooting interface, displaying the item information of the target image through the shooting interface.

In a possible implementation manner, the obtaining unit 1102 is further configured to perform, in response to a change in the target image of the shooting range, obtaining item information of the changed target image;

the display unit 1103 is further configured to display the item information of the changed target image through the shooting interface.

Fig. 12 is a block diagram illustrating a multimedia data photographing apparatus according to an exemplary embodiment, referring to fig. 12, the apparatus including:

a receiving unit 1201 configured to execute an article identification request sent by a receiving terminal, where the article identification request carries a target image acquired by the terminal through a shooting interface;

an identifying unit 1202 configured to perform identifying the target image in response to the item identification request, resulting in item information contained in the target image;

an obtaining unit 1203 configured to perform obtaining at least one template information, the template information indicating a template matching the item information;

a transmitting unit 1204 configured to perform transmitting the at least one template information to the terminal.

According to the device provided by the embodiment of the disclosure, when an article identification request of a terminal is received, article information contained in a target image carried by the article identification request is identified, and template information matched with the article information is obtained, because the target image is an image to be shot by a user, the article information contained in the target image can reflect data content to be shot by the user, and templates corresponding to the template information are related to the article information, and the template information is sent to the terminal, the user only needs to select from the template information displayed by the terminal, and then multimedia data is shot based on the selected target template information, so that the number of the templates to be browsed by the user is greatly reduced, the user does not need to browse a large number of templates, the operation is simple, and the operation efficiency is improved.

In a possible implementation manner, the obtaining unit 1203 is configured to determine at least one template tag matching the item information according to the template tag of each template, and obtain at least one template information corresponding to the at least one template tag.

In a possible implementation manner, the obtaining unit 1203 is configured to perform obtaining of a template identifier and a corresponding thumbnail of at least one template matching with the item information.

In a possible implementation manner, the receiving unit 1201 is further configured to execute receiving a template obtaining request sent by the terminal, where the template obtaining request carries target template information selected by the terminal;

the sending unit 1204 is further configured to perform sending the target template to the terminal.

It should be noted that: in the multimedia data shooting device provided in the foregoing embodiment, when shooting multimedia data, only the division of the above function modules is exemplified, and in practical applications, the function distribution may be completed by different function modules according to needs, that is, the internal structure of the terminal/server is divided into different function modules to complete all or part of the above described functions. In addition, the multimedia data shooting device provided by the above embodiment and the multimedia data shooting method embodiment belong to the same concept, and specific implementation processes thereof are detailed in the method embodiment and are not described herein again.

Fig. 13 is a block diagram illustrating an electronic device 1300 in accordance with an example embodiment. The electronic device 1300 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer or a desktop computer. The electronic device 1300 may also be referred to by other names such as user equipment, portable electronic device, laptop electronic device, desktop electronic device, and so forth.

In general, the electronic device 1300 includes: one or more processors 1301 and one or more memories 1302.

Processor 1301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1301 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1301 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also referred to as a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing content that the display screen needs to display. In some embodiments, processor 1301 may further include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

Memory 1302 may include one or more computer-readable storage media, which may be non-transitory. The memory 1302 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 1302 is used to store at least one program code for execution by the processor 1301 to implement the multimedia data capturing method provided by the method embodiments in the present disclosure.

In some embodiments, the electronic device 1300 may further optionally include: a peripheral interface 1303 and at least one peripheral. Processor 1301, memory 1302, and peripheral interface 1303 may be connected by a bus or signal line. Each peripheral device may be connected to the peripheral device interface 1303 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1304, display 1305, camera 1306, audio circuitry 1307, positioning component 1308, and power supply 1309.

Peripheral interface 1303 may be used to connect at least one peripheral associated with I/O (Input/Output) to processor 1301 and memory 1302. In some embodiments, processor 1301, memory 1302, and peripheral interface 1303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1301, the memory 1302, and the peripheral device interface 1303 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The Radio Frequency circuit 1304 is used to receive and transmit RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 1304 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1304 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1304 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 1304 can communicate with other electronic devices via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 1304 may also include NFC (Near Field Communication) related circuits, which are not limited by this disclosure.

The display screen 1305 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1305 is a touch display screen, the display screen 1305 also has the ability to capture touch signals on or over the surface of the display screen 1305. The touch signal may be input to the processor 1301 as a control signal for processing. At this point, the display 1305 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 1305 may be one, providing the front panel of the electronic device 1300; in other embodiments, the display 1305 may be at least two, respectively disposed on different surfaces of the electronic device 1300 or in a folded design; in still other embodiments, the display 1305 may be a flexible display disposed on a curved surface or on a folded surface of the electronic device 1300. Even further, the display 1305 may be arranged in a non-rectangular irregular figure, i.e., a shaped screen. The Display 1305 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or the like.

The camera assembly 1306 is used to capture images or video. Optionally, camera assembly 1306 includes a front camera and a rear camera. Generally, a front camera is disposed on a front panel of an electronic apparatus, and a rear camera is disposed on a rear surface of the electronic apparatus. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1306 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuit 1307 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1301 for processing, or inputting the electric signals to the radio frequency circuit 1304 to achieve voice communication. For stereo capture or noise reduction purposes, multiple microphones may be provided, each at a different location of the electronic device 1300. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 1301 or the radio frequency circuitry 1304 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuit 1307 may also include a headphone jack.

The positioning component 1308 is used to locate a current geographic Location of the electronic device 1300 for navigation or LBS (Location Based Service). The positioning component 1308 can be a positioning component based on the GPS (Global positioning System) of the united states, the beidou System of china, the graves System of russia, or the galileo System of the european union.

The power supply 1309 is used to provide power to various components within the electronic device 1300. The power source 1309 may be alternating current, direct current, disposable or rechargeable. When the power source 1309 comprises a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the electronic device 1300 also includes one or more sensors 1310. The one or more sensors 1310 include, but are not limited to: acceleration sensor 1311, gyro sensor 1312, pressure sensor 1313, fingerprint sensor 1314, optical sensor 1315, and proximity sensor 1316.

The acceleration sensor 1311 may detect the magnitude of acceleration in three coordinate axes of a coordinate system established with the electronic apparatus 1300. For example, the acceleration sensor 1311 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 1301 may control the display screen 1305 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1311. The acceleration sensor 1311 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 1312 may detect the body direction and the rotation angle of the electronic device 1300, and the gyro sensor 1312 may cooperate with the acceleration sensor 1311 to acquire a 3D motion of the user on the electronic device 1300. Processor 1301, based on the data collected by gyroscope sensor 1312, may perform the following functions: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization while shooting, game control, and inertial navigation.

The pressure sensor 1313 may be disposed on a side bezel of the electronic device 1300 and/or underlying the display 1305. When the pressure sensor 1313 is disposed on the side frame of the electronic device 1300, a user's holding signal to the electronic device 1300 may be detected, and the processor 1301 performs left-right hand recognition or shortcut operation according to the holding signal acquired by the pressure sensor 1313. When the pressure sensor 1313 is disposed at a lower layer of the display screen 1305, the processor 1301 controls the operability control on the UI interface according to a pressure operation of the user on the display screen 1305. The operability control comprises at least one of a button control, a scroll bar control, an icon control, and a menu control.

The fingerprint sensor 1314 is used for collecting the fingerprint of the user, and the processor 1301 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 1314, or the fingerprint sensor 1314 identifies the identity of the user according to the collected fingerprint. When the identity of the user is identified as a trusted identity, the processor 1301 authorizes the user to perform relevant sensitive operations, including unlocking a screen, viewing encrypted information, downloading software, paying, changing settings, and the like. The fingerprint sensor 1314 may be disposed on the front, back, or side of the electronic device 1300. When a physical button or vendor Logo is provided on the electronic device 1300, the fingerprint sensor 1314 may be integrated with the physical button or vendor Logo.

The optical sensor 1315 is used to collect ambient light intensity. In one embodiment, the processor 1301 may control the display brightness of the display screen 1305 according to the ambient light intensity collected by the optical sensor 1315. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1305 is increased; when the ambient light intensity is low, the display brightness of the display screen 1305 is reduced. In another embodiment, the processor 1301 can also dynamically adjust the shooting parameters of the camera assembly 1306 according to the ambient light intensity collected by the optical sensor 1315.

The proximity sensor 1316, also known as a distance sensor, is typically disposed on a front panel of the electronic device 1300. The proximity sensor 1316 is used to capture the distance between the user and the front face of the electronic device 1300. In one embodiment, the processor 1301 controls the display 1305 to switch from the bright screen state to the dark screen state when the proximity sensor 1316 detects that the distance between the user and the front face of the electronic device 1300 gradually decreases; the display 1305 is controlled by the processor 1301 to switch from the breath-screen state to the light-screen state when the proximity sensor 1316 detects that the distance between the user and the front surface of the electronic device 1300 is gradually increasing.

Those skilled in the art will appreciate that the configuration shown in fig. 13 is not intended to be limiting of the electronic device 1300 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.

Fig. 14 is a block diagram illustrating a server 1400 according to an exemplary embodiment, where the server 1400 may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 1401 and one or more memories 1402, where at least one program code is stored in the one or more memories 1402, and the at least one program code is loaded and executed by the one or more processors 1401 to implement the multimedia data photographing method provided by the above-described method embodiments. Certainly, the server 1400 may further have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input and output, and the server 1400 may further include other components for implementing the functions of the device, which is not described herein again.

In an exemplary embodiment, there is also provided a storage medium including instructions, for example, a memory 1302 and a memory 1402 including instructions executable by the processor 1301 of the terminal 1300 or the processor 1401 of the server 1400 to perform the multimedia data photographing method described above. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Compact Disc Read-Only Memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.

In an exemplary embodiment, there is also provided an application program product storing one or more instructions executable by processor 1301 of terminal 1300 or processor 1401 of server 1400 to perform the method steps of the multimedia data photographing method provided in the above-described embodiments.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for capturing multimedia data, the method comprising:

acquiring a target image in a shooting range through a shooting interface;

acquiring a plurality of pieces of template information according to the article information contained in the target image, wherein the template information is used for indicating a template matched with the article information, and each piece of template information comprises a thumbnail;

sequentially displaying a plurality of thumbnails in the target area of the shooting interface according to the arrangement sequence of the thumbnails, and displaying other thumbnails except the thumbnail displayed in the target area in the other areas except the target area; the target area is an area where the shooting control is located;

responding to the trigger operation of the target area, and determining a template corresponding to the thumbnail currently displayed in the target area as a target template;

shooting based on the target template to obtain multimedia data comprising the target template;

after displaying, in a region other than the target region, thumbnails of the plurality of thumbnails other than the thumbnail displayed in the target region, the method further includes any of:

in response to a sliding operation on the plurality of thumbnails, adjusting display positions of the plurality of thumbnails according to a sliding direction indicated by the sliding operation, wherein the thumbnails displayed in the target area are changed;

and displaying the selected thumbnail in the target area in response to a selection operation of any one of the plurality of thumbnails.

2. The method of claim 1, wherein the obtaining a plurality of template information according to the article information included in the target image comprises:

carrying out article identification on the target image to obtain article information contained in the target image;

determining a plurality of templates matching the item information;

and acquiring template information of the plurality of templates.

3. The method of claim 2, wherein the determining a plurality of templates matching the item information comprises:

4. The method of claim 1, wherein the obtaining a plurality of template information according to the item information included in the target image comprises:

sending an article identification request to a server, wherein the article identification request carries the target image, and the article identification request is used for indicating the server to identify the article information contained in the target image and acquiring template information of a plurality of templates matched with the article information;

and receiving the plurality of template information returned by the server.

5. The method of claim 4, wherein the receiving the plurality of template information returned by the server comprises:

and receiving a plurality of template identifications and corresponding thumbnails returned by the server.

6. The method of capturing multimedia data according to claim 1, wherein after the plurality of thumbnails are sequentially displayed in an order of arrangement of the plurality of thumbnails in the target area of the capturing interface, the method further comprises:

responding to the selection operation of any template information in the plurality of template information, and sending a template acquisition request to a server, wherein the template acquisition request carries the selected target template information;

and receiving the target template returned by the server.

7. The method of capturing multimedia data according to claim 1, further comprising:

displaying a first thumbnail of the plurality of thumbnails in the target area;

8. The method of claim 1, wherein the capturing based on the target template to obtain the multimedia data including the target template comprises:

9. The method of claim 1, wherein before the obtaining of the plurality of template information according to the item information included in the target image, the method further comprises:

10. The method of claim 1, wherein after acquiring a plurality of template information according to the item information included in the target image, the method further comprises:

11. The method of claim 1, wherein the capture interface further comprises a re-recognition control;

after the plurality of thumbnails are sequentially displayed in the target area of the shooting interface according to the arrangement sequence of the plurality of thumbnails, the method further comprises:

12. The method for shooting multimedia data according to claim 1, wherein the plurality of thumbnails are sequentially displayed in an order of arrangement of the plurality of thumbnails in a target area of the shooting interface, and after other thumbnails than the thumbnail displayed in the target area among the plurality of thumbnails are displayed in areas other than the target area, the method further comprises:

and in response to a triggering operation on a blank area in the shooting interface, re-acquiring the target image of the shooting range, wherein the blank area is an area which does not include a control in the shooting interface.

13. The method of claim 1, wherein after acquiring a plurality of template information according to the item information included in the target image, the method further comprises:

and displaying an object identifying control in the area except the target area in the shooting interface.

14. The method of claim 13, wherein after displaying a literacy control in an area of the shooting interface other than the target area, the method further comprises any one of:

in response to the sliding operation of the area except the target area in the shooting interface, displaying the literary composition control in the target area;

15. The method of claim 14, wherein after displaying a literacy control in an area of the capture interface other than the target area, the method further comprises:

and responding to the triggering operation of the knowledge control in the shooting interface, and displaying the article information of the target image through the shooting interface.

16. The method of claim 15, wherein after displaying the item information of the target image through the capture interface in response to the triggering operation of the literacy control in the capture interface, the method further comprises:

responding to the change of the target image in the shooting range, and acquiring the changed article information of the target image;

and displaying the changed article information of the target image through the shooting interface.

17. A method for capturing multimedia data, the method comprising:

receiving an article identification request sent by a terminal, wherein the article identification request carries a target image of a shooting range acquired by the terminal through a shooting interface;

responding to the article identification request, identifying the target image to obtain article information contained in the target image;

acquiring a plurality of template information, wherein the template information is used for indicating a template matched with the article information, and each template information comprises a thumbnail;

sending the plurality of template information to the terminal;

wherein the terminal is configured to acquire the target image through the shooting interface; acquiring the plurality of template information according to the article information contained in the target image; sequentially displaying a plurality of thumbnails in the target area of the shooting interface according to the arrangement sequence of the thumbnails, and displaying other thumbnails except the thumbnail displayed in the target area in the other areas except the target area; the target area is an area where the shooting control is located; responding to the trigger operation of the target area, and determining a template corresponding to the thumbnail currently displayed in the target area as a target template; shooting based on the target template to obtain multimedia data comprising the target template;

the terminal is further configured to perform any of:

18. The method of claim 17, wherein the obtaining the plurality of template information comprises:

determining a plurality of template labels matched with the article information according to the template label of each template;

and acquiring a plurality of template information corresponding to the plurality of template labels.

19. The method of claim 17, wherein the obtaining the plurality of template information comprises:

and acquiring template identifications of a plurality of templates matched with the article information and corresponding thumbnails.

20. The multimedia data photographing method of claim 17, wherein after the transmitting of the plurality of template information to the terminal, the method further comprises:

and sending the target template to the terminal.

21. A multimedia data photographing apparatus, the apparatus comprising:

an acquisition unit configured to perform acquisition of a plurality of template information indicating templates matching the item information, each template information including a thumbnail, according to the item information contained in the target image;

a display unit configured to sequentially display a plurality of thumbnails in an arrangement order of the thumbnails in a target area of the shooting interface, and display other thumbnails of the plurality of thumbnails except for the thumbnail displayed in the target area in areas other than the target area; the target area is an area where the shooting control is located;

the shooting unit is configured to execute a trigger operation responding to the target area, and determine a template corresponding to the thumbnail currently displayed in the target area as a target template; shooting based on the target template to obtain multimedia data comprising the target template;

an adjustment unit configured to perform adjustment of display positions of the plurality of thumbnails in accordance with a sliding direction indicated by a sliding operation in response to the sliding operation on the plurality of thumbnails, wherein the thumbnails displayed in the target area are changed;

the display unit is further configured to perform displaying of the selected thumbnail in the target area in response to a selection operation of any one of the plurality of thumbnails.

22. The multimedia data photographing device of claim 21, wherein the obtaining unit comprises an identifying subunit, a determining subunit, and an obtaining subunit;

the determining subunit configured to perform determining a plurality of templates that match the item information;

the obtaining subunit is configured to perform obtaining template information of the plurality of templates.

23. The multimedia data photographing device of claim 22, wherein the determining subunit is configured to perform selecting a template corresponding to the template tag matching the item information according to the template tag of each template.

24. The multimedia data photographing device of claim 21, wherein the obtaining unit comprises a transmitting subunit and a receiving subunit;

the sending subunit is configured to execute sending, to a server, an item identification request, where the item identification request carries the target image, and the item identification request is used to instruct the server to identify the item information included in the target image and acquire template information of a plurality of templates matching the item information;

the receiving subunit is configured to execute receiving the plurality of template information returned by the server.

25. The device as claimed in claim 24, wherein the receiving subunit is configured to perform receiving the plurality of template identifications and corresponding thumbnails returned by the server.

26. The multimedia data capturing apparatus of claim 21, wherein the apparatus further comprises:

the sending unit is configured to execute a selection operation responding to any template information in the plurality of template information and send a template obtaining request to the server, wherein the template obtaining request carries selected target template information;

a receiving unit configured to execute receiving the target template returned by the server.

27. The multimedia data photographing device of claim 21, wherein the display unit is further configured to perform displaying a first thumbnail of the plurality of thumbnails in the target area; and displaying the thumbnails of the plurality of thumbnails except the first thumbnail in other areas except the target area.

28. The apparatus of claim 21, wherein the capturing subunit is configured to perform a synthesis of the target template with the captured multimedia data, resulting in the multimedia data comprising the target template.

29. The apparatus of claim 21, wherein the display unit is further configured to display a first prompt for prompting that the target image is being recognized through the shooting interface.

30. The multimedia data capturing apparatus of claim 21, wherein the display unit is further configured to perform displaying a second prompt message through the capturing interface, the second prompt message being used to prompt that a template matching the item information is identified.

31. The multimedia data capture device of claim 21 wherein the capture interface further comprises a re-identification control;

32. The apparatus according to claim 21, wherein the capturing unit is further configured to perform re-capturing the target image of the capturing range in response to a trigger operation on a blank area in the capturing interface, the blank area being an area in the capturing interface that does not include a control.

33. The device of claim 21, wherein the display unit is further configured to display a literacy control in a region of the shooting interface other than the target region.

34. The multimedia data capture device of claim 33, wherein the display unit is further configured to perform any of:

displaying the literacy control in the target area in response to the sliding operation of the area except the target area in the shooting interface;

35. The device of claim 34, wherein the display unit is further configured to display the item information of the target image through the capture interface in response to a trigger operation of the literacy control in the capture interface.

36. The apparatus according to claim 35, wherein the acquiring unit is further configured to execute acquiring, in response to a change in the target image of the shooting range, item information of the changed target image;

the display unit is further configured to display the changed article information of the target image through the shooting interface.

37. A multimedia data photographing apparatus, the apparatus comprising:

the system comprises a receiving unit, a processing unit and a display unit, wherein the receiving unit is configured to execute an article identification request sent by a receiving terminal, and the article identification request carries a target image of a shooting range acquired by the terminal through a shooting interface;

the identification unit is configured to identify the target image in response to the item identification request to obtain item information contained in the target image;

an acquisition unit configured to perform acquisition of a plurality of template information indicating templates matching the item information, each template information including a thumbnail;

a transmitting unit configured to perform transmitting the plurality of template information to the terminal;

the terminal is further configured to perform any of:

38. The multimedia data photographing apparatus of claim 37, wherein the obtaining unit is configured to perform determining a plurality of template tags matching the item information according to a template tag of each template; and acquiring a plurality of template information corresponding to the plurality of template labels.

39. The apparatus according to claim 37, wherein said acquisition unit is configured to perform acquisition of template identifications and corresponding thumbnails of a plurality of templates matching said item information.

40. The device of claim 37, wherein the receiving unit is further configured to perform receiving a template obtaining request sent by the terminal, and the template obtaining request carries target template information selected by the terminal;

the sending unit is further configured to execute sending the target template to the terminal.

41. A terminal, characterized in that the terminal comprises:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the multimedia data photographing method according to any of claims 1 to 16.

42. A server, characterized in that the server comprises:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the multimedia data capturing method of any one of claims 17 to 20.

43. A storage medium, characterized in that instructions in the storage medium, when executed by a processor of a terminal or a processor of a server, enable the terminal to perform the multimedia data photographing method according to any one of claims 1 to 16 or enable the server to perform the multimedia data photographing method according to any one of claims 17 to 20.