CN104519267A

CN104519267A - Shooting control method and terminal equipment

Info

Publication number: CN104519267A
Application number: CN201310461631.9A
Authority: CN
Inventors: 杨帆; 徐超劲
Original assignee: Beijing Samsung Telecommunications Technology Research Co Ltd; Samsung Electronics Co Ltd
Current assignee: Beijing Samsung Telecommunications Technology Research Co Ltd; Samsung Electronics Co Ltd
Priority date: 2013-09-30
Filing date: 2013-09-30
Publication date: 2015-04-15
Also published as: CN108989662A

Abstract

The invention provides a shooting control method and terminal equipment. The shooting control method includes saving the correspondence of photographer information and control information in advance; allowing a first camera to collect the photographer information, searching for the correspondence based on the photographer information and acquiring the corresponding control information; according to the control information, performing corresponding control on a second camera during or after shooting. By the use of the shooting control method, the shooting function of the terminal equipment is expanded.

Description

Shooting control method and terminal equipment

Technical Field

The invention relates to the technical field of electronic terminals, in particular to a method for controlling shooting and a terminal device.

Background

The existing hardware of many electronic terminals comprises two or more than two cameras and at least supports the simultaneous opening of the two cameras; however, the application is too single, and only the simple superposition and combination of the photos shot by the two cameras (the front camera and the rear camera) are simply supported, and the advantage of the function of simultaneously opening the two cameras is not fully exerted. Therefore, the existing electronic terminal has less shooting functions and too narrow application scene.

Disclosure of Invention

The invention provides a method for controlling shooting, which can expand the shooting function of terminal equipment aiming at an electronic terminal which is provided with more than two cameras and supports simultaneous opening.

The invention also provides terminal equipment for controlling shooting, which can control shooting.

The technical scheme of the invention is realized as follows:

a method of controlling photographing, comprising:

pre-storing the corresponding relation between the photographer information and the control information;

the first camera collects information of a photographer, searches the corresponding relation according to the information of the photographer and obtains corresponding control information;

and according to the control information, carrying out corresponding control when or after the second camera shoots.

In the above method, the control information includes shooting effect or function information, or preference setting information;

the mode of carrying out corresponding control when the second camera shoots according to the control information comprises the following steps: and calling the shooting effect or function according to the needs of the user or setting the terminal equipment by adopting the preference setting information when the second camera shoots according to the shooting effect or function information or the preference setting information.

Wherein the photographer information includes feature information of a face image of the photographer; the mode that first camera gathered shooter information includes: the method comprises the steps that a first camera acquires a photographer image, identifies a face image of the photographer and acquires feature information of the face image;

or the photographer information includes an expression of the photographer; the mode that first camera gathered shooter information includes: the method comprises the steps that a first camera obtains an image of a photographer and identifies the expression of the photographer;

or, the photographer information includes a motion of the photographer; the mode that first camera gathered shooter information includes: the first camera acquires an image of a photographer and identifies the motion of the photographer.

In the above method, the photographer information includes a face image of the photographer, and the control information includes identification information corresponding to the photographer;

the mode that first camera gathered shooter information includes: the method comprises the steps that a first camera acquires a photographer image and identifies a face image of the photographer;

the mode of carrying out corresponding control after the second camera shoots according to the control information comprises the following steps: and taking the identification information of the photographer as a photographer tag, and storing the photographer tag after shooting.

The photographer tag may be stored in exchangeable image file format EXIF information of an image file captured by the second camera or in a video file captured by the second camera.

The above method may further comprise:

when a user uses application software, acquiring identity information of the user aiming at the application software, matching the identity information with a photographer tag of an image or video file, and if the matching is successful, acquiring the corresponding image or video file; and if the matching is unsuccessful, matching the identity information with the facial image or the identification information of the person in the corresponding relationship, and if the matching is successful, acquiring the image or the video file shot by the user.

Or,

and judging whether the facial image of the identified photographer is matched with the facial image in the corresponding relation or not, and if so, taking the identified facial image or the facial image in the corresponding relation or a related image as an avatar signature and adding the avatar signature into the image or video file.

The above method may further comprise: and retrieving or operating the authority control of the image or video file according to the head portrait signature or the photographer label in the image or video file.

In the above method, the photographer information includes a face image of the photographer, and the control information includes a function authority;

the mode of carrying out corresponding control when the second camera shoots according to the control information comprises the following steps: and according to the function authority, allowing the photographer to use the function within the function authority range when the second camera shoots.

The control information further includes file management function information;

the mode of carrying out corresponding control after the second camera shoots according to the control information further comprises: after the second camera shoots, classifying the shot image or video file according to the shooting person label, and managing the image or video file according to the file management function information; the management includes encryption, concealment, sorting, or lookup operations.

After classifying the shot image or video file according to the facial image after the shooting, the method further comprises the following steps: an album is created from the photographer tags.

The above method may further comprise: setting corresponding relations between different geographic positions and author relation circle information in advance aiming at a photographer tag;

after the photographed image or video file is classified according to the photographer tag after photographing, the method further comprises: and acquiring the geographic position of the shot image or video file, searching corresponding author relationship circle information according to the corresponding relationship, and classifying the shot image or video file respectively according to the author relationship circle information.

The method may further include:

the method comprises the following steps that a first camera identifies at least two facial images of a photographer, and a second camera acquires an image of a current scene as a background;

and pasting and displaying at least two facial images of the photographer on the background when the second camera shoots.

The method may further include:

the second camera acquires image preview of the current scene;

and inputting image description information when the second camera shoots, and importing, dragging or manually inputting the image description information at a preset position of the image preview.

The method may further include:

when a user starts terminal equipment, a first camera identifies a facial image of the user, and judges whether the user corresponding to the facial image can use a camera shooting function or manage an image or video file according to preset; the shooting function includes taking a picture or recording a video.

The method may further include:

the first camera identifies the expression of a photographer, acquires relevant information corresponding to the expression of the photographer according to a preset corresponding relation, and stores the relevant information after the second camera shoots.

A terminal device that controls shooting, comprising:

the storage module is used for storing the corresponding relation between the photographer information and the control information in advance;

the control information acquisition module is used for searching the corresponding relation according to the photographer information acquired by the first camera and acquiring corresponding control information;

and the control module is used for carrying out corresponding control when the second camera shoots or after shooting according to the control information.

In the terminal device, the control information includes shooting effect or function information or preference setting information;

the mode that the control module carries out corresponding control when the second camera shoots according to the control information comprises: and calling the shooting effect or function according to the needs of the user or setting the terminal equipment by adopting the preference setting information when the second camera shoots according to the shooting effect or function information or the preference setting information.

Or the photographer information includes a face image of the photographer, and the control information includes identification information corresponding to the photographer;

the mode that the control module carries out corresponding control after the second camera shoots according to the control information comprises: and taking the identification information of the photographer as a photographer tag, and storing the photographer tag after shooting.

Or,

the photographer information includes a face image of the photographer, and the control information includes a function authority;

the mode that the control module carries out corresponding control when the second camera shoots according to the control information comprises: and according to the function authority, allowing the photographer to use the function within the function authority range when the second camera shoots.

The control module is further configured to paste and display at least two facial images of the photographer identified by the first camera on an image of the current scene acquired by the second camera when the second camera is used for shooting.

Or receiving image description information when the second camera shoots, and importing, dragging or manually inputting the image description information at a preset position of the current scene image preview acquired by the second camera.

Or when the user starts the terminal equipment, judging whether the user corresponding to the facial image identified by the first camera can use the camera shooting function or manage the image or video file according to the preset; the shooting function includes taking a picture or recording a video.

Or acquiring the expression of the photographer identified by the first camera, acquiring related information corresponding to the expression of the photographer according to a preset corresponding relation, and storing the related information after the second camera shoots.

Therefore, the method for controlling shooting and the terminal device can identify the face, expression or action of a photographer by using face recognition, expression recognition or action (gesture) recognition technology, and execute corresponding functions according to the pre-stored information, thereby expanding the shooting function of the terminal device.

Drawings

Fig. 1 is a flowchart of a method for controlling photographing according to the present invention;

FIG. 2 is a schematic diagram of an application scenario of the present invention;

FIG. 3 is a schematic diagram of the identification technique involved in the present invention;

FIG. 4 is a flowchart of a method for establishing and sharing a face information base according to a first embodiment of the present invention;

FIG. 5 is a diagram illustrating contents of a face information base according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of a display interface of a face information base according to an embodiment of the present invention;

FIG. 7 is a schematic diagram illustrating a manner of adding a photographer tag in a second embodiment of the present invention;

FIG. 8 is a schematic diagram of two ways of adding a photographer tag;

FIG. 9 is a schematic view of a display interface for setting a tag for adding a photographer in a second embodiment of the present invention;

fig. 10 is a schematic diagram of EXIF information added with a photographer tag in the second embodiment of the present invention;

fig. 11 is a schematic view of a display interface for providing a shooting effect selection for an identified face image according to a third embodiment of the present invention;

fig. 12 is a schematic view of a display interface for prohibiting a user from using a recording function according to a fourth embodiment of the present invention;

FIG. 13 is a schematic diagram of a display interface providing a photographer preference setting skip selection according to a fifth embodiment of the present invention;

fig. 14 is a schematic view of a display interface to which photographer state information is added in the seventh embodiment of the present invention;

FIG. 15 is a schematic diagram of a display interface for classifying and encrypting a picture or video file according to shooting according to a ninth embodiment of the present invention;

fig. 16 is a flowchart illustrating a social account being associated with a photographer in a tenth embodiment of the present invention;

FIG. 17 is a schematic diagram of a display interface of a selected work in accordance with an exemplary embodiment of the present invention;

FIG. 18 is a schematic diagram of a display interface for adding avatar signatures in an eleventh embodiment of the present invention;

FIG. 19 is a first schematic view of a display interface for creating a photo album according to a thirteenth embodiment of the present invention;

FIG. 20 is a second schematic view of a display interface for creating a photo album according to a thirteenth embodiment of the present invention;

FIG. 21 is a flowchart of a fourteenth implementation of the present invention;

fig. 22 is a schematic view of a display interface for setting positional information of a photographer in a fourteenth embodiment of the present invention;

FIG. 23 is a diagram of an interface displaying the classification and sorting of works in the fourteenth embodiment of the present invention;

fig. 24 is a schematic structural diagram of a terminal device for controlling shooting according to the present invention.

Detailed Description

The present invention provides a method for controlling shooting, as shown in fig. 1, including:

step 101: pre-storing the corresponding relation between the photographer information and the control information;

step 102: the first camera collects information of a photographer, searches the corresponding relation according to the information of the photographer and obtains corresponding control information;

step 103: and according to the control information, carrying out corresponding control when or after the second camera shoots.

The facial image may be a human face image or other forms of facial images.

The invention relates to the field of electronic terminals, which comprises two or more than two cameras and terminal equipment which at least supports the simultaneous opening of the two cameras on hardware. For the convenience of description of the present invention, the term "two cameras" or "dual camera" is used to replace the term multiple cameras, that is, it should be understood that the application expansion based on the simultaneous opening of multiple cameras (two or more cameras) and the improvement of the shooting effect, etc., all belong to the definition and protection scope of the present invention.

As shown in FIG. 2, the invention is that when a user (201) operates a terminal device (202), the double cameras of the terminal device are simultaneously opened (203), and an application scene (205) of the function which is simultaneously opened by the double cameras is perfected and expanded by utilizing an identification technology (204), an improved shooting effect and the like (206), so that the effect of expanding the shooting function is achieved.

As shown in fig. 3, the identification techniques included in the present invention include: face recognition technology (301), expression recognition technology (302), gesture (motion) recognition technology (303), and the like. The present invention includes, but is not limited to, the above recognition technology, and it should be understood that any expansion of the application scenario of the dual camera by using the recognition technology falls within the scope defined and protected by the present invention.

The following detailed description refers to specific embodiments. First, the expansion of an application scene based on a face recognition technology is described.

In the step 101, the photographer information includes a face image of the photographer, and the control information includes identification information corresponding to the photographer;

in step 102, the manner of acquiring the photographer information by the first camera includes: the method comprises the steps that a first camera acquires a photographer image and identifies a face image of the photographer;

in step 103, according to the control information, the method for performing corresponding control after the second camera shoots includes: and taking the identification information of the photographer as a photographer tag, and storing the photographer tag after shooting.

The photographer tag may be stored in EXIF information of the photographed image file or in the photographed video file.

The first embodiment is as follows:

in the embodiment, a face information base is established by using a face recognition technology and is used for recording photographer information corresponding to works such as photos or videos, namely author information of the works, and the established face information base can also be used for sharing among users.

Fig. 4 is a flowchart of a method for establishing and sharing a face information base according to an embodiment of the present invention. The method comprises the following steps:

the face information base (404) is derived from a work shot by a camera (401) and face information source files such as photos (videos and the like) (402) containing face information stored in a terminal memory, and effective face information is extracted after the files are processed by a face recognition technology (403), so that the face information base is established; further, people corresponding to different face information can be named (405), the names can be real names or nicknames, and the like, and the unnamed face information can be uniformly set to be a certain default name. The thus created face information base is available for searching and sharing (406). For example, for unnamed face information, the face information can be used as a database for multimedia search to perform picture search or video search, and whether the face information base stored by the terminal device contains target face information is queried; for named face information, the face information can be directly searched by keywords such as names or nicknames; the face information base in a certain terminal device can be shared with other terminal devices, so that sharing is realized, namely the face information base is used as a data type to be shared or backed up and the like.

Fig. 5 is a schematic content diagram of a face information base according to an embodiment of the present invention. The face information base (504) of the photographer comprises an individual face image file (501), a correspondingly defined name (502) of an expected photographer, and personal privacy information (503) such as mailbox information, IM information and the like selectively added by a user for ensuring the uniqueness of the work (due to the non-uniqueness of the name or the nickname). Fig. 6 is a schematic diagram of an optional display interface of a face information base according to an embodiment of the present invention, and as shown in fig. 6, the face information base may provide a search function, and each face and its corresponding name (e.g., user a, user B) may be presented on the interface, although the interface may display more information in other aspects, which is not shown in the figure.

Example two:

this embodiment describes a manner of adding a tag of a photographer (author) to each photo taken by a terminal device or each video recorded by the terminal device by using a face recognition technology and information such as a face information base established in advance.

Fig. 7 is a schematic diagram illustrating a manner of adding a photographer tag in the second embodiment of the present invention. The method comprises the following steps:

one camera of the terminal equipment is used for detecting a photographer while normal shooting is carried out; the camera collects face information of a person, and facial information of the photographer is extracted at step 701. If valid face information is extracted, at step 702, it is determined whether the extracted face information exists in the face information base of the terminal device. If the current photographer exists in the face information base, searching the name corresponding to the face information of the photographer, and adding the photographed work into the name of the photographer to form an author label; if the name of the contact person is not in the face information base, matching with the contact person photo, if matching is successful, adding the work into a 'photographer' label corresponding to the name of the contact person, and if matching is not successful, defining the 'photographer label' as a 'stranger' or other preset names.

As can be seen from the above process, there are two ways of adding the "photographer tag" (author tag), and fig. 8 is a schematic diagram of two ways of adding the photographer tag, including: 1) adding from a face information base, namely setting a 'photographer tag' as information such as a corresponding face name or a nickname pre-stored in the face information base, wherein the information in the face information base of the photographer can be obtained by identifying a picture containing face information or a picture collected by a camera by using a face identification technology and advancing face information; 2) the "photographer tag" is added from the contact, that is, information such as the name or nickname of the corresponding contact in the contact (phonebook). It can be seen that, in the step 101, the preset correspondence between the face image and the person identifier may be stored in the face information base, or may be stored in the contact (phone book) file.

In order to ensure the uniqueness of the work of the photographer (because the name of a person, the nickname and the like are not unique, namely the work is in a duplicate name state), the user can selectively add personal privacy information such as mailbox information, IM information and the like into the work, and when the work is shared or uploaded, the user can be prompted whether to share or upload the privacy information together. The first addition mode is 'adding from a face information base', and the personal privacy information can be stored in advance when a user establishes the face information base; the second addition method "add from contact", and these private information may also be stored in the contact address book in advance.

Fig. 9 is a schematic view of a display interface for setting a photographer tag according to a second embodiment of the present invention. As shown in fig. 9, a state of "photographer tag" may be set in the terminal device setting, that is, the photographer tag may be selectively turned on or off, when the function of "photographer tag" is turned on, the terminal device may detect and add the current photographer information, and other setting information shown in fig. 9 is optional information for the present embodiment, and is not listed one by one again.

In addition, the present embodiment may add a "photographer tag" to Exchangeable Image File format (EXIF) information of an Image File. The EXIF information is a group of shooting parameters embedded in a JPEG/TIFF image file format and mainly comprises information such as an aperture, a shutter, ISO, time, equipment model, focal length, recorded sound during shooting, GPS and the like; identifiers between the character strings 0xFFE0 — 0 xfffef that are not utilized by the conventional JPEG file are called "application markers", and EXIF is just to record shooting parameters using these information strings; various shooting information is written according to the definition of the identifier fields of the EXIF standard; the photos can be managed according to the EXIF information, such as quickly finding a specific photo, for example: all pictures with exposure times of more than 2 seconds are searched. Fig. 10 is a schematic diagram of EXIF information added with a photographer tag in the second embodiment of the present invention, where the EXIF information shown in fig. 10 includes information that the photographer is "user a", and in actual application, other information is selectable as needed.

The above first and second embodiments describe specific examples of creating a face information base and adding photographer information to an image or video file. The invention can also expand the functions in or after the shooting of the picture or the video, and the function expansion in the shooting process is described in the third embodiment to the eighth embodiment, and the function expansion after the shooting is described in the ninth embodiment to the fourteenth embodiment. Wherein, the function expansion in shooting refers to: if the picture is taken, the picture is in the state of a picture preview frame before a picture taking key is not pressed, and if the picture is recorded, the picture is in the state of recording before a recording key is pressed; in this case, a group of application forms based on simultaneous opening of dual photographing. The function expansion after shooting means: works (photos, videos, etc.) have been completed, and a set of application forms for the operation and use of the works, etc.

Example three:

in this embodiment, after the face image of the photographer is recognized, a corresponding shooting effect or function guidance is provided for the features of the face image.

In this embodiment, the correspondence between the feature information of the face image and the shooting effect or function may be stored in advance;

identifying a facial image of a photographer, acquiring feature information of the facial image, searching the corresponding relation according to the feature information of the facial image, and recommending a shooting effect or guiding a function;

and calling the shooting effect or function according to the requirement of the user during shooting.

For example, the face recognition technology is used to estimate the sex (information such as approximate age) of the photographer and recommend the photographing effect and photographing function guide related to the sex; if the front camera judges that the current photographer is a young woman, the user is recommended to open a 'beautiful muscle mode' and the like, and if the current photographer is an old person, the user is guided, and if the user can be prompted to enlarge a function key icon and the like so as to facilitate the operation of the user.

Fig. 11 is a schematic view of a display interface for providing a shooting effect selection for an identified face image in the third embodiment of the present invention, where the interface schematic view is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. Providing a capture effect selection for the recognized face image, a "mode" button as in fig. 11 may be displayed, and prompt information may be displayed to the user, which may be, for example: clicking on "mode" may select more photographing effects to tighten up the trial bar.

Example four:

in the present embodiment, the function authority of the terminal device is set for different photographers.

In this embodiment, in step 101, the photographer information includes a face image of the photographer, and the control information includes a function right;

in step 103, according to the control information, the method for performing corresponding control when the second camera shoots includes: and according to the function authority, allowing the photographer to use the function within the function authority range when the second camera shoots.

In the embodiment, the face recognition technology is utilized to obtain the information of the photographer, and different camera operation authorities can be set for different photographers in advance; for example, the locking or automatic hiding processing can be performed on a photographing function, a recording function, or one or some functions of the camera, such as a flash lamp, a continuous shooting mode and the like, and only a specially-authorized photographer can normally complete the operation; for example, the application scenario may be that a child of a family member may mistakenly operate and start the recording mode when using the device, which not only consumes power, but also the recorded video occupies a lot of storage space.

Fig. 12 is a schematic view of a display interface for prohibiting a user from using a recording function in the fourth embodiment of the present invention, where the schematic view of the interface is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. As shown in fig. 12, the left image represents a face image in which the camera recognizes the photographer; the right image shows that the photographer is prohibited from starting the video recording function and is allowed to start the photographing function according to the operation authority of different photographer stored in advance.

Example five:

the present embodiment sets the skip preference configuration: saving and skipping preference settings of terminal equipment for different photographers by using a face recognition technology; recording the setting of the user when the user uses the equipment for the first time, and prompting the user whether to skip the personalized equipment setting stored in advance when the user uses the equipment again, so that the equipment is more intelligent; such as whether the GPS tag is turned on, whether the camera is muted, etc. (preferably, configurations that are independent of the photographing environment, i.e., configurations that do not need to be changed as the photographing environment changes).

Specifically, in this embodiment, in the step 101, the control information includes preference setting information;

in step 103, according to the control information, the method for performing corresponding control when the second camera shoots includes: according to preference setting information, when the second camera shoots, the preference setting information is adopted to set the terminal equipment according to the needs of the user

Fig. 13 is a schematic view of a display interface for providing photographer preference setting skip selection in the fifth embodiment of the present invention, where the interface schematic view is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. As shown in fig. 13, the user may choose to jump directly to the user's preference settings by clicking the "ok" button in the dialog box popped up by the interface without manually configuring the terminal device, or may refuse to jump directly to the user's preference settings by clicking the "cancel" button in the dialog box popped up by the interface.

Example six:

in this embodiment, a picture taken by the rear camera may be used as the self-portrait background board. The method comprises the following steps: identifying a face image of a photographer, and acquiring an image of a current scene as a background; and pasting and displaying the face image of the photographer on the background during shooting.

Specifically, when a user uses the front camera to carry out self-shooting, the rear camera is also in an open state; when a user continuously takes a group of self-timer pictures, the rear camera also takes pictures at the same time; the pictures shot by the rear camera are used as a background, and the pictures shot by the front camera are combined and arranged on the background for displaying.

Example seven:

the present embodiment may record image description information describing a photographer state in a preset area of an image. The method comprises the following steps: acquiring image preview of a current scene; when shooting, inputting image description information, and importing, dragging or manually inputting the image description information at a preset position of the image preview.

Fig. 14 is a schematic view of a display interface to which photographer state information is added in the seventh embodiment of the present invention, where the schematic view of the interface is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. As shown in fig. 14, a "editable text area" is preset in a preview box of the terminal device, and after the area is clicked, the types of weather (the current weather can be obtained through a weather application), mood, time, and personal logo are popped up; clicking on one of the types pops up a candidate, such as "mood" and pops up an "happy! "," true heart is depressed! "and so on the literal information or with the corresponding expression picture to replace, then choose to drag to the editable text area; or according to the expression of the user detected by the front camera, mood content is automatically filled, and after the user takes a photo, a photo printed with personalized information can be formed.

Example eight:

the embodiment can realize the authority management of multi-account login by using the facial recognition technology. The method specifically comprises the following steps: when a user starts the terminal equipment, the facial image of the user is identified, and whether the user corresponding to the facial image can use the camera shooting function or manage the image or video file is judged according to the preset. The shooting function is to shoot a picture or record a video.

The above embodiments describe the extension of functions during picture or video taking. The following describes the extension of functions after picture or video capture.

Example nine:

the embodiment can classify, encrypt and hide the works by utilizing the face recognition technology. In this embodiment, the control information in step 101 may further include file management function information;

in step 103, according to the control information, the method of performing corresponding control after the second camera shoots may further include: after the second camera shoots, classifying the shot image or video file according to the shooting person label, and managing the image or video file according to the file management function information; the management includes encryption, concealment, sorting, or lookup operations.

Specifically, the face recognition technology is utilized to obtain the information of the photographer, and the files such as the pictures or the videos shot by the photographer are automatically classified or are encrypted or hidden individually according to different photographers, so that the manageability and the safety of the files such as the pictures or the videos are improved.

Fig. 15 is a schematic view of a display interface for classifying a picture or a video file according to shooting in the ninth embodiment of the present invention, where the schematic view of the interface is an optional schematic view, and in practical applications, various interfaces capable of embodying graphical information may be selected. In the schematic diagram, works shot by different photographers are classified into respective albums, and some works shot by the photographers can be set to be encrypted, hidden, sorted or searched.

Example ten:

according to the embodiment, the association between the social account in the social application software and the works of the photographer can be realized, the information such as the account or the head portrait of the photographer, such as the social application and the chat software, is associated with the works shot by the photographer, and further, the operation and the management of the works of the user can be facilitated.

Specifically, when the user uses the application software, the identity information of the user aiming at the application software can be obtained, the identity information is adopted to be matched with the photographer information of the image or video file, and if the matching is successful, the corresponding image or video file is obtained; and if the matching is unsuccessful, matching the identity information with the face image or the identification information of the person in the corresponding relationship, and if the matching is successful, acquiring the image or the video file shot by the user. The identity information can be information such as account number, head portrait and the like. The photographer information can be a photographer tag, information in a face information base, information in a contact person, and the like. The identification information of the person may be a name, a nickname, a mailbox, IM information, etc. that can identify the user.

Fig. 16 is a flowchart illustrating a social account being associated with a photographer according to a tenth embodiment of the present invention. As shown in fig. 16, the user runs the social application software, clicks the option of "select from my works", matches the social account number with the "photographer tag", and if matching is successful, directly jumps to the corresponding album; if the matching is not successful, matching the social account head portrait with a face information base (the face information base is understood to be the face information base and the information in the contact person, which are described above, in a broad sense), and if the matching is successful, jumping to a corresponding photo album; and if the matching is not successful, matching the social account with information such as a mailbox, an IM (instant messaging) and the like in the contact person, and if the matching is successful, directly jumping to a corresponding photo album.

Fig. 17 is a schematic view of a display interface of a selected work in the tenth embodiment of the present invention, where the schematic view of the interface is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. After the work shot by the photographer is associated with the social account, the user can click the option of "select from my work" to select a desired photo, which is convenient for the user to operate, and of course, as shown in fig. 17, the user can also select functions of "take a picture", "select from a mobile phone album", "cancel", and the like.

Example eleven:

the present embodiment can take the face image of the photographer as a photo signature of his work. May include the steps of: identifying the face image of the photographer, judging whether the identified face image is matched with the face image in the corresponding relation stored in advance, and if so, taking the identified face image or the face image in the corresponding relation or the related image as an avatar signature and adding the avatar signature into the image or video file. If the matching is not successful, the front-facing camera immediately shoots, automatically selects a face image with clear user as an avatar signature and adds the face image or the face image into the image or the video file.

Specifically, when a user shoots, the two cameras are simultaneously started, and the front camera detects a face image of the current user; if the detected face image is a face image which is stored in a face information base or a contact person in advance, after the shooting of the shooting person is finished, corresponding head portrait information of the shooting person can be added, or other images similar to cartoons can be used for replacing the head portrait in order to protect the privacy of the head portrait of the shooting person, so that the head portrait serves as a 'photo signature'. This "photo signature" can be divided into two ways of addition: one is a static preset mode, namely, the works of the photographer are directly added into the photo information of the head portrait of the photographer or the face information base; the other is a dynamic putting mode, namely when a photographer finishes shooting a work, the front-facing camera immediately shoots and automatically selects a human face image which is clear for the user to be used as a photo signature of the work. The application form increases the shooting commemorative significance of the photos and protects the works of the user from being embezzled by other people. For "photo signature" of a video, a picture of a certain frame of the video taken, such as the first frame, may be added with the "photo signature" of the video photographer as the "photo signature" of the video.

Fig. 18 is a schematic view of a display interface for adding an avatar signature to a shot photo in the eleventh embodiment of the present invention, where the schematic view of the interface is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. As shown in fig. 18, the user adds his avatar signature (or called photo signature) to the lower right corner of the photo for the photo he takes.

Example twelve:

this embodiment introduces an application for work signatures or tags. In this embodiment, the image or video file may be retrieved or operation authority controlled according to the avatar signature or the photographer tag in the image or video file.

According to the above description, the work may have two ways of "signing", one is "overt signature", i.e., "photo signature" as described in example eleven, and the other is "invisible signature", i.e., "photographer tag" information contained in EXIF information in the work. The following illustrates two application modes of work signatures:

first, a work is available for searching: a "signed" work that can be easily retrieved locally or over a network (e.g., a social networking site); the 'explicitly signed' work is retrieved, which means that the photo containing the head portrait signature can be used as an 'index' for retrieval, namely, the head portrait of a photographer is taken as a reference standard picture for photo or video search, and then the head portrait can be used for searching the work containing the head portrait signature; the work which is subjected to the invisible signature is retrieved, and the work which contains the keyword of the photographer label is directly searched; both ways can improve the speed and accuracy of picture or video search.

Second, work operation authority management: the user can set the operation authority of the works after the 'signature'; if the work has an explicit signature, namely a photo signature, when the work is deleted, a front-facing camera can be used for judging a current user, and if the work is not a photographer of the photo, the work cannot be directly deleted; this increases the security of management of files such as photos or videos.

Example thirteen:

the present embodiment describes a manner of creating an album using a photographer tag. If the works shot by the user are classified into different albums according to the 'photographer tags', the target album can be directly selected 'from the designated photographer to add' when the story album is created, and convenience is brought to the user. Based on the original photo GPS information, time information and the like, the information dimension of the photo is increased by adding the label information of a photographer, namely an author, so that the interestingness, the manageability and the like of diary applications such as a story album (StoryAlbum) and the like and tourism applications such as S Travel and the like are improved.

Fig. 19 and 20 are schematic diagrams of display interfaces for creating an album according to a thirteenth embodiment of the present invention, where the schematic diagrams are optional schematic diagrams, and in practical applications, various interfaces capable of embodying illustrated information may be selected.

Example fourteen:

the embodiment introduces a way of classifying the works shot by the photographer at different places respectively to form different 'relationship circles', and can preset the corresponding relationship between different geographic positions and author relationship circle information for the facial image; after the shot image or video file is classified according to the facial image after shooting, the geographic position of the shot image or video file is further obtained, corresponding author relationship circle information is searched according to the corresponding relationship, and the shot image or video file is classified respectively according to the author relationship circle information.

As shown in fig. 21, which is a flowchart for implementing the fourteenth embodiment of the present invention, the geographical location information of the daily activity place of the photographer is preset, whether the photographed work contains predefined location information is determined, and if yes, the author relationship circle album is automatically categorized and sorted according to "intimacy". The "intimacy" refers to the frequency of occurrence of a certain person in each "relationship circle" photograph.

Fig. 22 is a schematic view of a display interface for setting photographer position information in the fourteenth embodiment of the present invention, where the schematic view of the interface is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. Geographical location information of the photographer's home, company, friend gathering place, and the like may be set in advance. The works shot by the photographer are automatically classified into a corresponding "family circle", "coworker circle", "close friend circle", and the like, based on the GPS information. Furthermore, according to the occurrence frequency of the characters in the relationship circle, the works can be sorted according to the 'intimacy degree'; people with higher intimacy are circled in the photos for display, so that the interestingness of photo sharing is enhanced; for example, by sorting the number of persons b in a photograph taken by a person a, the relationship between the person a and the person b can be estimated, and the estimated relationship can be displayed in the photograph.

Fig. 23 is a schematic view of an interface display for classifying and sorting works in the fourteenth embodiment of the present invention, where the interface schematic view is an optional schematic view, and in practical application, various interfaces capable of embodying graphical information may be selected. The 'intimacy' is sequenced according to the frequency of the appearance of the characters in the works, the relationship between the photographer and the photo character is judged and displayed when the intimacy is higher, the figure illustrates that the relationship between the character and the photographer is 'close friend', and the relationship can be edited by the user in a user-defined way.

The above describes a specific embodiment in which the face recognition technology is used to extend the shooting function. The above is merely an example illustrating the application of simultaneous opening of two cameras by using the face recognition technology, and the present invention includes and is not limited to the above example, and it should be understood that all cases of simultaneously opening application extensions for two cameras by using the face recognition technology are within the scope of the definition and protection of the present invention.

An embodiment of function expansion using an expression recognition technique and a gesture (motion) recognition technique is described below.

Example fifteen:

this embodiment describes an example of function expansion using expression recognition technology.

In this embodiment, the photographer information in step 101 may be an expression of the photographer, and the control information may include shooting effect or function information or preference setting information;

in step 103, according to the control information, the method for performing corresponding control when the second camera shoots includes: and calling the shooting effect or function according to the needs of the user or setting the terminal equipment by adopting the preference setting information when the second camera shoots according to the shooting effect or function information or the preference setting information.

Specifically, the expression recognition technology can be utilized in the embodiment to analyze the expression of a photographer, namely an author, when the photographer shoots a photo or a video, and further the mood of the current user can be added to the work; or, by using the expression recognition technology, the photos or videos can be classified according to the expressions of the photographer during shooting or shooting; or recommending the corresponding photographing effect and the like according to the expression of the photographer by using the expression recognition technology.

The above is merely an example illustrating the application being simultaneously opened for two cameras by using the expression recognition technology, and the present invention includes and is not limited to the above example, and it should be understood that the application extension being simultaneously opened for two cameras by using the expression recognition technology is within the scope of the definition and protection of the present invention.

Example sixteen:

this embodiment describes an example of function extension using gesture (motion) recognition technology.

In this embodiment, the photographer information in step 101 may be the motion of the photographer, and the control information may include shooting effect or function information, or preference setting information;

Specifically, the present embodiment may utilize a gesture (motion) recognition technology to presume the intention of a photographer, i.e., an author, of a gesture (motion) when taking a picture or a video, and then the terminal makes a feedback; by utilizing a gesture (action) recognition technology, according to different gestures of a user, the terminal completes corresponding actions such as shooting, and the like, and if the actions are similar to 'blink shooting'; and (3) popping up corresponding buttons such as Setting or Menu and the like by the terminal according to different gestures of the user by utilizing a gesture (action) recognition technology.

The above is merely an example illustrating the application simultaneously opened by the gesture (motion) recognition technology for the two cameras, the present invention includes and is not limited to the above example, and it should be understood that the application extension simultaneously opened by the gesture (motion) recognition technology for the two cameras is within the scope defined and protected by the present invention.

The present invention further provides a terminal device for controlling shooting, as shown in fig. 24, which is a schematic structural diagram of the terminal device, and includes:

a saving module 2401, configured to pre-save a correspondence between photographer information and control information;

the control information acquisition module 2402 is configured to search the corresponding relationship according to the photographer information acquired by the first camera, and acquire corresponding control information;

and the control module 2403 is configured to perform corresponding control during or after shooting by the second camera according to the control information.

the manner of the control module 2403 performing corresponding control when the second camera shoots according to the control information includes: and calling the shooting effect or function according to the needs of the user or setting the terminal equipment by adopting the preference setting information when the second camera shoots according to the shooting effect or function information or the preference setting information.

the mode that the control module 2403 performs corresponding control after shooting by the second camera according to the control information includes: and taking the identification information of the photographer as a photographer tag, and storing the photographer tag after shooting.

Or, the photographer information includes a face image of the photographer, and the control information includes a function authority;

the manner of the control module 2403 performing corresponding control when the second camera shoots according to the control information includes: and according to the function authority, allowing the photographer to use the function within the function authority range when the second camera shoots.

In the terminal device described above, the terminal device,

the control module 2403 is further configured to, when the second camera captures the image, paste and display at least two facial images of the photographer identified by the first camera on the image of the current scene acquired by the second camera.

Or, the control module 2403 is further configured to receive image description information when the second camera shoots, and import, drag, or manually input the image description information at a preset position of the current scene image preview acquired by the second camera.

Or, the control module 2403 is further configured to, when the user starts the terminal device, determine, according to a preset setting, whether the user corresponding to the facial image identified by the first camera can use a camera shooting function or manage an image or video file; the shooting function includes taking a picture or recording a video.

Or, the control module 2403 is further configured to obtain the expression of the photographer identified by the first camera, obtain relevant information corresponding to the expression of the photographer according to a preset correspondence, and store the relevant information after the second camera takes a picture.

In summary, the method for controlling shooting and the terminal device provided by the invention add a brand new label, namely a photographer (author), to the file of the shot photo or video or the like or improve the shooting effect by using the technology of simultaneously starting and identifying the two cameras, particularly the face identification technology, so as to expand the shooting function. The photographer tag can be written into the EXIF information, and the content of the EXIF information is enriched. The invention is based on the simultaneous opening of the two cameras during or after the shooting of the picture or the video file, and carries out abundant extension on the application form, such as improving the shooting effect, managing the shot works and the like. Under the condition that the traditional single-camera shooting is not influenced, the expression and the gesture (action) of a photographer during shooting can be additionally acquired, and certain operation is finished or the information is recorded according to the acquired related information.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. A method of controlling photographing, the method comprising:

2. The method according to claim 1, wherein the control information includes photographing effect or function information, or preference setting information;

3. The method according to claim 2, wherein the photographer information includes feature information of a photographer face image; the mode that first camera gathered shooter information includes: the method comprises the steps that a first camera acquires a photographer image, identifies a face image of the photographer and acquires feature information of the face image;

4. The method according to claim 1, wherein the photographer information includes a face image of the photographer, and the control information includes identification information corresponding to the photographer;

the mode of carrying out corresponding control after the second camera shoots according to the control information comprises the following steps: and taking the identification information corresponding to the photographer as a photographer tag, and storing the photographer tag after shooting.

5. The method of claim 4, wherein the photographer tag is stored in exchangeable image file format EXIF information of an image file captured by the second camera or a video file captured by the second camera.

6. The method of claim 4, further comprising:

7. The method of claim 4, further comprising:

8. The method of claim 7, further comprising:

and retrieving or operating the authority control of the image or video file according to the head portrait signature or the photographer label in the image or video file.

9. The method according to claim 1, wherein the photographer information includes a face image of the photographer, and the control information includes a function authority;

10. The method of claim 4, wherein the control information further includes file management function information;

11. The method of claim 10, wherein after classifying the captured image or video file according to the facial image after the capturing, further comprising: an album is created from the photographer tags.

12. The method of claim 10, further comprising: setting corresponding relations between different geographic positions and author relation circle information in advance aiming at a photographer tag;

13. The method of any one of claims 1 to 12, further comprising:

14. The method of any one of claims 1 to 12, further comprising:

the second camera acquires image preview of the current scene;

15. The method of any one of claims 1 to 12, further comprising:

16. The method of any one of claims 1 to 12, further comprising:

17. A terminal device that controls shooting, characterized in that the terminal device comprises:

18. The terminal device according to claim 17, wherein the control information includes photographing effect or function information, or preference setting information;

19. The terminal device according to claim 17, wherein the photographer information includes a face image of the photographer, and the control information includes identification information corresponding to the photographer;

20. The terminal device according to claim 17, wherein the photographer information includes a face image of a photographer, and the control information includes a function authority;

21. The terminal device according to any of claims 17 to 20,

the control module is further used for pasting and displaying at least two facial images of the photographer identified by the first camera on the image of the current scene acquired by the second camera when the second camera shoots.

22. The terminal device according to any of claims 17 to 20,

the control module is further configured to receive image description information when the second camera shoots, and import, drag or manually input the image description information to a preset position of the current scene image preview acquired by the second camera.

23. The terminal device according to any of claims 17 to 20,

the control module is also used for judging whether a user corresponding to the facial image identified by the first camera can use a camera shooting function or manage an image or a video file according to the preset condition when the user starts the terminal equipment; the shooting function includes taking a picture or recording a video.

24. The terminal device according to any of claims 17 to 20,

the control module is further used for acquiring the expression of the photographer identified by the first camera, acquiring related information corresponding to the expression of the photographer according to a preset corresponding relation, and storing the related information after the second camera shoots.