WO2021135601A1

WO2021135601A1 - Auxiliary photographing method and apparatus, terminal device, and storage medium

Info

Publication number: WO2021135601A1
Application number: PCT/CN2020/125204
Authority: WO
Inventors: 杨建业
Original assignee: 华为技术有限公司
Priority date: 2019-12-31
Filing date: 2020-10-30
Publication date: 2021-07-08
Also published as: CN113132618B; CN113132618A

Abstract

The present application is applicable to the technical field of terminals, and in particular, relates to an auxiliary photographing method and apparatus for an artificial intelligence (AI) terminal, a terminal device, and a computer-readable storage medium. The auxiliary photographing method comprises: acquiring an original image and recognizing a target feature of a photographing object and a scene feature of the scene where the photographing object is located in the original image; acquiring a posture image according to the target feature of the photographing object and the scene feature of the scene where the photographing object is located, the posture image comprising a target posture to be recommended; superimposing the posture image and the original image to display as a preview image, so as to guide the photographing object to perform posture adjustment according to the target posture in the preview image, such that the photographing object can be quickly guided to adjust the posture according to the target posture in the preview image, thus improving the posture adjustment efficiency and improving the photographing efficiency, thereby effectively improving the image photographing effect and user experience.

Description

Auxiliary photographing method, device, terminal equipment and storage medium

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office on December 31, 2019, the application number is 201911423536.3, and the application name is "assisted photographing method, device, terminal equipment and storage medium", the entire content of which is by reference Incorporated in this application.

Technical field

This application belongs to the technical field of terminal technology, and in particular relates to an artificial intelligence (AI) terminal assisted photographing method, device, terminal device, and computer-readable storage medium.

Background technique

With the continuous development of camera technology and the widespread popularity of terminal equipment, the camera function of terminal equipment is widely used. More and more users use mobile phones, tablet computers and other terminal equipment to take pictures, which greatly improves the convenience and convenience of taking pictures. Sex. However, many people who are not good at taking pictures often do not know how to pose when taking pictures, which leads to stiff and old-fashioned images and affects the shooting effect.

Summary of the invention

The embodiments of the present application provide an auxiliary photographing method, a device, a terminal device, and a computer-readable storage medium, which can quickly guide a photographed subject to adjust the posture and improve the photographing effect of an image.

In the first aspect, an embodiment of the present application provides an auxiliary photographing method, including:

Acquiring an original image, and identifying the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;

Acquiring a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, where the posture image contains the target posture to be recommended;

The posture image and the original image are superimposed and displayed as a preview image, so as to guide the photographic subject to perform posture adjustment according to the target posture in the preview image.

For example, the original image may be the first frame preview image previewed in the display interface, or may also be the Nth frame preview image after the first frame previewed in the display interface. For example, the original image may be the first frame image captured by the camera in real time, or it may be the Nth frame image after the first frame captured by the camera in real time, where N is an integer greater than 1.

It should be understood that after acquiring the original image, the original image may be recognized by artificial intelligence recognition technology first to determine whether there is a photographed object in the original image. If there is a photographed object in the original image, the target feature of the photographed object and the scene characteristic of the scene where the photographed object is located can be further identified. Among them, the target characteristics of the photographed object may include one or more of the number of photographed objects, gender, age, height, body type, and the like.

For example, a TOF depth camera set by a terminal device can be used to obtain target features such as the height and body shape of the subject. For example, a face recognition model set in the terminal device can be used to recognize target characteristics such as the number, gender, and age of the subject in the original image. For example, the scene characteristics of the scene where the shooting object in the original image is located can be obtained through a scene recognition model set in the terminal device.

In a possible implementation manner, the superimposing and displaying the posture image and the original image as a preview image may include:

A layer mask is added to the posture image, and the posture image with the added layer mask and the original image are superimposed and displayed as the preview image, and the position corresponding to the target posture in the layer mask is set to White, the position in the layer mask except the target pose is set to black.

It should be noted that the posture image superimposed on the original image can be a binary mask of the same size as the original image, and each pixel in the binary mask corresponds to each pixel in the original image one-to-one. . For example, the pixel value of the pixel corresponding to the target posture in the binary mask is 1 (that is, the pixel corresponding to the target posture in the binary mask is white), and the pixel value of the pixel other than the target posture in the binary mask is The pixel value is 0 (that is, pixels other than the target posture in the binary mask are black), and the target posture in the posture image is merged into the current photographing scene to guide the subject to adjust the posture.

Specifically, after the posture image is obtained, a layer mask can be added to the posture image, where the position corresponding to the target posture in the layer mask (that is, the pixel corresponding to the target posture) can be set to white, and the layer The position of the mask other than the target pose (that is, the pixel points other than the target pose) can be set to black to obtain the binary mask corresponding to the pose image, and the pose image with the layer mask (that is, the pose The binary mask of the image) and the original image are superimposed and displayed as a preview image, that is, the target posture in the posture image is superimposed on the original image to obtain a preview image, and the obtained preview image can be displayed on the display interface. This guides the subject to make posture adjustments.

In another possible implementation manner, the superimposing and displaying the posture image and the original image as a preview image may include:

Segmenting the target posture from the posture image;

The target posture is superimposed on the original image, and the original image superimposed on the target posture is displayed as a preview image.

Specifically, the superimposing the target pose on the original image may include:

Acquiring the first position of the target posture in the posture image;

The second position of the target posture in the original image is determined according to the first position, and the target posture is superimposed at the second position of the original image.

It should be understood that in the embodiments of the present application, the image segmentation technology can also be used to segment the target posture from the posture image, and the segmented target posture can be superimposed on the original image, and then the original image superimposed on the target posture can be displayed as Preview image.

For example, the first position of the target posture in the posture image can be determined first, and then according to the correspondence between the pixels in the posture image and the pixels in the original image, the original image and the pixel points in the original image can be found. The target pixel point corresponding to the target posture, so that the second position of the target posture in the original image can be determined according to the target pixel point.

Optionally, the acquiring a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located may include:

Acquiring a photographing feature of the photographing object, where the photographing characteristic is a photographing preference characteristic corresponding to the photographing object;

The posture image is acquired according to the target feature and the photographing feature of the shooting object and the scene feature of the scene where the shooting object is located.

It should be noted that, in the embodiments of the present application, after the subject in the original image is identified, the photographic characteristics of the subject can also be acquired, and the characteristics of the subject can be obtained according to the target characteristics of the subject, the scene characteristics of the scene where the subject is located, and the shooting The photographic features of the subject acquire the posture image. Among them, the photographing feature may be a characteristic of photographing preferences or photographing habits corresponding to the photographed subject.

For example, the photographic characteristics of the photographed object may be obtained according to the identity mark information of the photographed object. For example, the photographing feature corresponding to the terminal device may also be acquired according to the device identification information of the terminal device, and the acquired photographing characteristic corresponding to the terminal device may be determined as the photographing characteristic of the subject.

It should be understood that the photographic characteristics of each photographed object may be obtained by image analysis of the historical photographed images of each photographed object in advance, and the photographed characteristics of each photographed object may be associated and saved with the identity mark information of each photographed object. In the embodiments of this application, it is also possible to perform image analysis on the historical photographed images in each terminal device in advance to obtain the photographing characteristics corresponding to each terminal device, and to compare the photographing characteristics corresponding to each terminal device with the device identification information of each terminal device. Save associatively.

Optionally, the acquiring a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located includes:

Acquiring at least one sample image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located;

Acquiring the recommended value corresponding to the at least one sample image;

A target sample image is selected from the at least one sample image according to the recommended value, and the posture image is acquired according to the target sample image.

It should be noted that when the posture image is acquired according to the target characteristics of the subject and the scene characteristics of the scene where the subject is located, or according to the target characteristics of the subject, the scene characteristics of the scene where the subject is located, and the photographic characteristics of the subject When acquiring the posture image, one or more sample images can be acquired, and the posture image can be acquired according to the acquired sample images. The sample image may be an image collected in advance and stored in a terminal device or stored in a cloud server connected to the terminal device, or it may be an image captured from the network in real time during the photographing process.

It should be understood that when a sample image is obtained, the obtained sample image can be directly determined as a posture image; and when multiple sample images are obtained, one can be selected from the multiple sample images. The target sample image, and the selected target sample image can be determined as a posture image.

Specifically, when multiple sample images are obtained, the recommended value corresponding to each sample image can be obtained first, and then the sample image with the highest recommended value can be selected as the target sample image, and the selected one can be selected as the target sample image. A target sample image is determined as a posture image, and the posture image is recommended through the recommended value, which helps to improve the recommendation accuracy and recommendation efficiency of the posture image.

Optionally, the recommended value corresponding to the sample image may be determined according to the number of historical recommendations of the sample image within a preset time. For example, it can be determined according to the number of historical recommendations of the sample images in the past week. The sample images with more historical recommendations have higher recommended values; the sample images with fewer historical recommendations have corresponding values. The recommended value of is lower.

It should be understood that when multiple sample images are acquired, multiple target sample images can be selected from the multiple sample images, and the selected multiple target sample images can be displayed, so that the photographer or the photographed object can be selected from these multiple sample images. Select the posture image from the target sample images. Here, the target sample image can be selected according to the recommended value corresponding to each sample image, that is, the first N sample images with high recommended value can be selected from the sample images as the target sample image, where N is greater than or equal to 2. Integer.

Specifically, the display order corresponding to each target sample image can be determined according to the recommended value corresponding to each target sample image, wherein the target sample image with the larger recommended value is displayed on the display interface first, and the target sample with the smaller recommended value The image is later displayed on the display interface.

In a possible implementation manner, before the superimposing and displaying the posture image and the original image as a preview image, the method may include:

Acquiring a first image size corresponding to the original image and a second image size corresponding to the posture image;

The second image size corresponding to the posture image is adjusted according to the first image size corresponding to the original image, so as to adjust the second image size corresponding to the posture image to the first image size.

It should be noted that, before the posture image and the original image are superimposed and displayed as a preview image, in order to ensure that the posture image can be superimposed with the original image, the first image size corresponding to the original image and the posture image corresponding to the The second image size, and the second image size corresponding to the posture image can be adjusted according to the first image size, so as to adjust the second image size corresponding to the posture image to the first image size.

Optionally, after the superimposing and displaying the posture image and the original image as a preview image may include:

Acquiring the current posture of the shooting object;

The degree of matching between the current posture and the target posture is determined, and the shooting object is guided to adjust the posture according to the degree of matching.

It should be understood that after the posture image and the original image are superimposed and displayed as a preview image to guide the posture of the subject according to the preview image, the current posture of the subject can also be obtained in real time, and the current posture and the target posture can be determined The degree of matching between the two can guide the subject to adjust the posture according to the degree of matching.

For example, after obtaining the matching degree between the current posture and the target posture, the matching degree can also be displayed on the display interface in real time, so that the subject and/or the photographer can clearly understand the photographing posture and posture image of the subject The specific fit of the target posture.

It should be noted that after obtaining the matching degree between the current posture and the target posture, if the matching degree is less than the preset threshold, posture comparison can be performed to find the difference between the current posture and the target posture Position, so that the subject can be prompted to adjust the posture according to the distinguished position. For example, the subject may be prompted to adjust the posture through voice playback and/or the subject may be prompted to adjust the posture through text display.

In the second aspect, an embodiment of the present application provides an auxiliary photographing device, including:

The target feature recognition module is used to obtain the original image, and recognize the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;

A posture image acquisition module, configured to acquire a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, the posture image contains the target posture to be recommended;

The posture image superimposing module is configured to superimpose and display the posture image and the original image as a preview image, so as to guide the subject to perform posture adjustment according to the target posture in the preview image.

In a possible implementation manner, the posture image superimposing module may include:

The first posture image superimposing unit is used to add a layer mask to the posture image, and superimpose and display the posture image with the added layer mask and the original image as the preview image, in the layer mask The position corresponding to the target posture is set to white, and the position other than the target posture in the layer mask is set to black.

In another possible implementation manner, the posture image superimposing module may further include:

A posture image segmentation unit for segmenting the target posture from the posture image;

The second posture image superimposing unit is configured to superimpose the target posture on the original image, and display the original image superimposed on the target posture as a preview image.

Optionally, the second posture image superimposing unit may include:

The first position acquisition subunit is configured to acquire the first position of the target posture in the posture image;

The second position determination subunit is configured to determine the second position of the target posture in the original image according to the first position, and superimpose the target posture on the second position of the original image.

For example, the posture image acquisition module may include:

A photographing feature acquiring unit, configured to acquire a photographing characteristic of the photographing object, where the photographing characteristic is a photographing preference characteristic corresponding to the photographing object;

The first posture image obtaining unit is configured to obtain the posture image according to the target feature and the photographing feature of the shooting object and the scene feature of the scene where the shooting object is located.

Optionally, the posture image acquisition module may include:

A sample image acquisition unit, configured to acquire at least one sample image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located;

A recommended value obtaining unit, configured to obtain a recommended value corresponding to the at least one sample image;

The second posture image obtaining unit is configured to select a target sample image from the at least one sample image according to the recommended value, and obtain the posture image according to the target sample image.

In a possible implementation manner, the auxiliary photographing device may further include:

An image size obtaining module, configured to obtain a first image size corresponding to the original image and a second image size corresponding to the posture image;

The image size adjustment module is configured to adjust the second image size corresponding to the posture image according to the first image size corresponding to the original image, so as to adjust the second image size corresponding to the posture image to the first image size .

Optionally, the auxiliary photographing device may further include:

The current posture acquisition module is used to acquire the current posture of the photographed object;

The current posture matching module is used to determine the degree of matching between the current posture and the target posture, and guide the subject to adjust the posture according to the degree of matching.

In the third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, The auxiliary photographing method according to any one of the above-mentioned first aspects is realized.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium that stores a computer program that, when executed by a processor, implements any one of the above-mentioned aspects of the first aspect The auxiliary method of taking pictures.

In the fifth aspect, the embodiments of the present application provide a computer program product, which when the computer program product runs on a terminal device, causes the terminal device to execute the auxiliary photographing method described in any one of the above-mentioned first aspects.

It is understandable that, for the beneficial effects of the second aspect to the fifth aspect described above, reference may be made to the relevant description in the first aspect described above, and details are not repeated here.

Compared with the prior art, the embodiments of this application have the following beneficial effects:

After obtaining the original image, the embodiment of the present application can identify the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located, and obtain a match with the shooting object by combining the target feature of the shooting object and the scene feature of the scene where the shooting object is located And the posture image of the scene where the shooting object is located can improve the accuracy and effectiveness of the posture image acquisition, so that the obtained posture image meets the photographing requirements of the shooting object and the scene where the shooting object is currently located. In addition, by superimposing the posture image and the original image as a preview image, and by displaying the target posture in the preview image, it is convenient to quickly guide the subject to adjust the posture according to the target posture in the preview image, which improves the efficiency of posture adjustment and the efficiency of taking pictures. , In order to effectively improve the shooting effect of the image and enhance the user experience.

Description of the drawings

Fig. 1 is a schematic diagram of posture image selection in the prior art;

Fig. 2 is a schematic diagram of posture image display in the prior art;

FIG. 3 is a schematic flowchart of an auxiliary photographing method provided by an embodiment of the present application;

4 and 5 are schematic diagrams of starting the auxiliary photographing mode in an embodiment of the present application;

FIG. 6 is a schematic diagram of scene features obtained by a scene recognition model in an embodiment of the present application;

FIG. 7 is a schematic diagram of a preview image provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of a preview image provided by another embodiment of the present application;

FIG. 9 is a schematic structural diagram of an auxiliary photographing device provided by an embodiment of the present application;

Figure 10 is a schematic structural diagram of a terminal device provided by an embodiment of the present application

FIG. 11 is a schematic structural diagram of a mobile phone to which the auxiliary photographing method provided by an embodiment of the present application is applicable.

Detailed ways

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of this application.

It should be understood that when used in the specification and appended claims of this application, the term "comprising" indicates the existence of the described features, wholes, steps, operations, elements and/or components, but does not exclude one or more other The existence or addition of features, wholes, steps, operations, elements, components, and/or collections thereof.

It should also be understood that the term "and/or" used in the specification and appended claims of this application refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

As used in the description of this application and the appended claims, the term "if" can be construed as "when" or "once" or "in response to determination" or "in response to detecting ". Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "in response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".

In addition, in the description of the specification of this application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.

Reference to "one embodiment" or "some embodiments" described in the specification of this application means that one or more embodiments of this application include a specific feature, structure, or characteristic described in combination with the embodiment. Therefore, the sentences "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless it is specifically emphasized otherwise. The terms "including", "including", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

The auxiliary photographing method provided by the embodiments of this application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, and super mobile personal computers For terminal devices (ultra-mobile personal computer, UMPC), netbooks, and personal digital assistants (personal digital assistant, PDA), the embodiments of this application do not impose any restrictions on the specific types of terminal devices.

In order to improve the shooting effect, many applications currently have a posture recommendation function. As shown in Figure 1, some fixed posture images are built in the application. When the user selects a certain posture image, as shown in Figure 2, The posture image is displayed in a fixed position in the display interface (for example, displayed in the lower left corner or the lower right corner of the display interface) for the subject's posture reference. Although this method can improve the shooting effect to a certain extent, because the built-in posture images in the application are limited, it is often unable to meet the user’s current photographing needs, and the built-in posture images in the application do not necessarily meet the current photographing scene. The photographing effect is poor; in addition, fixing the posture image in the left small corner or the lower right corner of the display interface cannot provide sufficient reference value for the subject, which makes posture adjustment efficiency and thus low photographing efficiency.

In order to solve the above-mentioned problems, embodiments of the present application provide an auxiliary photographing method, device, terminal device, and computer-readable storage medium. The target feature of the photographed object and the scene characteristic of the scene where the photographed object is located are combined to obtain the corresponding photographic object and the photographed object The posture image of the scene can improve the accuracy and effectiveness of the posture image acquisition, so that the acquired posture image meets the photographing requirements of the subject and the scene where the subject is currently located. In addition, by superimposing the posture image and the original image as a preview image, and by displaying the target posture in the preview image, it is convenient to quickly guide the subject to adjust the posture according to the target posture in the preview image, which improves the efficiency of posture adjustment and the efficiency of taking pictures. , In order to effectively improve the shooting effect of the image and enhance the user experience.

Fig. 3 shows a schematic flowchart of an auxiliary photographing method provided by an embodiment of the present application. As an example and not a limitation, the auxiliary photographing method may be applied to a terminal device that has a photographing function, that is, the terminal device A camera for taking pictures can be set in the. Wherein, the auxiliary photographing method may include:

S301: Obtain an original image, and identify the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;

It should be understood that the terminal device can start the camera of the terminal device according to the detected camera start instruction, and can preview the image collected by the camera in real time through the display interface of the terminal device. Specifically, the user can start the camera of the terminal device by inputting a camera start instruction. The camera start instruction may be an instruction that triggers the generation of a preset button, or an instruction that triggers the generation of a preset gesture, or an instruction that triggers the generation of a preset voice keyword, which is not limited in the embodiment of the present application.

For example, the terminal device can preset the "volume +" button to generate a camera start instruction when triggered twice, or preset the "volume +" button and the "volume -" button to generate a camera start instruction when triggered at the same time, then when the user presses " The volume +" button twice, or when the user presses the "volume +" button and the "volume -" button at the same time, the terminal device can generate and obtain the camera start instruction. For another example, the terminal device may be preset to generate a camera start instruction when a preset gesture such as an "O"-shaped gesture is collected, and then when the user inputs a gesture that matches the preset gesture such as an "O"-shaped gesture, the terminal device Then the camera start instruction can be generated and obtained. For another example, the terminal device can be preset to generate a camera start instruction when a preset voice keyword such as "photograph" is detected. Then when the user input voice contains the preset voice keyword such as "photograph", the terminal device is Can generate and get the camera start instruction.

For example, the original image may be the first frame preview image previewed on the display interface of the terminal device, or may also be the Nth frame preview image after the first frame previewed on the display interface of the terminal device. For example, the original image may be the first frame image captured by the camera in real time, or it may be the Nth frame image after the first frame captured by the camera in real time, where N is an integer greater than 1.

Optionally, the terminal device may obtain the original image according to a preset trigger event or a preset duration.

Specifically, the terminal device may obtain the image currently previewed in the display interface of the terminal device or the image currently captured by the camera according to the detected specific instruction, and may determine the currently previewed image or the currently captured image as The original image.

For example, the terminal device can obtain the image currently previewed by the display interface or the image currently collected by the camera when detecting a click operation of the user clicking any position on the display interface.

Optionally, the terminal device may obtain the image currently previewed by the display interface or obtain the image currently collected by the camera when the time period when the camera is activated reaches the preset time period.

It should be noted that the auxiliary photographing mode can be set in advance in the terminal device for the user to select. Specifically, after the camera of the terminal device is started, the user can input the auxiliary photographing instruction to turn on the auxiliary photographing mode of the camera, that is, when the user inputs the auxiliary photographing instruction, the terminal device can obtain the original image, and can obtain the original image according to the original The target feature of the subject in the image and the scene feature of the scene where the subject is located acquire a posture image, so that the acquired posture image and the original image can be superimposed and displayed as a preview image to assist the subject to perform according to the target posture in the preview image Posture adjustment; and when the user does not input an auxiliary photographing instruction, the terminal device can directly perform conventional photographing processing, that is, no posture image acquisition is performed.

It should be understood that the auxiliary photographing instruction may be an instruction that triggers the generation of a preset button, or an instruction that triggers the generation of a preset gesture, or an instruction that triggers the generation of a preset voice keyword, which is not limited in the embodiment of the present application.

For example, as shown in FIG. 4, after the camera of the terminal device is started, the user can select the photographing mode on the display interface of the terminal device, and the terminal device can start the auxiliary photographing mode according to the user's selection. For example, as shown in Figure 5, after the camera of the terminal device is started, a virtual button for assisting taking pictures can be presented on the display interface of the terminal device. If the user triggers the virtual button, the terminal device can turn on the camera’s assisting taking pictures. Mode; if the user does not trigger the virtual button, the terminal device can directly perform conventional photographing processing.

For example, after the camera of the terminal device is started, the user can also enter a preset gesture such as an "M" gesture in the display interface of the terminal device to turn on the camera's auxiliary photographing mode, or may include "assisted photographing" through voice input Wait for the preset voice keywords to turn on the auxiliary camera mode of the camera.

It should be understood that after the terminal device acquires the original image, it may first perform image recognition on the original image through artificial intelligence (AI) technology to determine whether there is a photographed object in the original image. If there is a photographed object in the original image, the terminal device can further identify the target feature of the photographed object and the scene characteristic of the scene where the photographed object is located. Among them, the target characteristics of the photographed object may include one or more of the number of photographed objects, gender, age, height, body type, and the like.

For example, the terminal device may be provided with a TOF (Time of Flight) depth camera, and the terminal device may use the TOF depth camera to obtain target features such as the height and body shape of the photographed subject.

For example, the terminal device may be provided with a face recognition model, and the terminal device may use the face recognition model to recognize target characteristics such as the number, gender, and age of the subject in the original image. Here, the face recognition model may be a recognition model constructed based on a convolutional neural network. The embodiment of the present application does not limit the specific construction process and specific training process of the face recognition model, and the existing construction process may be used for construction. The existing training process can also be used for training. It should be understood that the face recognition model set in the terminal device may be trained by a cloud server, and the face recognition model set in the terminal device may be updated in real time according to the update operation of the cloud server.

It should be noted that after the face recognition model receives the original image, it can first perform preprocessing such as information conversion, denoising, smoothing, and transformation on the original image to enhance the important features of the image; then face recognition can be used The technology performs face recognition on the preprocessed original image to obtain target characteristics such as the number, gender, and age of the subject in the original image according to the face recognition result. Here, the face recognition technology may be any existing face recognition technology, which is not limited in the embodiment of the present application.

For example, the terminal device may be provided with a scene recognition model, and the terminal device may use the scene recognition model to obtain the scene characteristics of the scene where the shooting object in the original image is located. As shown in Figure 6, the scene recognition model may be a hierarchical scene recognition model based on a convolutional neural network. Among them, the hierarchical scene recognition model can be used to extract features of different scales of the original image, and can mix the features of different scales, and then the mixed features can be extracted again, and the extracted features can be used as The scene features of the original image enable the extracted scene features to contain more image information, thereby improving the accuracy of the posture image acquisition.

For example, for an original image of 640*480 pixels, the terminal device can first perform multiple downsampling operations on the original image to obtain A1 (320*240), A2 (160*120), ..., An, Then you can perform a series of feature extraction operations (such as convolution operations) on A1, A2,..., An to obtain feature images F1, F2...Fn, and finally you can combine the features of F1, F2,..., Fn After the images are combined, feature extraction is performed again, and the last extracted feature can be used as the scene feature of the original image.

It should be noted that the embodiment of the present application does not limit the specific construction process and specific training process of the hierarchical scene recognition model, and the existing construction process can be used for construction, or the existing training process can be used for training. For example, the layered scene recognition model can be trained by the cloud server through the AI training and simulation training platform MTP, or the cloud server can be trained by the AI training and the Xiangyun simulation execution platform MEP. It should be understood that the hierarchical scene recognition model set in the terminal device may also be updated in real time according to the update operation of the cloud server.

It should be understood that after the layered scene recognition model receives the original image, it can first perform preprocessing such as information conversion, denoising, smoothing, and transformation on the original image to enhance the important features of the image; then, image segmentation technology can be used, For example, the image instance segmentation technology (Mask Region-based Convolutional Neural Networks, Mask RCNN) can be used to perform target detection and segmentation on the preprocessed original image to obtain the foreground part and background part of the original image; then the background part can be Perform feature extraction to obtain the scene features of the scene where the shooting object in the original image is located.

S302: Acquire a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, where the posture image contains the target posture to be recommended;

Optionally, the terminal device may be provided with a posture recommendation model, the posture recommendation model can obtain the posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, so as to obtain the posture image by comprehensively considering the target feature and the scene feature Precise and effective posture images, which can assist and guide the subject to adjust posture according to the target posture contained in the posture image, improve the image shooting effect, and enhance the user experience.

Here, the posture recommendation model may be a recommendation model constructed based on a neural network. The embodiment of the present application does not limit the specific construction process and specific training process of the posture recommendation model, and the existing construction process may be used for construction, or the existing training process may be used for training. It should be understood that the posture recommendation model set in the terminal device can be trained by the cloud server based on a large number of sample images, and the posture recommendation model set in the terminal device can also be updated in real time according to the update operation of the cloud server.

In a possible implementation, the pose recommendation model can take the target feature of the subject and the scene feature of the scene where the subject is located as input, and can take a pose that matches the target feature and scene feature. Image as output. Specifically, after the terminal device obtains the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located, the target feature and the scene feature can be formed into a two-tuple, and the formed two-tuple can be combined Input to the posture recommendation model, and the posture recommendation model can output a posture image containing the target posture based on the two-tuple.

In another possible implementation manner, the pose recommendation model can take the target feature of the shooting object, the scene feature of the scene where the shooting object is located, and the shooting feature of the shooting object as input as a triplet, and can be related to the target feature , The scene feature and the posture image matching the photo feature as output. Among them, the photographing feature may be a characteristic of photographing preferences or photographing habits corresponding to the photographed subject. Specifically, after the terminal device obtains the target feature of the shooting object in the original image, the scene feature of the scene where the shooting object is located, and the shooting feature of the shooting object, the target feature, the scene feature, and the shooting feature can be formed into a triplet , And the composed triples can be input to the posture recommendation model, and the posture recommendation model can output a posture image containing the target posture based on the triples.

Specifically, after the terminal device recognizes the subject in the original image, it can also acquire the photographic characteristics of the subject, and can acquire the posture based on the target characteristics of the subject, the scene characteristics of the scene where the subject is located, and the photographic characteristics of the subject image.

For example, the terminal device may obtain the photographic characteristics of the photographed object according to the identity mark information of the photographed object. For example, the terminal device may also acquire the photographing feature corresponding to the terminal device according to the device identification information of the terminal device, and may determine the acquired photographing characteristic corresponding to the terminal device as the photographing characteristic of the photographing object.

It should be understood that, in the embodiments of the present application, the photographic characteristics of each photographed object can be obtained by image analysis of the historical photographed images of each photographed object in advance, and the photographic characteristics of each photographed object can be compared with the identity mark information of each photographed object. Save associatively. In the embodiments of this application, it is also possible to perform image analysis on the historical photographed images in each terminal device in advance to obtain the photographing characteristics corresponding to each terminal device, and to compare the photographing characteristics corresponding to each terminal device with the device identification information of each terminal device. Save associatively.

It should be noted that when the terminal device acquires the posture image according to the target characteristics of the photographed object and the scene characteristics of the scene where the photographed object is located, or the terminal device is based on the target characteristic of the photographed object, the scene characteristic of the scene where the photographed object is located, and When acquiring the posture image with the photographic characteristics of the subject, one or more sample images can be acquired, and the posture image can be acquired according to the acquired sample images. Wherein, the sample image may be an image collected in advance and stored in the terminal device or stored in a cloud server connected to the terminal device, or it may be an image captured from the network in real time during the photographing process.

It should be understood that when the terminal device acquires a sample image, the terminal device can directly determine the acquired sample image as the posture image acquired by the terminal device; and when the terminal device acquires multiple sample images , The terminal device can select a target sample image from the multiple sample images, and can determine the selected target sample image as the posture image acquired by the terminal device.

Specifically, the terminal device can first obtain the recommended value corresponding to each sample image, and then can select the sample image with the highest recommended value as the target sample image, and can determine the selected target sample image as the target sample image. The posture image acquired by the terminal device is used to recommend the posture image through the recommended value, which helps to improve the recommendation accuracy and recommendation efficiency of the posture image.

It should be understood that when the terminal device acquires multiple sample images, the terminal device can select multiple target sample images from the multiple sample images, and can display the selected multiple target sample images, so that the photographer or The subject selects a pose image from the multiple target sample images. Here, the terminal device can also select the target sample image according to the recommended value corresponding to each sample image, that is, the first N sample images with high recommended value can be selected from the sample images as the target sample image, where N is An integer greater than or equal to 2.

For example, after the terminal device obtains the recommended values corresponding to the multiple sample images, it can first sort the multiple sample images in descending order according to the recommended values to obtain a descending sorted group. In the descending sorted group, the recommended value is higher. The higher the order of the sample images, the higher the order of the sample images, and the lower the order of the sample images of the lower the recommended value; then, the top N sample images in the descending order can be selected as the target sample images.

For example, after the terminal device selects multiple target sample images, the multiple target sample images may be sequentially displayed on the display interface of the terminal device. For example, these multiple target sample images can be displayed in the lower left corner, lower right corner, upper left corner, or upper right corner of the display interface in sequence, so that the photographer or the subject can select pose images from the multiple target sample images . For example, in the display process of the target sample image, the photographer or the subject can select the posture image by double-clicking the target sample image, or can select the posture image by triple-clicking the target sample image. This is not limited.

It should be understood that, during the display of the target sample image, the photographer or the shooting object can switch the target sample image through a sliding operation. For example, you can switch to the previous target sample image by swiping to the left, and switch to the next target sample image by swiping to the right. For example, you can switch to the next target sample image by swiping to the left, and switch to the previous target sample image by swiping to the right. For example, you can switch to the previous target sample image by swiping up, and switch to the next target sample image by swiping down. For example, it is possible to switch to the next target sample image by swiping up, and switch to the previous target sample image by swiping down, which is not limited in the embodiment of the present application.

Optionally, after acquiring multiple target sample images, the terminal device may determine the display sequence corresponding to each target sample image, and may sequentially display the target sample images on the display interface of the terminal device according to the display sequence. In order to improve the effect of posture image recommendation, it is convenient to quickly find satisfactory posture images and enhance user experience.

Specifically, the terminal device can determine the display sequence corresponding to each target sample image according to the recommended value corresponding to each target sample image, wherein the target sample image with a larger recommended value is displayed on the display interface first, and the recommended value is smaller The target sample image of is later displayed on the display interface.

Optionally, when the terminal device displays each target sample image on the display interface, it can also display the recommended value corresponding to each target sample image, so that it is convenient for the subject and/or the photographer to select the posture image according to the recommended value To enhance the user experience. For example, the recommended value may be a specific value, for example, it may be a specific value such as 90 or 95. For example, the recommendation value may also be a recommendation index, for example, it may be a 5-star recommendation index, a 4-star recommendation index, a 3-star recommendation index, and so on.

S303. Superimpose and display the posture image and the original image as a preview image, so as to guide the photographic subject to perform posture adjustment according to the target posture in the preview image.

It should be understood that after the terminal device obtains the posture image, the posture image can be superimposed on the original image, that is, the target posture contained in the posture image can be superimposed on the original image, and the original image superimposed on the target posture can be used as The preview image is displayed on the display interface of the terminal device. For example, in a specific application scenario, the preview image as shown in FIG. 7 can be displayed on the display interface of the terminal device, so that the target posture in the preview image can be passed Guide the subject to adjust the posture and/or standing position, improve the efficiency of posture adjustment, improve the efficiency of photographing, and enhance the user experience.

For example, the terminal device may instruct the photographed subject to adjust the posture and/or standing position through the form of voice playback and/or text display, for example, instruct the photographed subject to be embedded in the target posture.

It should be noted that, before the posture image and the original image are superimposed and displayed as a preview image, to ensure that the posture image can be superimposed on the original image, the terminal device may first obtain the first image size and size corresponding to the original image. The second image size corresponding to the posture image, and the second image size corresponding to the posture image can be adjusted according to the first image size, so as to adjust the second image size corresponding to the posture image to the first image size.

In a possible implementation, the posture image superimposed on the original image may be a binary mask with the same size as the original image. Specifically, the original image may be a first layer, and the binary mask may be a second layer, and the posture image and the original image are superimposed by superimposing the second layer on the first layer. Wherein, each pixel in the binary mask corresponds to each pixel in the original image respectively. For example, the pixel value of the pixel corresponding to the target posture in the binary mask is 1 (that is, the pixel corresponding to the target posture in the binary mask is white), and the pixel value of the pixel other than the target posture in the binary mask is The pixel value is 0 (that is, the pixels other than the target pose in the binary mask are black), that is, when the pose image is superimposed on the original image, the target pose can completely hide the content of the corresponding position in the original image. The position other than the target pose is completely transparent, that is, the position other than the target pose can display the content of the corresponding position in the original image, so that the target pose in the pose image can be merged into the current photo scene To guide the subject in posture adjustments.

Specifically, after the terminal device obtains the posture image, it can add a layer mask to the posture image, where the position corresponding to the target posture in the layer mask (that is, the pixel corresponding to the target posture) can be set to white, and The position of the layer mask other than the target pose (that is, the pixel points other than the target pose) can be set to black to obtain the binary mask corresponding to the pose image, and the pose image with the layer mask (ie The binary mask of the posture image) and the original image are superimposed and displayed as a preview image, that is, the target posture in the posture image is superimposed on the original image to obtain a preview image, and the obtained preview image can be displayed on the terminal device In the display interface of to guide the subject to adjust the posture.

In another possible implementation, the terminal device can also use image segmentation technology to segment the target posture from the posture image, the segmented target posture can be superimposed on the original image, and the target posture can be superimposed on the target posture. The original image is displayed as a preview image.

Specifically, the terminal device may first obtain the first position of the target posture in the posture image, and then determine the second position of the target posture in the original image according to the first position, and can superimpose the target posture To the second position of the original image.

For example, the terminal device may first determine the first position of the target posture in the posture image, and then can find the original image according to the correspondence between the pixels in the posture image and the pixels in the original image In the target pixel point corresponding to the target posture, the second position of the target posture in the original image can be determined according to the target pixel point.

It should be understood that in the process of displaying the preview image on the terminal device, the photographer can adjust the shooting angle and/or shooting position by moving the terminal device, and in the process of adjusting the shooting angle and/or shooting position, the terminal The device can obtain the adjusted original image in real time, and can obtain the posture image according to the adjusted original image, and can superimpose the obtained posture image and the adjusted original image and display it as a preview image, so that the target posture can change with the scene Dynamically adjust the position to improve the recommendation effect of the target posture, improve the photographing effect, and enhance the user experience.

It should be understood that in the process of displaying the preview image on the terminal device, the photographer can adjust the shooting angle and/or shooting position by moving the terminal device, and in the process of adjusting the shooting angle and/or shooting position, the terminal The device can determine the target position of the target pose in the preview image of the current frame according to the relative position of the target pose in the preview image of the previous frame and the foreground part and/or background part of the preview image, and can preview the target pose in the current frame The target posture is displayed at the target position of the image, so that the target posture may not move with the movement of the terminal device, which reduces the difficulty of use by the photographer and improves the photographing effect. For example, in the scene shown in FIG. 7, when the photographer adjusts the shooting angle and/or shooting position by moving the terminal device, the current frame preview as shown in FIG. 8 may be displayed on the display interface of the terminal device. Image, so that the target posture and the shooting scene remain relatively fixed.

Optionally, after the posture image and the original image are superimposed and displayed as a preview image to guide the posture of the subject according to the preview image, the terminal device can obtain the current posture of the subject in real time, and can determine the current posture and The degree of matching between the target postures can thereby guide the subject to adjust the posture according to the degree of matching. Here, the matching degree between the current posture and the target posture may be determined by any existing matching degree calculation method, which is not limited in the embodiment of the present application.

For example, after the matching degree between the current pose and the target pose is obtained, the matching degree can also be displayed on the display interface of the terminal device in real time, so that the subject and/or the photographer can clearly understand the subject’s photo pose The specific fit with the target posture in the posture image.

It should be understood that after the terminal device obtains the matching degree between the current posture and the target posture, if the matching degree is less than a preset threshold, the terminal device can perform posture comparison to find out the current posture and the target posture Therefore, the subject can be prompted to adjust the posture according to the different position. For example, the subject may be prompted to adjust the posture through voice playback and/or the subject may be prompted to adjust the posture through text display. The preset threshold value should be understood as a threshold value preset in the terminal device. The preset threshold value may be set by the user where the terminal device is located, or may be set by default by the terminal device system.

It should be noted that after obtaining the target posture in the posture image, the terminal device can also generate a three-dimensional model corresponding to the target posture according to the current scene, and can fuse the three-dimensional model into the original image and display it as a preview image to pass Three-dimensional AR image for more precise and vivid posture guidance.

It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiment of the present application.

Corresponding to the auxiliary photographing method described in the above embodiments, FIG. 9 shows a structural block diagram of an auxiliary photographing device provided in an embodiment of the present application. For ease of description, only parts related to the embodiment of the present application are shown.

Referring to FIG. 9, the auxiliary photographing device may include:

The target feature recognition module 901 is configured to obtain an original image, and recognize the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;

The posture image acquisition module 902 is configured to obtain a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, and the posture image contains the target posture to be recommended;

The posture image superimposing module 903 is configured to superimpose and display the posture image and the original image as a preview image, so as to guide the subject to perform posture adjustment according to the target posture in the preview image.

In a possible implementation manner, the posture image superimposing module 903 may include:

In another possible implementation manner, the posture image superimposing module 903 may further include:

Optionally, the second posture image superimposing unit may include:

For example, the posture image acquisition module 902 may include:

Optionally, the posture image acquisition module 902 may include:

Optionally, the auxiliary photographing device may further include:

It should be noted that the information interaction and execution process between the above-mentioned devices/units are based on the same concept as the method embodiment of this application, and its specific functions and technical effects can be found in the method embodiment section. I won't repeat it here.

Those skilled in the art can clearly understand that for the convenience and conciseness of description, only the division of the above functional units and modules is used as an example. In practical applications, the above functions can be allocated to different functional units and modules as required. Module completion, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist alone physically, or two or more units can be integrated into one unit. The above-mentioned integrated units can be hardware-based Formal realization can also be realized in the form of a software functional unit. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the foregoing system, reference may be made to the corresponding process in the foregoing method embodiment, which will not be repeated here.

FIG. 10 is a schematic structural diagram of a terminal device provided by an embodiment of this application. As shown in FIG. 10, the terminal device 10 of this embodiment includes: at least one processor 1000 (only one is shown in FIG. 10), a memory 1001, and stored in the memory 1001 and can be stored in the at least one processor 1000. When the processor 1000 executes the computer program 1002, the steps in any of the foregoing embodiments of the auxiliary photographing method are implemented.

The terminal device 10 may include, but is not limited to, a processor 1000 and a memory 1001. Those skilled in the art can understand that FIG. 10 is only an example of the terminal device 10, and does not constitute a limitation on the terminal device 10. It may include more or less components than shown in the figure, or a combination of certain components, or different components. , For example, can also include input and output devices, network access devices, and so on.

The processor 1000 may be a central processing unit (Central Processing Unit, CPU), and the processor 1000 may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), and application specific integrated circuits (Application Specific Integrated Circuits). , ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 1001 may be an internal storage unit of the terminal device 10 in some embodiments, such as a hard disk or a memory of the terminal device 10. In other embodiments, the memory 1001 may also be an external storage device of the terminal device 10, for example, a plug-in hard disk equipped on the terminal device 10, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) card, flash card (Flash Card), etc. Further, the memory 1001 may also include both an internal storage unit of the terminal device 10 and an external storage device. The memory 1001 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 1001 can also be used to temporarily store data that has been output or will be output.

For example, the terminal device involved in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, and the like. Take the terminal device as a mobile phone as an example. FIG. 11 shows a block diagram of a part of the structure of a mobile phone provided in an embodiment of the present application. Referring to FIG. 11, the mobile phone includes: a radio frequency (RF) circuit 1110, a memory 1120, an input unit 1130, a display unit 1140, a sensor 1150, an audio circuit 1160, a wireless fidelity (WiFi) module 1170, and a processor 1180 , And power supply 1190 and other components. Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 11 does not constitute a limitation on the mobile phone, and may include more or fewer components than those shown in the figure, or a combination of some components, or different component arrangements.

The following describes the components of the mobile phone in detail with reference to Figure 11:

The RF circuit 1110 can be used for receiving and sending signals during the process of sending and receiving information or talking. In particular, after receiving the downlink information of the base station, it is processed by the processor 1180; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1110 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division) Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), Email, Short Messaging Service (SMS), etc.

The memory 1120 may be used to store software programs and modules. The processor 1180 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1120. The memory 1120 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of mobile phones (such as audio data, phone book, etc.), etc. In addition, the memory 1120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The input unit 1130 may be used to receive inputted digital or character information, and generate key signal input related to user settings and function control of the mobile phone. Specifically, the input unit 1130 may include a touch panel 1131 and other input devices 1132. The touch panel 1131, also called a touch screen, can collect user touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 1131 or near the touch panel 1131. Operation), and drive the corresponding connection device according to the preset program. Optionally, the touch panel 1131 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 1180, and can receive and execute the commands sent by the processor 1180. In addition, the touch panel 1131 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1131, the input unit 1130 may also include other input devices 1132. Specifically, other input devices 1132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, and joystick.

The display unit 1140 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 1140 may include a display panel 1141. Optionally, the display panel 1141 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 1131 can cover the display panel 1141. When the touch panel 1131 detects a touch operation on or near it, it transmits it to the processor 1180 to determine the type of touch event, and then the processor 1180 responds to the touch event. The type provides corresponding visual output on the display panel 1141. Although in FIG. 11, the touch panel 1131 and the display panel 1141 are used as two independent components to implement the input and input functions of the mobile phone, but in some embodiments, the touch panel 1131 and the display panel 1141 can be integrated. Realize the input and output functions of mobile phones.

The mobile phone may also include at least one sensor 1150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor can include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 1141 according to the brightness of the ambient light. The proximity sensor can close the display panel 1141 and/or when the mobile phone is moved to the ear. Or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three-axis), and can detect the magnitude and direction of gravity when it is stationary. It can be used to identify mobile phone posture applications (such as horizontal and vertical screen switching, related Games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, percussion), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which can also be configured in mobile phones, I will not here Go into details.

The audio circuit 1160, the speaker 1161, and the microphone 1162 can provide an audio interface between the user and the mobile phone. The audio circuit 1160 can transmit the electrical signal converted from the received audio data to the speaker 1161, which is converted into a sound signal by the speaker 1161 for output; on the other hand, the microphone 1162 converts the collected sound signal into an electrical signal, and the audio circuit 1160 After being received, the audio data is converted into audio data, and then processed by the audio data output processor 1180, and sent to, for example, another mobile phone via the RF circuit 1110, or the audio data is output to the memory 1120 for further processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1170. It provides users with wireless broadband Internet access. Although FIG. 11 shows the WiFi module 1170, it is understandable that it is not a necessary component of the mobile phone, and can be omitted as needed without changing the essence of the invention.

The processor 1180 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. It executes by running or executing software programs and/or modules stored in the memory 1120, and calling data stored in the memory 1120. Various functions and processing data of the mobile phone can be used to monitor the mobile phone as a whole. Optionally, the processor 1180 may include one or more processing units; preferably, the processor 1180 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, application programs, etc. , The modem processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1180.

The mobile phone may also include a power source (such as a battery) for supplying power to various components. Preferably, the power source may be logically connected to the processor 1180 through a power management system, so that functions such as charging, discharging, and power consumption management can be managed through the power management system.

Although not shown, the mobile phone may also include a camera 1190. Optionally, the position of the camera 1190 on the mobile phone may be front-mounted or rear-mounted, which is not limited in the embodiment of the present application.

The camera 1190 can obtain the optical image generated by the photographed object, and can convert the optical image into an electrical signal, and then can convert the electrical signal into a digital signal through analog-to-digital conversion, and then process the digital signal through the digital signal processor DSP The processed digital signal can be sent to the processor 1180 for processing, and finally converted into an image that can be seen in the display unit 1140.

Optionally, the mobile phone may include a single camera, a dual camera, or a triple camera, etc., which is not limited in the embodiment of the present application.

For example, a mobile phone may include three cameras, of which one is a main camera, one is a wide-angle camera, and one is a telephoto camera.

Optionally, when the mobile phone includes multiple cameras 1190, the multiple cameras may be all front-mounted, or all rear-mounted, or part of the front-mounted and some rear-mounted, which is not limited in this embodiment of the present application.

In addition, although not shown, the mobile phone may also include a Bluetooth module, etc., which will not be repeated here.

The embodiments of the present application also provide a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in each of the foregoing method embodiments can be implemented.

The embodiments of the present application provide a computer program product. When the computer program product runs on a terminal device, the terminal device can implement the steps in the foregoing method embodiments when executed.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the implementation of all or part of the processes in the above-mentioned embodiment methods in this application can be accomplished by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. The computer program can be stored in a computer-readable storage medium. When executed by the processor, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable storage medium may at least include: any entity or device capable of carrying computer program code to the device/terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), and random access memory (RAM, Random Access Memory), electric carrier signal, telecommunications signal and software distribution medium. Such as U disk, mobile hard disk, floppy disk or CD-ROM, etc. In some jurisdictions, in accordance with legislation and patent practices, computer-readable storage media cannot be electrical carrier signals and telecommunication signals.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail or recorded in an embodiment, reference may be made to related descriptions of other embodiments.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed device/terminal device and method may be implemented in other ways. For example, the device/terminal device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units. Or components can be combined or integrated into another system, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, a person of ordinary skill in the art should understand that it can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims

An auxiliary photographing method, characterized in that it comprises:

Acquiring an original image, and identifying the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;

Acquiring a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, where the posture image contains the target posture to be recommended;

The posture image and the original image are superimposed and displayed as a preview image, so as to guide the photographic subject to perform posture adjustment according to the target posture in the preview image.
The auxiliary photographing method according to claim 1, wherein the superimposing and displaying the posture image and the original image as a preview image comprises:

A layer mask is added to the posture image, and the posture image with the added layer mask and the original image are superimposed and displayed as the preview image, and the position corresponding to the target posture in the layer mask is set to White, the position in the layer mask except the target pose is set to black.
The auxiliary photographing method according to claim 1, wherein the superimposing and displaying the posture image and the original image as a preview image comprises:

Segmenting the target posture from the posture image;

The target posture is superimposed on the original image, and the original image superimposed on the target posture is displayed as a preview image.
The auxiliary photographing method according to claim 3, wherein the superimposing the target posture on the original image comprises:

Acquiring the first position of the target posture in the posture image;

The second position of the target posture in the original image is determined according to the first position, and the target posture is superimposed at the second position of the original image.
The auxiliary photographing method according to claim 1, wherein the acquiring a posture image according to the target feature of the photographing object and the scene characteristic of the scene where the photographing object is located comprises:

Acquiring a photographing feature of the photographing object, where the photographing characteristic is a photographing preference characteristic corresponding to the photographing object;

The posture image is acquired according to the target feature and the photographing feature of the shooting object and the scene feature of the scene where the shooting object is located.
The auxiliary photographing method according to claim 1, wherein the acquiring a posture image according to the target feature of the photographed object and the scene characteristic of the scene where the photographed object is located comprises:

Acquiring at least one sample image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located;

Acquiring the recommended value corresponding to the at least one sample image;

A target sample image is selected from the at least one sample image according to the recommended value, and the posture image is acquired according to the target sample image.
The auxiliary photographing method according to claim 1, wherein before the superimposing and displaying the posture image and the original image as a preview image comprises:

Acquiring a first image size corresponding to the original image and a second image size corresponding to the posture image;

The second image size corresponding to the posture image is adjusted according to the first image size corresponding to the original image, so as to adjust the second image size corresponding to the posture image to the first image size.
The auxiliary photographing method according to any one of claims 1 to 7, wherein after the superimposing and displaying the posture image and the original image as a preview image, it comprises:

Acquiring the current posture of the shooting object;

The degree of matching between the current posture and the target posture is determined, and the shooting object is guided to adjust the posture according to the degree of matching.
An auxiliary photographing device, characterized in that it comprises:

The target feature recognition module is used to obtain the original image, and recognize the target feature of the shooting object in the original image and the scene feature of the scene where the shooting object is located;

A posture image acquisition module, configured to acquire a posture image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located, the posture image contains the target posture to be recommended;

The posture image superimposing module is configured to superimpose and display the posture image and the original image as a preview image, so as to guide the subject to perform posture adjustment according to the target posture in the preview image.
9. The auxiliary photographing device according to claim 9, wherein the posture image superimposing module comprises:

The first posture image superimposing unit is used to add a layer mask to the posture image, and superimpose and display the posture image with the added layer mask and the original image as the preview image, in the layer mask The position corresponding to the target posture is set to white, and the position other than the target posture in the layer mask is set to black.
9. The auxiliary photographing device according to claim 9, wherein the posture image superimposing module further comprises:

A posture image segmentation unit for segmenting the target posture from the posture image;

The second posture image superimposing unit is configured to superimpose the target posture on the original image, and display the original image superimposed on the target posture as a preview image.
The auxiliary photographing device according to claim 11, wherein the second posture image superimposing unit comprises:

The first position acquisition subunit is configured to acquire the first position of the target posture in the posture image;

The second position determination subunit is configured to determine the second position of the target posture in the original image according to the first position, and superimpose the target posture on the second position of the original image.
9. The auxiliary photographing device according to claim 9, wherein the posture image acquisition module comprises:

A photographing feature acquiring unit, configured to acquire a photographing characteristic of the photographing object, where the photographing characteristic is a photographing preference characteristic corresponding to the photographing object;

The first posture image obtaining unit is configured to obtain the posture image according to the target feature and the photographing feature of the shooting object and the scene feature of the scene where the shooting object is located.
9. The auxiliary photographing device according to claim 9, wherein the posture image acquisition module comprises:

A sample image acquisition unit, configured to acquire at least one sample image according to the target feature of the shooting object and the scene feature of the scene where the shooting object is located;

A recommended value obtaining unit, configured to obtain a recommended value corresponding to the at least one sample image;

The second posture image obtaining unit is configured to select a target sample image from the at least one sample image according to the recommended value, and obtain the posture image according to the target sample image.
9. The auxiliary photographing device of claim 9, wherein the auxiliary photographing device further comprises:

An image size obtaining module, configured to obtain a first image size corresponding to the original image and a second image size corresponding to the posture image;

The image size adjustment module is configured to adjust the second image size corresponding to the posture image according to the first image size corresponding to the original image, so as to adjust the second image size corresponding to the posture image to the first image size .
The auxiliary photographing device according to any one of claims 9 to 15, wherein the auxiliary photographing device further comprises:

The current posture acquisition module is used to acquire the current posture of the photographed object;

The current posture matching module is used to determine the degree of matching between the current posture and the target posture, and guide the subject to adjust the posture according to the degree of matching.
A terminal device, comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program as claimed in claims 1 to 8. The auxiliary photographing method described in any one of 8.
A computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the auxiliary photographing method according to any one of claims 1 to 8 .