WO2019213819A1

WO2019213819A1 - Photographing control method and electronic device

Info

Publication number: WO2019213819A1
Application number: PCT/CN2018/085899
Authority: WO
Inventors: 王星泽
Original assignee: 合刃科技（武汉）有限公司
Priority date: 2018-05-07
Filing date: 2018-05-07
Publication date: 2019-11-14
Also published as: CN111295875A

Abstract

Provided is a photographing control method, comprising: acquiring a preview image; using a preset model to analyze the preview image so as to obtain an analysis result; determining, according to the analysis result, whether a photographing condition is satisfied at a current moment; and if it is determined that the photographing condition is satisfied, controlling a photographing operation to be executed. Also provided is an electronic device implementing the photographing control method. In the photographing control method and the electronic device of the present invention, whether a photographing condition is satisfied can be automatically determined according to a preview image, and if the photographing condition is satisfied, a photographing operation is performed to timely capture an image of a scene of interest containing content corresponding to a current preview image.

Description

Shooting control method and electronic device

Technical field

The present application relates to the field of electronic devices, and in particular, to a photographing control method for an electronic device and the electronic device.

Background technique

Now, with the improvement of people's living standards, taking pictures has become a common function that is not indispensable in life. Nowadays, whether it is a camera or an electronic device such as a mobile phone or a tablet computer with a camera function, pixels are getting higher and higher, and the quality of photographs is getting better and better. However, current electronic devices such as cameras and mobile phones often require the user to initiate a photograph by pressing a shutter button or a photographing icon when performing photographing control. Since the user's operation often has a certain lag, it is often impossible to capture the wonderful time in time. In an instant, it is often impossible to take a satisfactory photo, or because of the lag, it has taken an unsatisfactory photo. For example, the subject may be in good condition when framing, but the moment when the photo is taken may appear that the eyes are not open, the smile is relatively stiff, and the final photographs are often unsatisfactory. For example, when taking pictures of a baby, the cute expression of the baby is often fleeting, and it is difficult to take a satisfactory photo in time by the user operating the shutter button or shooting an icon.

Summary of the invention

The application provides a shooting control method and an electronic device, which can perform a shooting operation in time to capture a wonderful moment.

In one aspect, a shooting control method is provided, the shooting control method includes: acquiring a shooting preview screen; analyzing the shooting preview image by using a preset model to obtain an analysis result; determining, according to the analysis result, whether the current shooting condition is met And control to perform the shooting operation when it is determined that the shooting conditions are satisfied.

In another aspect, an electronic device is provided, the electronic device including a camera, a memory, and a processor. The memory is for storing program instructions. The processor is configured to execute the shooting control method by calling the program instruction, the shooting control method includes: acquiring a shooting preview image by using a camera; and analyzing the shooting preview image by using a preset model to obtain an analysis result; The analysis result determines whether the shooting condition is currently satisfied; and when it is determined that the shooting condition is satisfied, the control performs the shooting operation.

In still another aspect, a computer readable storage medium is provided, the computer readable storage medium storing program instructions for executing a shooting control method after the computer calls, the shooting control method comprising: acquiring a shooting Previewing a picture; analyzing the shooting preview picture by using a preset model to obtain an analysis result; determining whether the shooting condition is currently satisfied according to the analysis result; and controlling to perform a shooting operation when it is determined that the shooting condition is satisfied.

The photographing control method and the electronic device of the present application can automatically determine whether the photographing condition is satisfied according to the photographing preview screen, and perform photographing when the photographing condition is satisfied, and can capture a wonderful moment including the content corresponding to the current photographing preview screen in time.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are only some embodiments of the present application, Those skilled in the art can also obtain other obvious modifications according to these drawings without any creative work.

1 is a flow chart of a photographing control method in a first embodiment of the present application.

2 is a flow chart of a photographing control method in a second embodiment of the present application.

FIG. 3 is a flowchart of a photographing control method in a third embodiment of the present application.

4 is a flow chart of a photographing control method in a fourth embodiment of the present application.

FIG. 5 is a flowchart of a photographing control method in a fifth embodiment of the present application.

FIG. 6 is a flowchart of a photographing control method in a sixth embodiment of the present application.

FIG. 7 is a flowchart of a photographing control method in a seventh embodiment of the present application.

FIG. 8 is a flowchart of a photographing control method in an eighth embodiment of the present application.

FIG. 9 is a flowchart of a photographing control method in a ninth embodiment of the present application.

FIG. 10 is a flowchart of a photographing control method in a tenth embodiment of the present application.

FIG. 11 is a flowchart of a model training process in a shooting control method according to an embodiment of the present application.

FIG. 12 is a flowchart of a model training process in a shooting control method according to another embodiment of the present application.

FIG. 13 is a flowchart of a model training process in a photographing control method in still another embodiment of the present application.

FIG. 14 is a block diagram showing a schematic partial structure of an electronic device according to an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

The shooting control method of the present application can be applied to an electronic device. The electronic device can include a camera. The electronic device can acquire a shooting preview screen and display a shooting preview image through the camera, and the electronic device can perform photographing, continuous shooting, video shooting, etc. through the camera. . Among them, the camera includes a front camera and a rear camera, and the operations of photographing, continuous shooting, video shooting, etc. can be performed by a rear camera or a self-timer by a front camera.

Please refer to FIG. 1 , which is a flowchart of a shooting control method in a first embodiment of the present application. The shooting control method is applied to an electronic device. The method includes the following steps:

S11: Acquire a shooting preview screen.

In some embodiments, the operation of acquiring the shooting preview screen is performed by the camera in response to the operation of turning on the camera, that is, the shooting preview screen is acquired by the camera.

In some embodiments, the operation of turning on the camera is a click operation on the photographing application icon, that is, when the camera is turned on in response to a click operation on the photographing application icon, the shooting preview screen is acquired by the camera.

Alternatively, in other embodiments, the operation of turning on the camera is a specific operation of a physical button of the electronic device. For example, the electronic device includes a volume up button and a volume down button, and the operation of turning on the camera is to increase the volume and volume. Simultaneous pressing of small keys. Further, the operation of turning on the photographing application is an operation of pressing the volume up key and the volume down key in a preset time (for example, 2 seconds).

In other embodiments, the operation of turning on the camera may also be an operation of a preset touch gesture input in any display interface of the electronic device. For example, on the main interface of the electronic device, the user may input a circular touch track. Turn on the camera with a touch gesture.

In other embodiments, the operation of turning on the camera may also be an operation of a preset touch gesture input on the touch screen when the electronic device is in a black screen state.

In some embodiments, when the electronic device is a camera, the operation of turning on the camera is an operation that presses the shutter button/power button of the camera to trigger the camera to be in an activated state.

Optionally, in the present application, acquiring a shooting preview screen is to obtain a shooting preview screen in real time through a camera.

S13: analyzing the shooting preview image by using a preset model to obtain an analysis result.

The preset model may be a trained model or an untrained model.

Optionally, in some embodiments, the preset model is a trained neural network model; and the preset preview model is used to analyze the captured preview image to obtain an analysis result, and further includes: analyzing the captured preview image by using a neural network model, The result of this analysis of satisfaction is obtained. Among them, the satisfaction degree is that the neural network model outputs the satisfaction result by processing the pre-trained model by taking all the pixels of the preview image as input.

Optionally, in other embodiments, the preset model is a trained image processing algorithm model, and the preset preview model is used to analyze the captured preview image to obtain an analysis result, and further includes: using a trained image processing algorithm model The shooting preview screen is compared with the reference picture, and the analysis result of the similarity between the preview picture and the reference picture is analyzed. The reference picture may be a standard picture preset by the user with a specific expression such as smile, laughter, sadness, anger, yawning, and the like.

Further, the trained image processing algorithm model includes the trained target object feature model, and the trained image processing algorithm model is used to compare the captured preview image with the reference image, and the similarity between the captured preview image and the reference image is analyzed, including The image recognition technology is used to analyze the target object in the preview image, and the corresponding target object feature vector is generated. The captured preview image and the reference image are calculated according to the trained target object feature model and the target object feature vector corresponding to the captured preview image. Similarity.

In some embodiments, the calculating the similarity between the captured preview image and the reference image according to the trained target object feature model and the target object feature vector corresponding to the captured preview image comprises: capturing the target object feature vector corresponding to the preview image As the input information of the trained expression feature model, the similarity between the shooting preview picture and the reference picture is calculated by the target object feature vector.

In another embodiment, comparing the shooting preview image with the reference image by using the trained image processing algorithm model, and analyzing the analysis result of the similarity between the preview image and the reference image, comprising: acquiring pixel information of the shooting preview image; The pixel information of the shooting preview screen is compared with the pixel information of the reference picture, and the similarity between the shooting preview picture and the reference picture is analyzed. That is, in other embodiments, the similarity between the captured preview picture and the reference picture is obtained by comparing the pixel information such as the pixel grayscale value of the two images.

In another embodiment, when the preset model is a trained image processing algorithm model, the analyzing the captured preview image by using the preset model to obtain the analysis result includes: using the face recognition technology to capture the preview image. The facial expression is analyzed to generate a corresponding expression feature vector; the expression feature vector is used as input information of the image processing algorithm model, and an analysis result including identification information indicating whether the shooting condition is currently satisfied is obtained. For example, the identification information may include an identifier of 1, 0, etc., which identifies whether the analysis result of the shooting condition is currently satisfied. More specifically, when the identification information is the identifier 1, it indicates that the shooting condition is satisfied, and when the identification information is the identifier 0, it indicates that the shooting condition is not satisfied.

In some embodiments, the trained target object feature model is completed by training in a plurality of photos having different expression faces in the initial training set; and using the image recognition technology to provide a plurality of pieces in the initial training set The target object in the photo performs emoticon analysis to generate a corresponding target object feature vector Xi. For example, when the target object feature vector is an expression feature vector, X1 represents the size of the eye opening, X2 represents the degree of the mouth angle rising, and X3 represents the mouth opening. The size of the opening; the training sample set is established based on the generated target object feature vector and the similarity label between the corresponding photo and the reference picture; and the sample set is used for training learning to obtain the trained target object feature model.

In some embodiments, in the present application, the analysis result is that the analysis result is obtained according to the real-time acquired shooting preview screen. In some other embodiments, the step of analyzing the shot preview image by using the preset model to obtain an analysis result is that the currently acquired shot preview screen is analyzed every time by a preset time (for example, 0.2 seconds) to obtain a current analysis result. .

S15: Determine whether the shooting condition is currently satisfied according to the analysis result. If yes, step S17 is performed, otherwise, it returns to step S13 or the process ends.

In some embodiments, when the analysis result is obtained according to the neural network model, determining whether the shooting condition is currently satisfied according to the analysis result includes: determining that the shooting condition is currently satisfied when determining that the satisfaction exceeds the satisfaction preset threshold. The satisfaction preset threshold may be 80%, 90%, and the like.

In some embodiments, when the analysis result is obtained according to the image processing algorithm model, determining whether the shooting condition is currently satisfied according to the analysis result includes: determining that the shooting condition is currently satisfied when determining that the similarity exceeds the similarity preset threshold. Alternatively, determining whether the shooting condition is currently satisfied according to the analysis result may further include: determining that the shooting condition is currently satisfied when the analysis result includes identifying the identification information that currently meets the shooting condition.

In the present application, the target object may be a hand, a face, a specific scene, etc.; the target object feature model includes a gesture feature model, an expression feature model, and a scene feature model, etc., and the analyzed target object feature vector may include a gesture. Feature vectors, expression feature vectors, and scene feature vectors.

S17: Control determines to perform a shooting operation when it is determined that the shooting condition is satisfied.

In some implementations, the photographing operation is a photographing operation, and controlling to perform the photographing operation includes: controlling to perform a photographing operation to obtain a photograph corresponding to the current photograph preview screen.

In other implementations, the shooting operation is a continuous shooting operation, and controlling to perform a shooting operation includes: controlling to perform a continuous shooting operation, and obtaining a plurality of photos including a photo corresponding to the current photo preview screen. Optionally, after performing the continuous shooting operation, further steps may be further included: analyzing a plurality of photos obtained by the continuous shooting operation to determine the best photo; and retaining the best photo, and performing the continuous shooting operation Get other photos to delete.

In other implementations, the photographing operation is a video photographing operation, and controlling to perform a photographing operation includes: controlling to perform a video photographing operation to obtain a video file that uses the current photograph preview screen as a starting video frame frame. Optionally, after the video recording operation is performed to obtain the video file, the method may further include: after the video file is captured, the plurality of video frame frames in the captured video file may be compared to determine an optimal screen. Frame; and intercept the best picture frame to save as a photo.

Therefore, in the present application, by analyzing the photographing preview screen to determine whether the photographing condition is currently satisfied, whether or not the photograph desired by the user is photographed can be determined according to the content in the photograph preview screen, so that the current exciting moment can be captured in time.

Please refer to FIG. 2 , which is a flowchart of a shooting control method in a second embodiment of the present application. In a second embodiment, the method comprises the steps of:

S21: Acquire a shooting preview screen.

S23: Comparing the shooting preview image with the reference image by using the trained image processing algorithm model to obtain an analysis result of the similarity between the shooting preview image and the reference image. The reference picture may be a standard picture preset by the user with a specific expression such as smiling, laughing, sad, angry, yawning, or a standard picture with gestures such as an "OK" gesture or a "V-shaped" gesture. It can also be a standard picture with flowers, birds, mountains and other scenery.

Optionally, the trained image processing algorithm model includes a target object feature model, and step S23 specifically includes: analyzing, by using an image recognition technology, a target object in the captured preview image to generate a corresponding target object feature vector; and according to the target object feature The target object feature vector corresponding to the model and the preview image is calculated to obtain the similarity between the preview image and the reference picture.

In some embodiments, the similarity between the captured preview image and the reference image is calculated according to the trained target object feature model and the target object feature vector corresponding to the captured preview image, including: taking the target object feature vector corresponding to the captured preview image as The input information of the target object model of the training is calculated, and the similarity between the shooting preview picture and the reference picture is calculated by the target object feature model.

In other embodiments, the captured image processing algorithm model is used to compare the shooting preview image with the reference image, and the similarity between the shooting preview image and the reference image is analyzed, including: acquiring pixel information of the shooting preview image; The pixel information of the screen is compared with the pixel information of the reference picture, and the similarity between the shooting preview picture and the reference picture is analyzed. That is, in other embodiments, the similarity between the captured preview picture and the reference picture is obtained by comparing the pixel information such as the pixel grayscale value of the two images.

The target object may include an object such as a face, a hand, and a specific scene. The target object feature model may include an expression feature model, a gesture feature model, a scene feature model, and the like, and the analyzed target object feature vector may include the foregoing. Emoticon, angry, yawning and other expression vector, or "OK" gesture, "V-shaped" and other gesture feature vectors, or flower, bird, mountain and other scene feature vectors. In some embodiments, taking the expression feature model as an example, the trained expression feature model can be trained by providing a plurality of photos with different expression faces in the initial training set; using face recognition technology, Performing an expression analysis on the characters in the plurality of photos provided in the initial training set to generate a corresponding expression feature vector Xi, for example, X1 represents the size of the eye opening, X2 represents the degree of the mouth angle rising, and X3 represents the size of the mouth opening; The generated expression feature vector and the similarity label between the corresponding photo and the reference picture establish a training sample set; and then use the sample set to perform training learning, and obtain the trained expression feature model.

S25: When the similarity between the shooting preview screen and the reference picture reaches the similarity preset threshold, it is determined that the shooting condition is satisfied, and the shooting operation is controlled to be performed.

The similarity preset threshold may be 80%, 90%, or the like. For example, the reference picture includes a reference picture having a laughing expression, and it is determined that the shooting condition is satisfied when the similarity between the shooting preview picture and the reference picture having the laughing expression reaches 80%, and the automatic shooting is triggered.

In the present application, the similarity between the shooting preview screen and the reference picture may include, but is not limited to, the similarity of the picture style, the similarity of the colors, the similarity of the content layout, the similarity of the pixel gray levels, and the like.

In this embodiment, the user may first set a reference picture that is considered satisfactory, and perform model training. When the user wants to take a picture, the user first obtains a preview picture, and then uses the trained model to analyze the similarity between the preview picture and the reference picture. When the similarity reaches the similarity preset threshold, automatic shooting is triggered, so that a satisfactory photo similar to the reference picture can be obtained, and when the target object is a face and the image processing algorithm model is an expression feature model, the image can be reduced. Taking a photo when the expression is unnatural, you can also take a satisfactory photo with a satisfactory expression in time.

The step S21 corresponds to the step S11 in FIG. 1 . For more specific description, reference may be made to the related description of FIG. 1 , and details are not described herein again. Step S23 may be a more specific step of step S13 in FIG. 1, and related descriptions may be referred to each other. Step S25 corresponds to steps S15 and S17 in FIG. 1, and related descriptions may also be referred to each other.

Please refer to FIG. 3 , which is a flowchart of a shooting control method in a third embodiment of the present application. In a third embodiment, the preset model is a trained image processing algorithm model, and the trained image processing algorithm model includes a trained target object feature model. The shooting control method includes the following steps:

S301: Acquire a shooting preview screen.

S303: Analyze a target object in the preview image by using an image recognition technology to generate a corresponding target object feature vector.

S305: Taking the target object feature vector as the input information of the trained target object feature model, and obtaining an analysis result including the identifier information that identifies whether the shooting condition is currently satisfied.

Optionally, the identifier information may be an identifier that identifies whether the photographing condition is currently satisfied, such as 1, 0, and the like. More specifically, when the identification information is 1, it indicates that the shooting condition is satisfied, and when the identification information is 0, it indicates that the shooting condition is not satisfied. Obviously, the identification information can also be information such as "yes" or "no".

S307: When it is determined according to the analysis result that the shooting condition is satisfied, the control performs a shooting operation.

Specifically, the step S307 includes: when the identification result includes the identification information that currently meets the shooting condition, determining that the shooting condition is currently satisfied, and controlling to perform the shooting operation.

For example, when the analysis result includes identifying the identification information that satisfies the shooting condition, for example, including the identifier "1", determining that the shooting condition is currently satisfied, and when the analysis result includes identifying the identification information that does not satisfy the shooting condition, for example, including the identifier "0" When it is determined that the shooting conditions are not met.

The step S301 corresponds to the step S11 in FIG. 1 . For a more specific description, reference may be made to the related description in FIG. 1 , and details are not described herein again. The step S303 and the step S305 may be the steps corresponding to the step S13 in FIG. 1 , and the description relationship between the upper and lower positions is mutually related, and the related descriptions may refer to each other. Step S307 corresponds to steps S15, S17 in Fig. 1, and the related description can also be referred to each other.

Please refer to FIG. 4 , which is a flowchart of a shooting control method in a fourth embodiment of the present application. In the fourth embodiment, the photographing control method includes the following steps:

S31: Acquire a shooting preview screen.

S33: analyzing the shooting preview image by using a preset model to obtain an analysis result.

Optionally, step S33 includes: comparing the captured preview image with the reference image by using the trained image processing algorithm model to obtain a similarity between the captured preview image and the reference image.

The trained image processing algorithm model includes a target object feature model. Optionally, the trained model is used to compare the captured preview image with the reference image to obtain a similarity between the captured preview image and the reference image, including: through image recognition technology. The target object in the shooting preview screen is analyzed to generate a corresponding target object feature vector; and the similarity between the preview image and the reference image is calculated according to the target object feature model and the target object feature vector corresponding to the preview image.

In some embodiments, analyzing the captured preview image by using the preset model to obtain the analysis result may further include: analyzing the target object in the captured preview image by using an image recognition technology, and generating a corresponding target object feature vector; The vector is used as input information of the target object feature model, and an analysis result including identification information indicating whether the shooting condition is currently satisfied is derived.

Obviously, as mentioned above, in other embodiments, the analysis result of satisfaction can also be obtained by the trained neural network model.

S35: When it is determined according to the analysis result that the shooting condition is currently satisfied, the control performs a continuous shooting operation, and obtains a plurality of photos including the photo corresponding to the current photo preview screen.

In some embodiments, when the analysis result of the satisfaction is obtained by the trained image processing algorithm model, step S35 includes: when the similarity between the shooting preview screen and the reference picture exceeds the similarity preset threshold or the analysis result includes the identification When the identification information that satisfies the shooting condition is currently determined, it is determined that the shooting condition is satisfied, and the control performs the continuous shooting operation.

In other embodiments, when the analysis result of the satisfaction is obtained by the trained neural network model, step S35 may further include: when the satisfaction exceeds the satisfaction preset threshold, determining that the shooting condition is satisfied, and controlling to perform continuous shooting operating.

The requirement of the shooting condition when performing the continuous shooting operation may be slightly lower than the requirement when the photographing operation is performed. Specifically, the comparison similarity preset threshold or the satisfaction preset threshold may be slightly lower than the execution of the photographing when performing the continuous shooting operation. The similarity preset threshold or satisfaction preset threshold of the operation comparison.

For example, the similarity preset threshold or the satisfaction preset threshold when performing the continuous shooting operation may be 70%, which is lower than the similarity preset threshold or the satisfaction preset threshold of 80% or higher in performing the photographing operation comparison. .

Thus, continuous shooting is achieved when the best shooting effect is about to be achieved, and a photograph of the best shooting effect in continuous shooting can be ensured. For example, the reference picture is a picture with a laughing expression, and the contrast expression vector is an expression feature vector X2 indicating the degree of the mouth angle rising, and the continuous shooting operation is controlled when it is determined that the mouth angle rises to 70% of the reference picture. The user continues to smile for a short period of time, and the user's smile reaches the maximum level. This expression will be captured by the continuous shooting operation, and the photo that ensures the best shooting effect can be ensured by the continuous shooting operation.

The step S31 corresponds to the step S11 in FIG. 1 . For more specific description, reference may be made to the related description of FIG. 1 , and details are not described herein again. The step S33 may be the step S13 in FIG. 1 , the step S23 in FIG. 2 and the steps corresponding to the steps S303 and S305 in FIG. 3 , and the description relationship between the upper and lower positions is mutually related, and the related descriptions may refer to each other. Step S35 corresponds to steps S15 and S17 in FIG. 1, step S25 in FIG. 2, and step S307 in FIG. 3, and is a description relationship of upper or lower positions, and the related descriptions may also be referred to each other.

Please refer to FIG. 5 , which is a flowchart of a shooting control method in a fifth embodiment of the present application. The fifth embodiment differs from the fourth embodiment in that the photos obtained by the continuous shooting operation are also screened. The photographing control method in the fifth embodiment includes the following steps:

S41: Acquire a shooting preview screen.

S43: analyzing the captured preview image by using the trained model to obtain an analysis result.

S45: When it is determined according to the analysis result that the shooting condition is currently satisfied, the control performs a continuous shooting operation, and obtains a plurality of photos including the photo corresponding to the current photo preview screen.

S47: Analyze a plurality of photos obtained by the continuous shooting operation to determine the best photo.

Optionally, in an implementation manner, step S47 may include: analyzing the plurality of photos by using the trained neural network model to obtain satisfaction, and determining the photo with the highest satisfaction as the best photo.

Optionally, in another implementation manner, step S47 may include: comparing a plurality of photos obtained by the continuous shooting with the reference image, and determining a photo with the highest similarity with the reference image as the best photo.

Optionally, as shown in FIG. 5, the shooting control method may further include:

S49: The best photo is retained, and other photos obtained by the continuous shooting operation are deleted.

In some embodiments, the electronic device includes a memory in which a plurality of albums are created, "preserve the best photos" to store the best photos in a certain album, such as in a camera album. Among them, by deleting other photos, it can effectively avoid occupying too much storage space.

The steps S41 to S45 are respectively the same as the steps S31 to S35 in the third embodiment shown in FIG. 4, and the descriptions of the steps S31 to S35 in FIG. 4 can be referred to in more detail.

Please refer to FIG. 6 , which is a flowchart of a shooting control method in a sixth embodiment of the present application. The sixth embodiment differs from the fourth embodiment in that the photographing operation is a video shooting and not a continuous shooting operation. The photographing control method in the sixth embodiment includes the following steps:

S51: Acquire a shooting preview screen.

S53: analyzing the shooting preview image by using a preset model to obtain an analysis result.

S55: When it is determined according to the analysis result that the shooting condition is currently satisfied, the control performs a video capturing operation, and obtains a video file that uses the current shooting preview screen as a starting video frame frame.

The requirement of the shooting condition when performing the video shooting operation may also be slightly lower than the requirement when the photographing operation is performed. Specifically, the comparison similarity preset threshold or the satisfaction preset threshold may be slightly lower than the execution when performing the continuous shooting operation. The similarity preset threshold or the satisfaction preset threshold of the photographing operation comparison.

Thus, video shooting is performed when the best shooting effect is about to be achieved, and the video frame frame including the best shooting effect in the video file can be ensured.

The steps S51-S55 correspond to the steps S31-S35 in the fourth embodiment shown in FIG. 4 respectively. For a more specific introduction, reference may be made to the related description of FIG. For example, step S55 may include: when the similarity between the shooting preview screen and the reference picture exceeds the similarity preset threshold, determining that the shooting condition is satisfied, and controlling to perform the video shooting operation. Optionally, in step S55, the method may further include: when the satisfaction exceeds the satisfaction preset threshold, determining that the shooting condition is met, and controlling to perform a video shooting operation.

Optionally, as shown in FIG. 6, the shooting control method may further include:

S57: Compare a plurality of video picture frames in the captured video file to determine an optimal picture frame.

Optionally, in an implementation manner, step S57 may include: analyzing the plurality of video picture frames by using the trained neural network model to obtain satisfaction, and determining a video frame frame with the highest satisfaction as the optimal picture. frame.

Optionally, in another implementation manner, step S57 may include: comparing a plurality of video picture frames in the video file with the reference picture, and determining a video picture frame with the highest similarity with the reference picture as the optimal picture frame. .

S59: The best picture frame is cut out and saved as a photo.

In some embodiments, the electronic device includes a memory in which a plurality of albums are created, and “the best picture frame is truncated to be saved as a photo” to store the best picture frame in a photo/photo format in an album. , for example, stored in a camera album.

Please refer to FIG. 7 , which is a flowchart of a shooting control method in a seventh embodiment of the present application. The photographing control method in the seventh embodiment includes the following steps:

S61: Acquire a shooting preview screen.

S63: The shooting result is analyzed by using a preset model to obtain an analysis result.

S65: Determine whether the shooting condition is currently satisfied and determine the shutter time according to the analysis result.

Optionally, in some embodiments, step S65 may include:

According to the analysis result, the target object feature is determined to determine whether the shooting condition is satisfied and the shutter time is determined. For example, in order to determine whether the shooting condition is satisfied according to the expression feature, and determining the shutter time according to the gesture feature obtained by the analysis result, it may be set in advance to use the expression feature to decide whether to take a photo, use the gesture feature to determine the shutter time, for example, preset Corresponding relationship between the expression and the shooting condition, the correspondence between the shutter time and the gesture feature, for example, a correspondence relationship between the smile expression and the photographing condition, the correspondence between the shutter time and the gesture feature of the thumb and the index finger distance, wherein The shutter time can be logarithmically related to the distance between the thumb and the index finger. Thereby, when the user's expression feature is determined to be a smile according to the analysis result, it is determined that the shooting condition is satisfied, and the shutter time is determined based on the gesture feature of the distance between the thumb and the index finger according to the analysis result, and the control of the exposure intensity is realized.

Optionally, in an implementation manner, the trained model is a trained image processing algorithm model, and the trained image processing algorithm model includes a trained target object feature model, specifically including a trained expression feature model and Training gesture feature model. The trained expression feature model may be a model completed by the following training steps: using facial recognition technology to perform expression analysis on a character in each photo in the initial training set to generate a corresponding expression feature vector; The feature vector and the similarity label between the corresponding photo and the reference picture establish a training sample set; and the training set is further performed by using the sample set to obtain the trained expression feature model. The trained gesture feature model is a model completed by the following training steps: using an image recognition technology to analyze a hand part in each photo in the initial training set to generate a corresponding gesture feature vector; based on the generated gesture feature The training sample set is established by the similarity tag between the vector and the corresponding photo and the reference picture; and the training set is further performed by using the sample set to obtain the gesture feature model of the training completion.

The step S63 may specifically include: determining an expression similarity according to the expression feature model and the expression feature vector corresponding to the shooting preview image, and determining, according to the gesture feature model and the gesture feature vector corresponding to the shooting preview image, the gesture feature corresponding to the shooting preview image. .

In some embodiments, the trained gesture feature model includes a plurality of reference images and a reference target object feature vector of the plurality of reference images, the determined according to the gesture feature model and the gesture feature vector corresponding to the captured preview image. The capturing the gesture feature corresponding to the preview image includes: comparing, by using the gesture feature model, the gesture feature vector corresponding to the captured preview image with the reference gesture feature vector of the plurality of reference images, and determining the reference gesture feature vector with the highest similarity. a reference image, and the target object feature is derived from the reference image. For example, after the reference image is determined, the gesture feature is determined based on the label of the reference image.

The step S65 may specifically include: determining that the shooting condition is satisfied when determining that the expression similarity is greater than the similarity preset threshold; determining the gesture feature according to the gesture feature model and the gesture feature vector corresponding to the shooting preview image, for example, obtaining the index finger and the thumb a distance, and determining a shutter time corresponding to the derived gesture feature according to a correspondence between a predefined gesture feature and a shutter time, for example, determining a shutter time according to a correspondence between a gesture feature of the index finger and the thumb and a shutter time .

The foregoing correspondence may be a correspondence table or the like stored in a memory of the electronic device.

In other embodiments, the step S63 may further include: using the expression feature vector corresponding to the preview image as the input information of the expression feature model, and determining, by the trained expression feature model, whether the identifier meets the shooting condition. The result of the identification information, and the gesture feature vector corresponding to the captured preview image is used as the input information of the trained gesture feature model, and the result including the shooting setting parameter is obtained by the trained gesture feature model. Thereby, the analysis result including whether the shooting condition and the shooting setting parameter are satisfied is obtained.

In other embodiments, the step S65 may include: determining whether the identifier obtained according to the trained expression feature model satisfies the shooting condition and the shooting setting parameter according to the trained gesture feature model. The identification information indicating whether the shooting condition is satisfied and the analysis result of the shooting setting parameter, that is, the analysis result of whether or not the shooting condition and the shooting setting parameter are satisfied are obtained.

Optionally, in another implementation manner, when the trained model is a trained neural network model, by taking all the pixels of the preview image as input, the output of the neural network model includes whether the shooting condition is met or not The analysis result of the information including the setting parameter is taken; step S65 includes: determining whether the current shooting condition is satisfied and determining the shooting setting parameter according to the analysis result of the trained neural network model including whether the shooting condition and the shooting setting parameter are currently satisfied. .

Optionally, in other embodiments, the photo preview screen may be analyzed to determine an analysis result of the age identity of the photographed person, and the shutter time is determined according to the age identity. For example, when it is determined that the person being photographed is an infant, the expression of the infant is often fleeting, thereby reducing the shutter time, increasing the shutter speed, and ensuring that a wonderful moment can be captured in time.

The steps S61 and S63 in FIG. 7 correspond to the steps S11 and S13 in FIG. 1 respectively, and the related descriptions can refer to each other.

Optionally, as shown in FIG. 7, the shooting control method further includes:

S67: When it is determined that the shooting condition is satisfied, the shooting operation is performed according to the determined shutter time. Specifically, after the shutter time is adjusted to the determined shutter time, a corresponding shooting operation is performed.

Please refer to FIG. 8 , which is a flowchart of a shooting control method in an eighth embodiment of the present application. The photographing control method in the eighth embodiment and the method in the seventh embodiment shown in FIG. 7 are different from the step S65 in FIG. The photographing control method in the eighth embodiment includes the following steps:

S71: Acquire a shooting preview screen.

S73: The shooting preview screen is analyzed by using a preset model to obtain an analysis result.

S75: Determine whether the shooting condition is currently satisfied and determine the aperture size according to the analysis result.

Optionally, in some embodiments, step S75 may include:

According to the analysis result, the target object feature is determined to determine whether the shooting condition is satisfied and the shutter time is determined. For example, the expression features obtained from the analysis results determine whether the shooting conditions are satisfied, and the aperture size is determined based on the gesture characteristics obtained from the analysis results. For example, it may be set in advance: using a smile to determine whether to take a picture, using a gesture feature to determine the aperture size, for example, a correspondence between the aperture size and the distance between the thumb and the index finger is set in advance, and further, the aperture size is logarithmically related to the distance between the thumb and the index finger. . Therefore, when it is determined according to the analysis result that the user's expression is a smile, it is determined that the shooting condition is satisfied, and the distance between the thumb and the index finger corresponding to the gesture is determined according to the analysis result to determine the aperture size, and the control of the photo depth of field is realized.

Steps S71 and S73 in FIG. 8 correspond to steps S11 and S13 in FIG. 1 respectively, and also correspond to steps S61 and S63 in FIG. 7, and related descriptions can be referred to each other.

Step S75 in FIG. 8 corresponds to step S65 in FIG. 7 , except that the aperture size is determined. For a more specific implementation, reference may be made to the description of step S65 in FIG. 7 by using the description in step S65 in FIG. 7 . A more specific implementation of the step S75 in FIG. 8 is obtained by replacing the shutter time with the aperture size, and details are not described herein again.

Obviously, the shutter time and the aperture size in FIGS. 7 and 8 are merely specific examples of the shooting setting parameters. In some embodiments, other shooting setting parameters, such as parameters such as sensitivity, may also be determined based on the analysis result.

In other embodiments, when it is determined according to the analysis result whether the shooting condition is satisfied, the setting parameters are also taken at the same time, for example, the shooting setting parameters such as the shutter time and the aperture size are determined. For example, the distance between the thumb and the index finger of the user's gesture can simultaneously correspond to the shutter time and the aperture size, and the corresponding shutter time and aperture size can be simultaneously obtained by analyzing the user gesture. Thus, in the present application, at least one shooting setting parameter including a shutter time, an aperture size, and the like can be determined based on the analysis result.

In some embodiments, determining whether the shooting condition is satisfied and determining the shooting setting parameter based on the analysis result are performed simultaneously according to the analysis result.

In still other embodiments, determining the shooting setting parameter including the shutter time or the aperture size is performed after determining that the shooting condition is satisfied based on the analysis result. That is, after the determination of the shooting condition is satisfied, the shooting setting parameter is determined according to the analysis result, thereby avoiding determining the shooting setting parameter every time, and avoiding waste of computing resources.

In other embodiments, the image processing algorithm model may be used to perform image analysis on the photo preview image to obtain the analysis result of the number of faces, and the aperture size is determined according to the number of faces to ensure that each face is good. Exposure.

Optionally, as shown in FIG. 8, the shooting control method further includes:

S77: When it is determined that the shooting condition is satisfied, the shooting operation is performed according to the determined aperture size. Specifically, after the aperture size is adjusted to the determined aperture size, a corresponding photographing operation is performed.

Please refer to FIG. 9 , which is a flowchart of a shooting control method in a ninth embodiment of the present application. The photographing control method in the ninth embodiment includes the following steps:

S81: Acquire a shooting preview screen.

S83: The video stream formed by the preview image is analyzed by using a preset model to obtain an analysis result.

S85: Determine whether the shooting condition is currently satisfied according to the analysis result. If yes, step S87 is performed, otherwise, step S83 is returned.

In some embodiments, the video stream may be analyzed by a preset model such as a trained neural network model or a trained image processing algorithm model. When the user is captured to complete an action, such as shaking a finger, it is determined that the shooting condition is met. . The capturing of the user completes an action may determine the action completed by the user through the change of the multi-frame video frame frame, and may pre-define the corresponding relationship between the preset action and the shooting condition, and determine that the action completed by the user is a preset action. When it is determined, the shooting conditions are determined.

In some embodiments, each frame of the video frame in the video stream may also be analyzed by a preset model such as a trained neural network model or a trained image processing algorithm model to obtain an analysis result, and determined according to the analysis result. Whether the shooting conditions are met. The analysis result is obtained by analyzing each frame of the video picture frame, and determining whether the shooting condition is satisfied according to the analysis result may refer to the related description of any of the foregoing embodiments.

S87: Determine shooting setting parameters according to the analysis result.

The shooting setting parameter may include at least one of a shutter time, an aperture size, and the like. Optionally, step S87 is performed after step S85. Optionally, in other embodiments, step S87 may be performed simultaneously with step S85. For a specific implementation manner of determining the shooting setting parameters such as the shutter time and the aperture size according to the analysis result, refer to step S65 in FIG. 7 and the related description in step S75 in FIG. 8.

S89: Perform the shooting operation according to the shooting setting parameters. Specifically, after the shooting parameters are adjusted to the determined shooting setting parameters, a corresponding shooting operation is performed.

Please refer to FIG. 10 , which is a flowchart of a shooting control method in a tenth embodiment of the present application. The photographing control method in the tenth embodiment includes the following steps:

S91: Acquire a shooting preview image through the camera and capture the sound signal through the microphone.

S93: analyzing the sound signal by using a preset model to obtain a first analysis result and analyzing the shooting preview image to obtain a second analysis result.

S95: Determine whether the shooting condition is met according to the first analysis result and the second analysis result. If yes, step S97 is performed, otherwise, step S93 is returned.

In some embodiments, the first analysis result is that the speech content is obtained by the speech analysis model, and S95 includes:

Determining whether the preliminary shooting condition is satisfied according to the first analysis result, for example, determining that the preset voice content is “photographing”, if the voice content obtained by the first analysis result and the preset voice content “photographing” If it is met, it is determined that the initial shooting conditions are met;

a second analysis result obtained by analyzing the captured preview image by the trained model determines whether the shooting condition is satisfied;

When it is determined by the first analysis result that the preliminary photographing condition is satisfied and the photographing condition is satisfied by the second analysis result, it is finally determined that the photographing condition is currently satisfied.

The second analysis result obtained by analyzing the shot preview image by the trained model determines whether the photographing condition is satisfied and corresponds to step S15 in FIG. 1 . The specific implementation manner may refer to at least step S15 in FIG. 1 and related Related steps of other embodiments.

S97: Determine a shooting setting parameter according to the second analysis result.

The shooting setting parameter may include at least one of a shutter time, an aperture size, and the like. In some embodiments, step S97 is performed after step S95. Optionally, in other embodiments, step S97 may be performed simultaneously with step S95. For a specific implementation manner of determining the shooting setting parameters such as the shutter time and the aperture size according to the second analysis result, refer to step S65 in FIG. 7 and the related description in step S75 in FIG. 8.

S99: Perform a shooting operation according to the determined shooting setting parameters. Specifically, after the shooting parameters are adjusted to the determined shooting setting parameters, a corresponding shooting operation is performed.

Thus, in some embodiments, the accuracy of the shooting control can be further improved by adding other inputs as a basis for judging whether or not the shooting conditions are met.

Optionally, before the first step of the shooting control method in any of the embodiments of FIG. 1 to FIG. 10, the method may further include: training the model to obtain the trained model.

Please refer to FIG. 11 , which is a flowchart of a model training process in a shooting control method according to an embodiment of the present application. As shown in FIG. 11, the model training process may include the following steps:

S101: When the user performs manual control shooting, the currently captured picture is taken as a positive sample satisfying the shooting condition by the model, and the parameters of the model itself are adjusted according to the positive sample of the current time.

In some embodiments, the model saves the positive samples and establishes or updates the positive samples and the correspondence that satisfies the shooting conditions to adjust the parameters of the model itself. Among them, the photographing condition can be marked as a label of the front sample.

Optionally, in one implementation, the user manually controls the shooting to be done by pressing a shutter button or a photo icon.

Optionally, in another implementation, the user manually controls the shooting to be performed by performing a specific operation on a physical button of the electronic device. For example, the electronic device includes a power button, and manual control shooting is achieved by double-clicking the power button.

S103: sample the frame frame that is not manually controlled by the model by using a preset rule as a reverse sample, and adjust the parameters of the model according to the reverse sample.

Optionally, in an implementation manner, sampling, by using a model, a frame frame that is not manually controlled to be taken as a reverse sample by using a preset rule includes: sampling a frame frame that is framing for a period of time after the front sample as a reverse sample.

Optionally, in another implementation manner, sampling, by using a preset rule, a frame frame that is not manually controlled to be taken as a reverse sample, includes: sampling a frame frame that is framing for a period of time before the front sample as a reverse sample. Wherein, when the picture frame that is framing within a certain period of time before the front sample is sampled, the shooting framing picture is automatically intercepted in advance and a certain number of pending samples are stored. After the manual control shooting, the non-manual control shooting is determined. The sample is determined to be the reverse sample.

Optionally, in some implementation manners, the frame frame that is not manually controlled may also be obtained as a reverse sample by random sampling.

Optionally, in other embodiments, the sampling is determined by an additional sensor, such as a photosensitive or acoustic sensor to collect ambient light or sound to determine the sampling, and the sampled picture frame is used as a negative sample.

Optionally, in other implementation manners, the image frame that is not manually controlled is sampled by the model as a reverse sample by using a preset rule, including: collecting a frame frame that is not manually controlled, further analyzing factors such as composition, and then determining whether to sample. For the reverse sample.

Optionally, in another implementation, in some embodiments, sampling the frame frame that is not manually controlled by the model by using a preset rule as the reverse sample includes: sampling two adjacent manual control shots at preset time intervals The picture frame obtained by the framing is taken as the reverse sample.

In some embodiments, the model may save the sampled back samples, and may also establish a correspondence between the back samples and the photographing conditions to adjust the parameters of the model itself. The reverse sample is a picture that does not satisfy the shooting condition; the label that does not satisfy the shooting condition can be marked as a label of the reverse sample. The preset time interval can be 1 second, 2 seconds, and the like.

Optionally, in one implementation, two adjacent manual control shots may be two adjacent manual control shots during the framing shot performed by the same camera opening.

Optionally, in another implementation manner, the two adjacent manual control shots may also be two different manual control shots during the framing shooting. For example, after the user turns on the camera and completes the first manual control shooting, the camera is turned off, and the next time the camera is turned on to complete the second manual control shooting, the framing screen between the first manual control shooting and the second manual control shooting is The currently used model is saved at a preset time interval as a negative sample.

S105: When it is determined that the training completion condition is reached, the training is ended, and the trained model is obtained for subsequent automatic shooting control.

Optionally, in an implementation manner, before step S101, the method further includes the step of: controlling the electronic device to enter the model training mode in response to the user input entering the model training. Determining that the training completion condition is reached includes: determining that the training completion condition is reached in response to the user-entered operation of the exit model training mode.

Optionally, the operations of entering the model training include a selection operation of the menu option, or a specific operation on the physical button, or a specific touch gesture input on the touch screen of the electronic device. Optionally, in response to the user-entered operation of entering the model training, the control electronic device enters the model training mode, including: responding to the user's selection operation of the menu option, or performing a specific operation on the physical button, or inputting on the touch screen of the electronic device. The specific touch gesture controls the electronic device to enter the model training mode.

Optionally, in another implementation manner, determining that the training completion condition is reached includes: determining that the training completion condition is reached when it is determined that the number of times the user manually controls the shooting reaches the preset number of times N1. The preset number of times N1 may be the number of times the system default model training needs to be executed, or may be a user-defined value.

Optionally, in another implementation manner, determining that the training completion condition is reached includes: using the positive sample of the current time to test the model, determining whether the test result reaches a preset threshold, and determining that the training result is reached after the test result reaches a preset threshold. Complete the conditions.

The above model may be a model such as a neural network model or an image processing algorithm model.

In the present application, the trained model is obtained by training the model in advance, and when the user turns on the camera for shooting, the shooting can be automatically controlled according to the trained model, and the satisfactory picture desired by the user can be captured in time.

Please refer to FIG. 12 , which is a flowchart of a model training process in a shooting control method according to another embodiment of the present application. As shown in FIG. 12, the model training process may include the following steps:

S111: Perform a framing preview in response to the opening operation of the camera to obtain a shooting preview screen.

In some embodiments, the step S111 specifically includes: after the automatic shooting function is turned on, performing a framing preview in response to the opening operation of the camera to obtain a shooting preview screen. That is, the model training process shown in FIG. 12 can be performed after the automatic shooting function is turned on.

Alternatively, in some embodiments, turning on the automatic shooting function may be accomplished in response to a user setting operation in a menu option of the camera.

Optionally, in other embodiments, turning on the automatic shooting function may also be performed in response to the user's specific touch gesture on the touch screen of the electronic device, for example, in response to double-clicking on the touch screen of the electronic device through the knuckles After the completion.

It can be understood that the photographing control method shown in any one of the embodiments 1 to 10 in the present application can be performed after the automatic shooting function is turned on by the electronic device.

S113: When it is determined according to the preset model that the shooting condition is satisfied, the control performs a shooting operation.

Step S113 corresponds to step S17 in the first embodiment shown in FIG. 1 and step S25 in the second embodiment shown in FIG. 2 . For specific implementation, refer to step S17 in FIG. 1 and other implementations. A description of the relevant steps in the example.

S115: Acquire user satisfaction feedback information about the automatic shooting.

Optionally, in an implementation manner, after the automatic photographing is completed, the user may be prompted to perform satisfaction evaluation on the automatic photographing by generating prompt information, for example, generating a prompt box including “satisfactory” and “unsatisfactory” options. For the user to select, and according to the user's choice, the satisfaction feedback information of the automatic photographing is obtained.

Optionally, in another embodiment, the user's satisfaction with the automatic shooting is obtained by detecting the user's operation on the photo or video obtained by the automatic shooting. For example, if it is detected that the user deletes the photo or video obtained by the automatic shooting, it is determined that the user is not satisfied with the automatic shooting, and the satisfaction feedback information that is unsatisfactory is obtained. For example, if it is detected that the user has set a photo or video obtained by the automatic shooting to a favorite or favorite type setting operation or a sharing operation, it is determined that the user is satisfied with the automatic shooting, and obtains I got feedback on satisfaction with satisfaction.

S117: Output the satisfaction feedback information of the user to the current automatic shooting to the currently used model, so that the currently used model uses the satisfaction feedback information for optimal training.

Therefore, in the present application, by collecting user satisfaction feedback information for automatic shooting, the training of the model can be optimized, and the model is continuously optimized, so that the automatic shooting in subsequent use can be more accurate.

Among them, the currently used model may be a model that has been confirmed by training, or a model that has not been trained yet. When it is confirmed that the training is completed, the model can be further optimized. When the model is not yet trained, the training can be better achieved.

Correspondingly, the steps S111 S S117 in FIG. 12 can be performed after the step S105 in FIG. 11 , and can also be performed before the step S105 in FIG. 11 , and can even be performed before the step S101 in FIG. 11 . When executed before step S101, the currently used model may be an untrained initial model.

The preset model in any one of the embodiments 1 to 10 as described above may also be an untrained model, and after the user starts the automatic shooting function, the automatic shooting is performed according to the current model, and according to The feedback feedback from the user feedback optimizes and trains the current model.

In some embodiments, when the preset model is an untrained model, the untrained model automatically acquires a picture each time the user performs shooting, and performs training as a frontal sample, or further acquires a shooting setting parameter at the time of shooting. The training is performed as a positive sample, and the preset model is gradually optimized until the number of training reaches a preset number of times or the satisfaction feedback information of subsequent user feedback is a satisfactory ratio exceeding a preset ratio, and the training is determined to be completed. In this way, since the user himself trains the model without using another person's model, personalization can be better achieved.

Please refer to FIG. 13 , which is a flowchart of a model training process in a shooting control method according to still another embodiment of the present application. As shown in FIG. 13, the model training process may include the following steps:

S121: When the user performs manual control shooting, the model takes the currently photographed screen as a positive sample corresponding to the photographing condition and the photographing setting parameter, and adjusts the model's own parameters according to the current front sample.

In some embodiments, the model saves the front samples and establishes or updates the front samples and the correspondences that satisfy the shooting conditions and the shooting settings parameters to adjust the parameters of the model itself. Among them, the shooting conditions and the shooting setting parameters can be marked as labels of the front samples at the same time.

The shooting setting parameters may include parameters such as aperture size, shutter time, and sensitivity.

S123: The screen frame that is not manually controlled is sampled by the model as a reverse sample by using a preset rule, and the parameters of the model itself are adjusted according to the reverse sample.

S125: When it is determined that the training completion condition is reached, the training is ended, and the trained model is obtained.

Step S123 and step S125 correspond to step S103 and step S105 in FIG. 11, respectively. For specific introduction, reference may be made to the description of step S103 and step S105 in FIG.

Therefore, in another embodiment, by the training of the model, not only the correspondence between the picture as the front sample and the shooting condition is established, but the correspondence between the picture as the front sample and the shooting setting parameter is established, and when the automatic shooting is subsequently started, It is possible to automatically determine whether the shooting conditions are satisfied and the setting of the shooting setting parameters can be automatically performed.

Please refer to FIG. 14 , which is a block diagram showing a schematic partial structure of an electronic device 100 according to an embodiment of the present application. As shown in FIG. 14, the electronic device 100 includes a processor 10, a memory 20, and a camera 30. The camera 30 includes at least a rear camera 31 and a front camera 32. The rear camera 31 is used to capture an image behind the electronic device 100, and can be used for a user to take a shooting operation such as a person. The front camera 32 is used to capture an image in front of the electronic device 100, and can be used to perform a self-photographing and the like.

In some embodiments, the models in FIGS. 1-13 may be programs such as specific algorithm functions running in processor 10, such as neural network algorithm functions, image processing algorithm functions, and the like. In other embodiments, the electronic device 100 may further include a model processor that is independent of the processor 10. The models in FIGS. 1 to 13 are in the operation and model processors, and the processor 10 may generate corresponding instructions as needed. The trigger model processor runs the corresponding model, and the output result of the model is output to the processor 10 through the model processor for use by the processor 10, and control such as a shooting operation is performed.

Program instructions are stored in the memory 20.

The processor 10 is configured to call a program instruction stored in the memory 20 to execute the photographing control method in any of the embodiments shown in FIGS. 1 to 9, and perform photographing control in any of the embodiments as shown in FIGS. 10 to 12. The model training process in the method.

For example, the processor 10 is configured to call a program instruction stored in the memory 20 to execute the following shooting control method:

Obtaining a shooting preview screen through the camera 30;

The analysis result is obtained by analyzing the shooting preview screen by using a preset model;

According to the analysis result, it is determined whether the shooting condition is currently satisfied;

When it is determined that the shooting conditions are satisfied, the control performs a shooting operation.

In some embodiments, the processor 10, when the calling program instruction is executed to determine whether the shooting condition is currently satisfied according to the analysis result, is further invoked to execute the program instruction: determining a shooting setting parameter including at least one of a shutter time and an aperture size according to the analysis result. .

The processor 10 controls to perform a photographing operation when it is determined that the photographing condition is satisfied, and further includes the processor 10 performing a photographing operation according to the determined photographing setting parameter when determining that the photographing condition is satisfied.

The processor 10 can be a microcontroller, a microprocessor, a single chip microcomputer, a digital signal processor, or the like.

The memory 20 can be any storage device that can store information such as a memory card, a solid state memory, a micro hard disk, an optical disk, or the like.

As shown in FIG. 14, the electronic device 100 further includes an input unit 40 and an output unit 50. The input unit 40 may include a touch panel, a mouse, a microphone, a physical button including a power key, a volume key, and the like. The output unit 50 can include a display screen, a speaker, and the like. In some embodiments, the touch panel of the input unit 40 and the display screen of the output unit 50 are integrated to form a touch screen while providing the functionality of touch input and display output.

The electronic device 100 can be a portable electronic device having a camera 30, such as a mobile phone, a tablet computer, or a notebook computer, and can also be a camera device such as a camera or a video camera.

In some embodiments, the present application further provides a computer readable storage medium, where a plurality of program instructions are stored in the computer readable storage medium, and the program instructions are executed by the main processing unit 20, and executed as shown in FIG. 1-13. All or part of the steps in any of the shooting control methods. In some embodiments, the computer storage medium is the memory 20, and may be any storage device that can store information such as a memory card, a solid state memory, a micro hard disk, an optical disk, or the like.

The photographing control method and the electronic device 100 of the present application can automatically determine whether the photographing condition is satisfied according to the photographing preview screen, and perform photographing when the photographing condition is satisfied, and can capture the highlight moment including the content corresponding to the current photographing preview screen in time.

Although the present invention has been described herein in connection with the embodiments of the present invention, those skilled in the art can understand and implement the disclosure by the drawings, the disclosure, and the appended claims. Other variations of the embodiments. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill several of the functions recited in the claims. Certain measures are recited in mutually different dependent claims, but this does not mean that the measures are not combined to produce a good effect.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, apparatus (device), or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code. The computer program is stored/distributed in a suitable medium, provided with other hardware or as part of the hardware, or in other distributed forms, such as over the Internet or other wired or wireless telecommunication systems.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of the methods, apparatus, and computer program products of the embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The above disclosure is only an embodiment of the present application, and of course, the scope of the application should not be limited thereto, and those skilled in the art can understand all or part of the process of implementing the above embodiments, and according to the claims of the present application. The equivalent change is still within the scope of the application.

Claims

A shooting control method, characterized in that the shooting control method comprises:

Get a preview of the shot;

The shooting preview screen is analyzed by using a preset model to obtain an analysis result;

Determining whether the shooting condition is currently satisfied according to the analysis result;

When it is determined that the shooting conditions are satisfied, the control performs a shooting operation.
The photographing control method according to claim 1, wherein the preset model is a trained neural network model; and the analyzing the photographed preview image by using a preset model to obtain an analysis result, comprising:

The captured preview image is analyzed by the trained neural network model, and the analysis result of satisfaction is obtained;

Determining, according to the analysis result, whether the current shooting condition is met, including:

When it is determined that the satisfaction exceeds the satisfaction preset threshold, it is determined that the shooting condition is currently satisfied.
The photographing control method according to claim 1, wherein the preset model is a trained image processing algorithm model, and the analyzing the photographed preview image by using the preset model to obtain an analysis result, comprising:

The trained image processing algorithm model is used to compare the shooting preview image with the reference image, and analyze the analysis result of the similarity between the shooting preview image and the reference image;

Determining, according to the analysis result, whether the current shooting condition is met, including:

When it is determined that the similarity exceeds the similarity preset threshold, it is determined that the shooting condition is currently satisfied.
The photographing control method according to claim 1, wherein the preset model is a trained image processing algorithm model, and the trained image processing algorithm model includes a target object feature model, and the preset model is used The shooting preview screen is analyzed to obtain the analysis results, including:

Using the image recognition technology to analyze the target object in the preview image to generate a corresponding target object feature vector;

Using the target object feature vector as the input information of the trained image processing algorithm model, and obtaining an analysis result including the identification information that identifies whether the shooting condition is currently satisfied;

According to the analysis results, it is determined whether the shooting conditions are currently met, including:

When the analysis result includes identifying the identification information that currently satisfies the shooting condition, it is determined that the shooting condition is currently satisfied.
The photographing control method according to claim 1, wherein the photographing operation is a continuous shooting operation, and the controlling performs a photographing operation, comprising: controlling to perform a continuous shooting operation, and obtaining a photograph corresponding to the current photographing preview screen. Multiple photos.
The photographing control method according to claim 5, wherein the photographing control method further comprises:

Analyzing a plurality of photos obtained by the continuous shooting operation to determine an optimal photo;

The best photo is retained, and other photos obtained by the continuous shooting operation are deleted.
The photographing control method according to claim 1, wherein the photographing operation is a video photographing operation, and the controlling performs a photographing operation, comprising: controlling to perform a video photographing operation, and obtaining a current photographed preview screen as a start video. The video file of the picture frame.
The photographing control method according to claim 7, wherein the photographing control method further comprises:

Comparing a plurality of video picture frames in the captured video file to determine an optimal picture frame;

The best picture frame is cut out and saved as a photo.
The photographing control method according to claim 1, wherein the analyzing the photographing preview screen to obtain an analysis result further comprises:

The video stream formed by the preview picture is analyzed by using a preset model to obtain an analysis result.
The photographing control method according to any one of claims 1 to 9, wherein the method further comprises:

Obtaining satisfaction feedback information that the user gives feedback on the photos or videos obtained by performing the shooting operation;

And outputting the satisfaction feedback information to the preset model, so that the preset model performs optimization training by using the satisfaction feedback information.
An electronic device, the electronic device comprising:

camera;

a memory for storing program instructions;

a processor for invoking the program instruction to perform the photographing control method according to any one of claims 1-10.
A computer readable storage medium, wherein the computer readable storage medium stores program instructions for performing a shooting control according to any one of claims 1 to 10 after being invoked by a computer method.