WO2019091486A1

WO2019091486A1 - Photographing processing method and device, terminal, and storage medium

Info

Publication number: WO2019091486A1
Application number: PCT/CN2018/115226
Authority: WO
Inventors: 陈岩
Original assignee: Oppo广东移动通信有限公司
Priority date: 2017-11-13
Filing date: 2018-11-13
Publication date: 2019-05-16
Also published as: CN107770451A

Abstract

Disclosed in the embodiments of the present application are a photographing processing method and device, a terminal, and a storage medium, belonging to the field of computer technologies. Said method comprises: receiving a photographing instruction; if the current zoom magnification of a camera is greater than a preset threshold, continuously photographing multiple frames according to the photographing instruction; and performing anti-shake synthesis processing on the multiple frames, so as to obtain a target picture. The embodiments of the present application can improve the definition of a photographed picture.

Description

Photo processing method, device, terminal and storage medium

The present application claims the priority of the Chinese patent application filed on November 13, 2017, the application number is 201711116497.3, and the invention is entitled "method, device, terminal and storage medium for photographing processing", the entire contents of which are incorporated by reference. In the embodiment of the present application.

Technical field

The embodiments of the present invention relate to the field of computer technologies, and in particular, to a method, an apparatus, a terminal, and a storage medium for photographing processing.

Background technique

With the popularity of smartphones, more and more users are using smartphones to take pictures. The use of a smartphone to take pictures is simple and easy to use.

When the user wants to use the smartphone to shoot, the user first turns on the camera function, and then on the screen of the smartphone, you can see the picture captured by the lens. By viewing the screen, the user adjusts the direction of the smartphone until it is determined that the target subject is clear and in the proper position. By clicking the shooting option, the smartphone can take a picture of the target subject. When the user wants to shoot a distant subject, the user can increase the zoom factor, enlarge the proportion of the subject in the picture, and then click the shooting option to shoot.

Summary of the invention

The embodiment of the present application provides a method, a device, a terminal, and a storage medium for photographing processing, which can improve the sharpness of a captured picture. The technical solution is as follows:

In one aspect, a method of photographing processing is provided, the method comprising:

Receiving a photographing instruction;

If the current zoom magnification of the camera is greater than a preset threshold, continuously capturing a plurality of frames according to the photographing instruction;

Performing anti-shake synthesis processing on the multi-frame picture to obtain a target picture.

In another aspect, an apparatus for photographing processing is provided, the apparatus comprising:

a receiving module, configured to receive a photographing instruction;

a shooting module, configured to continuously capture a plurality of frames according to the photographing instruction when a current zoom ratio of the camera is greater than a preset threshold;

The processing module is configured to perform anti-shake synthesis processing on the multi-frame picture to obtain a target picture.

In another aspect, a terminal is provided, the terminal comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or a set of instructions, the at least one instruction, A method of loading, and executing, at least a portion of a program, the set of codes, or a set of instructions by the processor to implement the photographing process described in the above aspects.

In another aspect, a computer readable storage medium is provided, wherein the storage medium stores at least one instruction, at least one program, a code set, or a set of instructions, the at least one instruction, the at least one program The method of photographing processing as described in the above aspect is implemented when the code set or instruction set is loaded and executed by a processor.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.

1 is a flowchart of a method for photographing processing provided by an embodiment of the present application;

2 is an interface diagram of a photographing process provided by an embodiment of the present application;

3 is a flowchart of a method for photographing processing provided by an embodiment of the present application;

4 is an interface diagram of a photographing process provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of an apparatus for photographing processing according to an embodiment of the present application; FIG.

FIG. 6 is a schematic structural diagram of a method for photographing processing according to an embodiment of the present application;

FIG. 7 is a structural block diagram of a terminal according to an embodiment of the present application.

Detailed ways

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

The embodiment of the present application provides a method, an apparatus, a terminal, and a storage medium for photographing processing, and the method can be implemented by a terminal. The terminal can be a smart phone, a tablet, or the like.

The terminal may include components such as a processor, a memory, a screen, an image detecting component, and the like. The processor can be a CPU (Central Processing Unit), etc., and can be used to process photographing instructions, call and run an anti-shake synthesis algorithm, and control screen display pictures. The memory may be a RAM (Random Access Memory), a Flash (flash memory), etc., and may be used to store received data, data required for processing, data generated during processing, and the like, such as a zoom factor. Preset threshold, ambient light intensity, and correspondence table between zoom magnification and exposure and number of shot frames, multi-frame images captured, and the like. The screen can be a touch screen, and can be used to display an image that the camera can capture, a target image that is captured, and the like. The image detecting unit may be a camera or the like.

The terminal may also include a transceiver, an audio output component, an audio input component, and the like. The transceiver can be used for data transmission with other devices, and can include an antenna, a matching circuit, a modem, and the like. The audio output unit can be a speaker, a headphone, or the like. The audio input component can be a microphone or the like.

In order to reflect the details of the subject (or to shoot distant objects), when using the terminal for shooting, the user usually uses the zoom function of the terminal to increase the zoom factor of the terminal camera, thereby enlarging the details of the subject. However, as the zoom factor of the camera increases, the slight jitter during shooting is also amplified, affecting the sharpness of the captured photo.

In the related art, in order to improve the photographing quality of a photograph in a zoom scene, the terminal usually solves the anti-shake problem by means of an OIS (Optical Image Stabilization) device or an image sharpening algorithm. However, the OIS device has a higher cost of anti-shake, and the image sharpening algorithm does not have the effect of anti-shake.

In the embodiment of the present application, in the zoom shooting scene, when the zoom ratio is high, the terminal continuously captures multiple frames of pictures, and performs anti-shake synthesis processing on the multi-frame pictures, thereby finally generating a picture with higher definition and reducing the user's shooting. The effect of jitter on picture quality.

The processing flow shown in FIG. 1 will be described in detail below with reference to the embodiments, and the content can be as follows:

In step 101, the terminal receives a photographing instruction.

In the implementation, when the user wants to use the smart phone to take a picture, the user can turn on the camera function of the smart phone, and through the screen of the smart phone, as shown in FIG. 2, the user can see the image that the camera can capture. If the user wants to shoot a relatively distant subject, the user can manually adjust the zoom factor of the camera in the smartphone to enlarge the image of the subject. In this process, the user can observe whether the image of the shooting target to be photographed conforms to his or her mind through the screen of the smartphone. When the user feels satisfied, he can click the camera option, and the terminal will receive the photographing instruction.

In step 102, if the current zoom magnification of the camera is greater than a preset threshold, the terminal continuously captures a plurality of frames according to the photographing instruction.

In the implementation, after the terminal receives the photographing instruction, the terminal may detect the current zoom factor of the camera, and acquire a preset threshold of the zoom factor stored in advance, and compare the current zoom factor of the camera with a preset preset threshold.

If the current zoom magnification of the camera is less than the preset threshold, the terminal may determine the current photographing parameters, such as aperture, shutter speed, sensitivity, white balance, and the like when receiving the photographing instruction. At this time, the terminal can obtain the camera parameters set by the user, and can also calculate the camera parameters based on the preset algorithm and the environment parameters. Then, take a picture based on the camera parameters.

If the current zoom ratio of the camera is greater than or equal to the preset threshold, the terminal may acquire the photographing parameter set by the user, or calculate the photographing parameter based on the preset algorithm and the environment parameter, and then continuously capture the multi-frame image based on the photographing parameter. The specific frame number of the multi-frame picture can be preset and stored in the terminal memory by the technician, or the specific frame number of the multi-frame picture can also be determined based on the current shooting parameters, which is not limited herein.

The preset threshold of the pre-stored zoom factor may be a value set by the user, or may be a value obtained by a technician according to a plurality of test results, and the value is a critical value. When the smartphone increases the zoom factor for shooting, the details of the picture will be enlarged. When the user clicks on the shooting option, the hand will slightly vibrate, which will cause slight jitter of the phone, and this slight jitter will blur the picture, making The sharpness of the captured picture is reduced. When the zoom magnification of the camera is greater than the critical value, the sharpness of the picture taken without the anti-shake processing does not satisfy the requirements of the majority of the user for the sharpness of the picture. When the zoom magnification of the camera is less than the critical value, the sharpness of the picture taken without the anti-shake processing can satisfy the user's requirement for the sharpness of the picture.

In a possible implementation manner, as shown in FIG. 3, this step may include the following steps.

Step 102A: If the current zoom magnification of the camera is greater than the preset threshold, determining a second shooting parameter according to the first shooting parameter, where the first shooting parameter includes a current zoom factor, and the second shooting parameter includes a target shooting frame number, and the target shooting The number of frames is the number of frames of a multi-frame picture.

Optionally, the first shooting parameter includes at least a current zoom factor of the camera, and the second shooting parameter includes at least a target shooting frame of the continuously captured multi-frame picture, and the current zooming ratio of the camera is positively correlated with the target shooting frame number. That is, the larger the zoom magnification, the more the number of consecutively taken picture frames.

Step 102B: continuously capture a plurality of frames according to the second shooting parameter.

According to the determined second shooting parameter, the terminal continuously captures the picture of the target shooting frame number when receiving the photographing instruction, so as to perform anti-shake synthesis processing on the multi-frame image obtained by the shooting.

Illustratively, when the preset threshold of the zoom magnification is 4 times and the current zoom magnification of the camera is 8 times, the terminal determines that the number of target shooting frames is 4 frames according to the current zoom magnification, so that when the photographing instruction is received, Take 4 frames of pictures in succession.

In step 103, anti-shake synthesis processing is performed on the multi-frame picture to obtain a target picture.

Optionally, corresponding to the foregoing steps 102A and 102B, as shown in FIG. 3, the step includes the step 103A: the terminal performs anti-shake synthesis processing on the picture of the target number of frames to obtain a target picture.

Wherein, when performing anti-shake synthesis processing on the picture of the target shooting frame number, the following steps may be included:

First, determine the center picture and the remaining pictures in the picture of the target number of frames, the center picture is the picture with the highest resolution in the picture of the target number of frames, and the rest of the pictures are pictures with a higher definition than the definition threshold except the center picture. .

In the implementation, after taking a multi-frame picture, an anti-shake synthesis algorithm is invoked, and in the multi-frame picture, one of the picture pictures is selected as the center picture according to a preset selection condition. For example, the preset selection condition may be selecting multiple frames. The clearest picture in the picture. Then, the resolution of the remaining multi-frame pictures is analyzed, and the picture in which the definition is lower than the preset definition threshold is determined as an invalid picture, and the invalid picture is deleted, thereby obtaining the remaining pictures.

Second, split the center picture and the rest of the picture.

Optionally, the terminal divides the central picture and the remaining pictures according to a preset segmentation manner, and is divided into multiple parts, and the central picture is completely divided with the remaining pictures. The embodiment of the present application does not limit the manner in which the picture is divided.

For example, the terminal divides the center picture and the remaining pictures into 10 picture blocks of 10×10.

3. If the resolution of the target picture part in the remaining pictures is higher than the definition of the target picture part in the center picture, the target picture part of the center picture is processed according to the target picture part in the remaining pictures.

Optionally, each part of the center detection center picture corresponding to the remaining pictures, for any part of the center picture, determining whether the part in the remaining picture is clearer than the part in the center picture, if the remaining pictures are in the picture The portion of the central image is processed based on the portion of the remaining pictures, wherein the processing includes at least one of brightness compensation and partial replacement.

4. Determine the processed center image as the target image.

After processing each picture part in the center picture, the terminal determines the processed center picture as the target picture.

In summary, in the embodiment of the present application, when the terminal receives the photographing instruction, it determines whether the current zoom magnification of the camera is greater than a preset threshold, and when the zoom magnification is greater than the preset threshold, continuously captures multiple frames according to the photographing instruction, thereby Performing anti-shake synthesis processing on the multi-frame picture to obtain a target picture with higher definition; using the photographing processing method provided by the embodiment of the present application, when the zoom magnification is increased for shooting, the picture blurred due to slight jitter of the user passes through After the anti-shake synthesis process, a clearer picture can be obtained, which improves the sharpness of the picture taken in the zoom shooting scene.

Optionally, when the user does not want the image after the anti-shake processing, the anti-shake processing may be cancelled, and the image obtained according to the regular photographing manner may be retained, and the corresponding processing may be as follows: displaying the target image and displaying the un-anti-shake option; When the click command for the anti-shake option is cancelled, the first frame image in the multi-frame picture is used to replace the target picture.

In the implementation, after obtaining the target picture through the above processing, the terminal displays the target picture to the user. While the target image is displayed, the Undo Anti Shake option can be displayed. If the user wants to go through the anti-shake target image, the user can directly save the target image. If the user does not want the target image after anti-shake processing, but wants the original image without anti-shake processing, for example, the user wants to capture the dynamic effect of water flow, the dynamic effect of this water flow is actually the dynamic of the water flow. Blurring, and the image obtained by anti-shake processing will eliminate this blurring effect, so the target image does not achieve the desired effect of the user, but the original image after anti-shake processing has such an effect. In this case, the user can click to undo the anti-shake option, as shown in Figure 4. After receiving the click command of the undo anti-shake option, the terminal acquires the first frame image in the captured multi-frame picture in the buffer area, and replaces the target picture with the first frame picture. Then, the first frame picture is displayed to the user. After the user sees the picture, if you are satisfied with the picture, you can choose to store it. If you are not satisfied, you can choose to delete and retake the picture.

In a possible implementation manner, when the first shooting parameter includes a current zoom factor and a current ambient light parameter (which may be ambient light intensity), the determined second shooting parameter includes a target shooting frame number and a target exposure degree. The step 102A may include the following steps: if the current zoom factor of the camera is greater than the preset threshold, determining the target exposure degree and the target shooting frame number according to the corresponding relationship between the first shooting parameter and the second shooting parameter stored in advance; Step 102B may include the step of continuously capturing a picture of the number of target shooting frames based on the target exposure.

In the implementation, the technician performs experiments according to different exposure degrees and shooting frames in different ambient light intensities and different zoom magnification scenarios. For example, a technician can take a photo at a certain exposure and a certain number of frames in a scene with a certain ambient light intensity and a zoom factor, and then keep the ambient light intensity, zoom factor, and number of shots unchanged. Exposure, take pictures according to the adjusted exposure, adjust the exposure, and then take the picture according to the adjusted exposure, repeat the above process, test the exposure value in the range of values, and select all The best picture in the picture determines the exposure of the picture. Then, you can determine the ambient light intensity and the exposure and the number of frames for the zoom factor, which can make the picture taken best. According to the above process, after a lot of experiments, the technician can get the corresponding exposure degree and the number of shooting frames in the scene of any ambient light intensity and zoom magnification, and shooting with the exposure degree and the number of shooting frames can make the picture better. . The technician stores the correspondence in the terminal and can store it in the form of a correspondence table, as shown in Table 1.

Table 1

When detecting that the current zoom magnification of the camera is greater than or equal to the preset threshold, the terminal detects the ambient light intensity of the current shooting environment, and then, the terminal acquires a correspondence table of the pre-stored ambient light intensity, zoom magnification, exposure, and number of shot frames. . Then, the terminal may search for the current ambient light intensity and the exposure degree and the number of shooting frames corresponding to the current zoom factor of the camera (ie, the target exposure degree and the target shooting frame number) according to the correspondence table, and then, according to the target exposure degree, The currently captured picture is the first frame picture, and the picture of the target number of frames is continuously captured. For example, if the terminal detects that the ambient light intensity of the current shooting environment is 100 and the current zoom magnification of the camera is 3, according to the correspondence table described above, it can be known that the target exposure degree is +1, the target shooting frame number is 3, and then, The terminal continuously shoots 3 frames of pictures according to the target exposure.

In another possible implementation manner, when the first shooting parameter includes a current zoom factor and a current ambient light parameter (which may be ambient light intensity), the determined second shooting parameter includes a target shooting frame number and a target exposure. The step 102A may further include the following steps: if the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter and the current zoom factor into the pre-trained shooting parameter determination model to obtain the target exposure. And the target shooting frame number; correspondingly, the step 102B may further include the step of continuously capturing the picture of the target shooting frame number based on the target exposure degree.

The shooting parameter determination model is obtained through deep learning training, and is used to determine the target exposure degree and the target shooting frame number.

In the implementation, the terminal can determine the current exposure degree and the number of shooting frames based on the ambient light parameter and the zoom factor. The shooting parameter determination model can be obtained through deep learning training. The training process can be as follows:

The technicians experimented with different exposures and shooting frames in different ambient light intensities and different zoom magnifications. For example, the technician can take a picture according to a certain exposure degree and the first shooting frame number in the first ambient light intensity and the first zoom multiple, and perform a synthesis process to obtain the processed composite picture, and then keep the first The ambient light intensity, the first zoom factor, and the number of first shot frames are unchanged, the exposure is adjusted, the picture is taken according to the adjusted exposure degree, and the composite image is processed to obtain the processed composite picture, and then the exposure is adjusted, and then adjusted. After the exposure, the picture is taken and synthesized, and the processed and synthesized pictures are obtained. The above process is repeated, and the value obtained by the exposure in the range of values is tested once, and all the obtained combined pictures are selected most. a good picture (ie, the first composite picture), determining a first exposure corresponding to the first composite picture, and then determining that the first ambient light intensity and the first zoom multiple correspond to the first exposure and the first number of shots Can make the best pictures get. The first ambient light intensity, the first zoom factor, the first exposure, and the first number of shot frames are stored as a set of samples into the training set. Repeat the test according to the above process, the technician can get multiple sets of ambient light intensity, zoom factor, exposure and the number of shot frames. The ambient light intensity and zoom factor are sample input, and the exposure and number of shots are sample output. Input the ambient light intensity and zoom factor in the sample into the shooting parameter determination model to obtain the model output exposure and the model output shooting frame number, based on the obtained model output exposure and model output shooting frame number and sample exposure and sample shooting. The number of frames and the training function adjust the shooting parameter determination model, repeat the above training process, and train the shooting parameter model to obtain the trained shooting parameter model.

When detecting that the current zoom ratio of the camera is greater than or equal to the preset threshold, the terminal detects the ambient light intensity of the current shooting environment, and then inputs the ambient light intensity of the current shooting environment and the current zoom factor into the trained shooting parameter determination model. The current ambient light intensity, the target exposure corresponding to the zoom factor, and the number of target shot frames can be obtained.

In order to further improve the accuracy of the model prediction, optionally, when determining the exposure and the number of frames to be taken, the terminal moving speed may also be considered. Correspondingly, the above step 102A may further include the following steps: if the current zooming ratio of the camera is greater than the pre- When the threshold is set, the current ambient light parameter, the current zoom factor and the current terminal moving speed are input into the pre-trained shooting parameter determination model to obtain the target exposure degree and the target shooting frame number.

The terminal moving speed is a moving speed at which the user's hand shake causes the terminal to move when the user's handheld terminal performs photographing. The terminal moving speed can be measured by a gyro sensor and/or an acceleration sensor in the terminal.

In the implementation, when the shooting parameter determination model is trained according to the above steps, samples formed by multiple sets of ambient light intensity, zoom magnification, terminal moving speed, exposure, and number of shooting frames, wherein ambient light intensity, zoom magnification, and terminal movement are obtained, The speed is the sample input, the exposure and the number of frames taken are the sample output. The plurality of sets of samples are input into the shooting parameter determination model to obtain the actual exposure and the actual number of captured frames. The photographing parameter determination model is adjusted based on the obtained actual exposure and the actual number of photographed frames and the sample exposure and the number of sample shot frames and the training function. By repeating the above training process and training the shooting parameter model, a trained shooting parameter model can be obtained.

When the model is used to determine the model, when detecting that the current zoom factor of the camera is greater than or equal to the preset threshold, the terminal detects the ambient light intensity of the current shooting environment and the terminal moving speed, and then, the ambient light intensity of the current shooting environment, The current terminal moving speed and the current zoom factor are input to the trained shooting parameter determination model, and the current ambient light intensity, the zoom magnification, the target exposure speed corresponding to the terminal moving speed, and the target shooting frame number can be obtained.

Based on the same technical concept, the embodiment of the present invention further provides a device for photographing processing. As shown in FIG. 5, the device includes: a receiving module 510, a photographing module 520, and a processing module 530.

The receiving module 510 is configured to receive a photographing instruction;

The photographing module 520 is configured to continuously capture a plurality of frames according to the photographing instruction when the current zoom magnification of the camera is greater than a preset threshold;

The processing module 530 is configured to perform anti-shake synthesis processing on the multi-frame picture to obtain a target picture.

Optionally, the shooting module 520 is configured to:

If the current zoom factor of the camera is greater than the preset threshold, determining a second shooting parameter according to the first shooting parameter, where the first shooting parameter includes the current zoom factor, and the second shooting parameter includes a target shooting The number of frames, the number of target shooting frames is the number of frames of the multi-frame picture;

And continuously capturing the multi-frame picture according to the second shooting parameter;

The processing module 530 is configured to:

Performing anti-shake synthesis processing on the picture of the target number of shot frames to obtain the target picture.

Optionally, the first shooting parameter includes the current zoom factor and a current ambient light parameter, the second shooting parameter includes the target shooting frame number and a target exposure degree; the shooting module 520 is configured for:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter and the current zoom factor into a pre-trained shooting parameter determination model to obtain the target exposure and the target shooting Number of frames;

And continuously taking a picture of the number of target shooting frames based on the target exposure;

Determining, according to a pre-stored correspondence between the first shooting parameter and the second shooting parameter, a current ambient light parameter corresponding to the current zoom factor, if the current zoom factor of the camera is greater than the preset threshold The target exposure degree and the number of target shooting frames;

Optionally, the first shooting parameter further includes a current terminal moving speed, and the shooting module 520 is configured to:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter, the current zoom factor, and the current terminal moving speed into a pre-trained shooting parameter determination model to obtain the Target exposure and the number of target shot frames.

Optionally, the processing module 530 is further configured to:

Determining a center picture and a remaining picture in the picture of the target number of shot frames, wherein the center picture is the highest-definition picture in the picture of the target number of shot frames, and the remaining pictures are clear except the center picture a picture that is above the sharpness threshold;

Segmenting the center picture and the remaining pictures;

If the resolution of the target picture part in the remaining picture is higher than the definition of the target picture part in the central picture, the target picture part of the central picture is processed according to the target picture part in the remaining pictures;

The processed center picture is determined as the target picture.

Optionally, as shown in FIG. 6, the apparatus further includes:

The display module 540 is configured to display the target picture and display the undo anti-shake option;

The replacement module 550 is configured to replace the target picture with a first frame picture in the multi-frame picture when a click instruction to the undo anti-shake option is detected.

With regard to the apparatus in the above embodiments, the specific manner in which the respective modules perform the operations has been described in detail in the embodiment relating to the method, and will not be explained in detail herein.

It should be noted that, when performing the photographing processing, the apparatus for photographing processing provided by the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the function distribution may be completed by different functional modules as needed. The internal structure of the terminal is divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus for photographing processing provided by the above embodiment is the same as the method embodiment of the photographing processing, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.

Please refer to FIG. 7 , which is a schematic structural diagram of a terminal according to an embodiment of the present invention. The terminal may be used to implement the method for photographing processing provided in the foregoing embodiment. Specifically:

The terminal 700 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more computer readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, and a WiFi (wireless fidelity, wireless). The fidelity module 170 includes a processor 180 having one or more processing cores, and a power supply 190 and the like. It will be understood by those skilled in the art that the terminal structure shown in FIG. 6 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:

The RF circuit 110 can be used for transmitting and receiving information or during a call, and receiving and transmitting signals. Specifically, after receiving downlink information of the base station, the downlink information is processed by one or more processors 180. In addition, the data related to the uplink is sent to the base station. . Generally, the RF circuit 110 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier). , duplexer, etc. In addition, RF circuitry 110 can also communicate with the network and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access). , Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.

The memory 120 can be used to store software programs and modules, and the processor 180 executes various functional applications and data processing by running software programs and modules stored in the memory 120. The memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 700 (such as audio data, phone book, etc.) and the like. Moreover, memory 120 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 120 may also include a memory controller to provide access to memory 120 by processor 180 and input unit 130.

The input unit 130 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls. In particular, input unit 130 can include touch-sensitive surface 131 as well as other input devices 132. Touch-sensitive surface 131, also referred to as a touch display or trackpad, can collect touch operations on or near the user (such as a user using a finger, stylus, etc., on any suitable object or accessory on touch-sensitive surface 131 or The operation near the touch-sensitive surface 131) and driving the corresponding connecting device according to a preset program. Alternatively, the touch-sensitive surface 131 can include two portions of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 180 is provided and can receive commands from the processor 180 and execute them. In addition, the touch-sensitive surface 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 131, the input unit 130 can also include other input devices 132. Specifically, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

Display unit 140 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of terminal 700, which can be constructed from graphics, text, icons, video, and any combination thereof. The display unit 140 may include a display panel 141. Alternatively, the display panel 141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 131 may cover the display panel 141, and when the touch-sensitive surface 131 detects a touch operation thereon or nearby, it is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 according to the touch event The type provides a corresponding visual output on display panel 141. Although in FIG. 6, touch-sensitive surface 131 and display panel 141 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 131 can be integrated with display panel 141 for input. And output function.

Terminal 700 can also include at least one type of sensor 150, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may close the display panel 141 when the terminal 700 moves to the ear. / or backlight. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the terminal 700 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.

The audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the terminal 700. The audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker 161 for conversion to the sound signal output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal by the audio circuit 160. After receiving, it is converted into audio data, and then processed by the audio data output processor 180, transmitted to the terminal, for example, via the RF circuit 110, or outputted to the memory 120 for further processing. The audio circuit 160 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 700.

WiFi is a short-range wireless transmission technology, and the terminal 700 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 170, which provides wireless broadband Internet access for users. Although FIG. 6 shows the WiFi module 170, it can be understood that it does not belong to the essential configuration of the terminal 700, and may be omitted as needed within the scope of not changing the essence of the invention.

The processor 180 is the control center of the terminal 700, connecting various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120, The various functions and processing data of the terminal 700 are performed to perform overall monitoring of the mobile phone. Optionally, the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.

The terminal 700 also includes a power source 190 (such as a battery) for powering various components. Preferably, the power source can be logically coupled to the processor 180 through a power management system to manage functions such as charging, discharging, and power management through the power management system. Power supply 190 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

Although not shown, the terminal 700 may further include a camera, a Bluetooth module, and the like, and details are not described herein again. Specifically, in this embodiment, the display unit of the terminal 700 is a touch screen display, the terminal 700 further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be one or one The above processor executes the one or more programs to implement any of the above-described methods of photographing processing.

In an exemplary embodiment, there is also provided a computer readable storage medium having stored therein at least one instruction, at least one program, a code set, or a set of instructions, the at least one instruction, the at least one program, The method of implementing any of the above-described photographing processes when the code set or instruction set is loaded and executed by a processor.

A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium. The storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims

A method for photographing processing, characterized in that the method comprises:

Receiving a photographing instruction;

If the current zoom magnification of the camera is greater than a preset threshold, continuously capturing a plurality of frames according to the photographing instruction;

Performing anti-shake synthesis processing on the multi-frame picture to obtain a target picture.
The method according to claim 1, wherein if the current zoom factor of the camera is greater than a preset threshold, continuously capturing the plurality of frames according to the photographing instruction comprises:

If the current zoom factor of the camera is greater than the preset threshold, determining a second shooting parameter according to the first shooting parameter, where the first shooting parameter includes the current zoom factor, and the second shooting parameter includes a target shooting The number of frames, the number of target shooting frames is the number of frames of the multi-frame picture;

And continuously capturing the multi-frame picture according to the second shooting parameter;

Performing anti-shake synthesis processing on the multi-frame picture to obtain a target picture, including:

Performing anti-shake synthesis processing on the picture of the target number of shot frames to obtain the target picture.
The method according to claim 2, wherein the first shooting parameter comprises the current zoom factor and a current ambient light parameter, the second shooting parameter comprising the target shooting frame number and a target exposure degree ;

If the current zoom factor of the camera is greater than the preset threshold, determining the second shooting parameter according to the first shooting parameter, including:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter and the current zoom factor into a pre-trained shooting parameter determination model to obtain the target exposure and the target shooting Number of frames;

The continuously capturing the multi-frame picture according to the second shooting parameter comprises:

A picture of the number of target shooting frames is continuously captured based on the target exposure.
The method according to claim 2, wherein the first shooting parameter comprises the current zoom factor and a current ambient light parameter, the second shooting parameter comprising the target shooting frame number and a target exposure degree ;

If the current zoom factor of the camera is greater than the preset threshold, determining the second shooting parameter according to the first shooting parameter, including:

Determining the target exposure degree and the target shooting frame number according to a correspondence relationship between the first shooting parameter and the second shooting parameter stored in advance, if a current zoom ratio of the camera is greater than the preset threshold;

The continuously capturing the multi-frame picture according to the second shooting parameter comprises:

A picture of the number of target shooting frames is continuously captured based on the target exposure.
The method according to claim 3, wherein the first shooting parameter further comprises a current terminal moving speed;

If the current zoom factor of the camera is greater than the preset threshold, determining the second shooting parameter according to the first shooting parameter, including:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter, the current zoom factor, and the current terminal moving speed into a pre-trained shooting parameter determination model to obtain the Target exposure and the number of target shot frames.
The method according to any one of claims 2 to 5, wherein the anti-shake synthesis processing is performed on the picture of the target number of frames to obtain the target picture, including:

Determining a center picture and a remaining picture in the picture of the target number of shot frames, wherein the center picture is the highest-definition picture in the picture of the target number of shot frames, and the remaining pictures are clear except the center picture a picture that is above the sharpness threshold;

Segmenting the center picture and the remaining pictures;

If the resolution of the target picture part in the remaining picture is higher than the definition of the target picture part in the central picture, the target picture part of the central picture is processed according to the target picture part in the remaining pictures;

The processed center picture is determined as the target picture.
The method according to any one of claims 1 to 5, wherein the method further comprises:

Displaying the target image and displaying the undo anti-shake option;

When a click command to the undo anti-shake option is detected, the target picture is replaced with a first frame picture in the multi-frame picture.
A device for photographing processing, characterized in that the device comprises:

a receiving module, configured to receive a photographing instruction;

a shooting module, configured to continuously capture a plurality of frames according to the photographing instruction when a current zoom ratio of the camera is greater than a preset threshold;

The processing module is configured to perform anti-shake synthesis processing on the multi-frame picture to obtain a target picture.
The apparatus according to claim 8, wherein the photographing module is configured to:

If the current zoom factor of the camera is greater than the preset threshold, determining a second shooting parameter according to the first shooting parameter, where the first shooting parameter includes the current zoom factor, and the second shooting parameter includes a target shooting The number of frames, the number of target shooting frames is the number of frames of the multi-frame picture;

And continuously capturing the multi-frame picture according to the second shooting parameter;

The processing module is configured to:

Performing anti-shake synthesis processing on the picture of the target number of shot frames to obtain the target picture.
The apparatus according to claim 9, wherein said first photographing parameter comprises said current zoom factor and current ambient light parameter, said second photographing parameter comprising said target photographing frame number and target exposure degree ;

The shooting module is further configured to:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter and the current zoom factor into a pre-trained shooting parameter determination model to obtain the target exposure and the target shooting Number of frames;

A picture of the number of target shooting frames is continuously captured based on the target exposure.
The apparatus according to claim 9, wherein said first photographing parameter comprises said current zoom factor and current ambient light parameter, said second photographing parameter comprising said target photographing frame number and target exposure degree ;

The shooting module is further configured to:

Determining, according to a pre-stored correspondence between the first shooting parameter and the second shooting parameter, a current ambient light parameter corresponding to the current zoom factor, if the current zoom factor of the camera is greater than the preset threshold The target exposure degree and the number of target shooting frames;

A picture of the number of target shooting frames is continuously captured based on the target exposure.
The device according to claim 10, wherein the first shooting parameter further comprises a current terminal moving speed, and the shooting module is further configured to:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter, the current zoom factor, and the current terminal moving speed into a pre-trained shooting parameter determination model to obtain the Target exposure and the number of target shot frames.
The device according to any one of claims 9 to 12, wherein the processing module is configured to:

Determining a center picture and a remaining picture in the picture of the target number of shot frames, wherein the center picture is the highest-definition picture in the picture of the target number of shot frames, and the remaining pictures are clear except the center picture a picture that is above the sharpness threshold;

Segmenting the center picture and the remaining pictures;

If the resolution of the target picture part in the remaining picture is higher than the definition of the target picture part in the central picture, the target picture part of the central picture is processed according to the target picture part in the remaining pictures;

The processed center picture is determined as the target picture.
The device according to any one of claims 8 to 12, wherein the device further comprises:

a display module, configured to display the target image, and display an undo anti-shake option;

And a replacement module, configured to replace the target picture by using a first frame picture in the multi-frame picture when a click instruction to the undo anti-shake option is detected.
A terminal, comprising: a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or a command set, the at least one instruction, the at least one program, and the The code set or instruction set is loaded and executed by the processor to implement the following method:

Receiving a photographing instruction;

If the current zoom magnification of the camera is greater than a preset threshold, continuously capturing a plurality of frames according to the photographing instruction;

Performing anti-shake synthesis processing on the multi-frame picture to obtain a target picture.
The terminal according to claim 15, wherein the processor is configured to:

If the current zoom factor of the camera is greater than the preset threshold, determining a second shooting parameter according to the first shooting parameter, where the first shooting parameter includes the current zoom factor, and the second shooting parameter includes a target shooting The number of frames, the number of target shooting frames is the number of frames of the multi-frame picture;

And continuously capturing the multi-frame picture according to the second shooting parameter;

Performing anti-shake synthesis processing on the picture of the target number of shot frames to obtain the target picture.
The terminal according to claim 16, wherein the first shooting parameter comprises the current zoom factor and a current ambient light parameter, and the second shooting parameter comprises the target shooting frame number and a target exposure degree. ;

The processor is further configured to:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter and the current zoom factor into a pre-trained shooting parameter determination model to obtain the target exposure and the target shooting Number of frames;

A picture of the number of target shooting frames is continuously captured based on the target exposure.
The terminal according to claim 16, wherein the first shooting parameter comprises the current zoom factor and a current ambient light parameter, and the second shooting parameter comprises the target shooting frame number and a target exposure degree. ;

The processor is further configured to:

Determining the target exposure degree and the target shooting frame number according to a correspondence relationship between the first shooting parameter and the second shooting parameter stored in advance, if a current zoom ratio of the camera is greater than the preset threshold;

A picture of the number of target shooting frames is continuously captured based on the target exposure.
The terminal according to claim 16, wherein the first shooting parameter further comprises a current terminal moving speed;

The processor is further configured to:

If the current zoom factor of the camera is greater than the preset threshold, input the current ambient light parameter, the current zoom factor, and the current terminal moving speed into a pre-trained shooting parameter determination model to obtain the Target exposure and the number of target shot frames.
The terminal according to any one of claims 16 to 19, wherein the processor is further configured to:

Determining a center picture and a remaining picture in the picture of the target number of shot frames, wherein the center picture is the highest-definition picture in the picture of the target number of shot frames, and the remaining pictures are clear except the center picture a picture that is above the sharpness threshold;

Segmenting the center picture and the remaining pictures;

If the resolution of the target picture part in the remaining picture is higher than the definition of the target picture part in the central picture, the target picture part of the central picture is processed according to the target picture part in the remaining pictures;

The processed center picture is determined as the target picture.
The terminal according to any one of claims 15 to 19, wherein the processor is further configured to:

Displaying the target image through the display screen and displaying the undo anti-shake option;

When a click command to the undo anti-shake option is detected, the target picture is replaced with a first frame picture in the multi-frame picture.
A computer readable storage medium, wherein the storage medium stores at least one instruction, at least one program, a code set or a set of instructions, the at least one instruction, the at least one program, the code set or A method of photographing processing according to any one of claims 1 to 7 when the instruction set is loaded and executed by a processor.