WO2023005060A1

WO2023005060A1 - Image capture method, mobile terminal and storage medium

Info

Publication number: WO2023005060A1
Application number: PCT/CN2021/130373
Authority: WO
Inventors: 王士龙
Original assignee: 上海传英信息技术有限公司
Priority date: 2021-07-27
Filing date: 2021-11-12
Publication date: 2023-02-02
Also published as: CN113542610A

Abstract

The present application discloses an image capture method, a mobile terminal and a storage medium, the method comprising: triggering a special effect template operation in a preview interface, and acquiring a target special effect template; receiving an image capture request, and collecting an image frame; and generating a target video on the basis of the image frame and the target special effect template. According to the present application, image-captured video scenes recorded by a mobile terminal are richer, and the user experience is improved.

Description

Shooting method, mobile terminal and storage medium

This application claims priority to a Chinese patent application filed with the China Patent Office on July 27, 2021, with application number 202110851878.6 and titled "Shooting method, mobile terminal and storage medium", the entire contents of which are incorporated by reference .

technical field

The present application relates to the technical field of image processing, and in particular to a photographing method, a mobile terminal and a storage medium.

Background technique

In some implementations, when recording a photographic video, the mobile terminal often only provides the recording function itself, that is, the user clicks to start recording and stop recording. During the process of conceiving and implementing this application, the inventor found that it has at least the following problems: Photography videos (such as time-lapse photography videos) have relatively monotonous screen content, resulting in low user experience.

The foregoing description is provided to provide general background information and does not necessarily constitute prior art.

technical problem

In view of the above technical problems, the present application provides a shooting method, a mobile terminal and a storage medium, so as to enrich the pictures of photographic video recorded by the mobile terminal and improve user experience.

technical solution

In order to solve the above technical problems, the application provides a shooting method, including:

Trigger the special effect template operation on the preview interface to obtain the target special effect template;

Receive the shooting request and collect the image frame;

A target video is generated based on the image frame and the target special effect template.

Optionally, the step of generating a target video based on the image frame and the target special effect template includes:

performing special effect processing on the image frame by using the target special effect template;

Extract key frames of a target number from the image frames after special effect processing;

The target video is generated based on the key frame.

Optionally, after the step of performing special effect processing on the image frame by using the target special effect template, it further includes:

The image frame after the special effect processing is displayed on the preview interface.

Extracting a target number of key frames from the image frame;

performing special effect processing on the key frame by using the target special effect template;

The target video is generated based on the key frame after special effect processing.

Optionally, after receiving the shooting request, after the step of collecting image frames, the method further includes:

When receiving the setting instruction of the frame drawing frequency, obtain the target frame drawing frequency corresponding to the setting instruction;

The target quantity for extracting the key frames is determined according to the target frame extraction frequency.

Optionally, the target special effect template includes: a filter template and/or a video image reversal template.

Optionally, after the step of generating the target video based on the image frame and the target special effect template, it also includes:

cache the target video;

When the recording end instruction is received, the target video is saved.

Optionally, after receiving the recording end instruction, it also includes:

When it is detected that the cached target time-lapse photography includes at least two, splicing at least two of the target videos.

Optionally, the step of splicing at least two of the target videos includes:

Splicing at least two of the target videos according to the order of cache time.

Optionally, the step of splicing at least two of the target videos includes:

Output the prompt information of splicing sequence;

When the setting operation of the target splicing sequence corresponding to the prompt information is detected, at least two of the target videos are spliced according to the target splicing sequence.

The present application also provides a mobile terminal, including: a memory and a processor, where a photographing program is stored in the memory, and when the photographing program is executed by the processor, the steps of the above method are implemented.

The present application also provides a computer storage medium, where the computer storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are realized.

Beneficial effect

As mentioned above, the shooting method of the present application is applied to a mobile terminal, and when the special effect template operation is triggered on the preview interface, the target special effect template is obtained; when a shooting request is received, an image frame is collected; based on the image frame and the target special effect template Generate target video. Through the above method, the content of the photographic video picture recorded by the mobile terminal is enriched, thereby improving the user experience.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, the Under the premise, other drawings can also be obtained based on these drawings.

FIG. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present application;

FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application;

Fig. 3 is a schematic flowchart of a photographing method according to the first embodiment;

Fig. 4 is a preview interface diagram shown according to the first embodiment;

Fig. 5 is a schematic flowchart of a photographing method according to a second embodiment;

Fig. 6 is a schematic flowchart of a photographing method according to a third embodiment;

Fig. 7 is a schematic diagram of an interface for adjusting the splicing sequence of target videos according to the third embodiment;

Fig. 8 is a schematic diagram of an interface for pausing recording according to the third embodiment;

Fig. 9 is a schematic diagram of an interface for continuing recording according to the third embodiment.

The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. By means of the above drawings, specific embodiments of the present application have been shown, which will be described in more detail hereinafter. These drawings and text descriptions are not intended to limit the scope of the concept of the application in any way, but to illustrate the concept of the application for those skilled in the art by referring to specific embodiments.

Embodiments of the present invention

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the statement "comprising a..." does not exclude the existence of other identical elements in the process, method, article or device that includes the element. Optionally, the present application Components, features, and elements with the same name in different embodiments may have the same meaning, or may have different meanings, and the specific meaning shall be determined based on the explanation in the specific embodiment or further combined with the context in the specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination". Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not exclude one or more other features, steps, operations, The existence, occurrence or addition of an element, component, item, species, and/or group. The terms "or", "and/or", "comprising at least one of" and the like used in this application may be interpreted as inclusive, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C", another example, " A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C". Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that although the various steps in the flow chart in the embodiment of the present application are displayed sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figure may include multiple sub-steps or multiple stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential Instead, it may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" could be interpreted as "when determined" or "in response to the determination" or "when detected (the stated condition or event) )" or "in response to detection of (stated condition or event)".

It should be noted that, in this article, step codes such as S10 and S20 are used, the purpose of which is to express the corresponding content more clearly and concisely, and does not constitute a substantive limitation on the order. Those skilled in the art may, during specific implementation, S20 will be executed first, followed by S10, etc., but these should be within the scope of protection of this application.

It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

In the following description, the use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating the description of the present application and has no specific meaning by itself. Therefore, 'module', 'part' or 'unit' may be mixedly used.

Mobile terminals may be implemented in various forms. For example, the mobile terminals described in this application may include mobile phones, tablet computers, notebook computers, palmtop computers, personal digital assistants (Personal Digital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, wearable devices, smart bracelets, pedometers and other mobile terminals, as well as fixed terminals such as digital TVs and desktop computers.

In the subsequent description, a mobile terminal will be taken as an example, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configurations according to the embodiments of the present application can also be applied to fixed-type terminals.

Please refer to FIG. 1, which is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present application. The mobile terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, a /V (audio/video) input unit 104 , sensor 105 , display unit 106 , user input unit 107 , interface unit 108 , memory 109 , processor 110 , and power supply 111 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in Figure 1 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than those shown in the figure, or combine some components, or different components layout.

Each component of the mobile terminal is specifically introduced below in combination with FIG. 1:

The radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Optionally, the radio frequency unit 101 may also communicate with a network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, general packet radio service), CDMA2000 (Code Division Multiple Access 2000, Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution, frequency division duplex long-term evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution, Time Division Duplexing Long Term Evolution) and so on.

WiFi is a short-distance wireless transmission technology. The mobile terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102, which provides users with wireless broadband Internet access. Although Fig. 1 shows the WiFi module 102, it can be understood that it is not an essential component of the mobile terminal, and can be completely omitted as required without changing the essence of the invention.

The audio output unit 103 can store the audio received by the radio frequency unit 101 or the WiFi module 102 or in the memory 109 when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like. The audio data is converted into an audio signal and output as sound. Also, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The A/V input unit 104 is used to receive audio or video signals. A/V input unit 104 may include a graphics processor (Graphics Processing Unit (GPU) 1041 and a microphone 1042, the graphics processor 1041 processes image data of still pictures or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 . The microphone 1042 may receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data. The processed audio (voice) data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 101 for output in the case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the mobile terminal 100 moves to the ear. panel 1061 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of mobile phones (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061 , and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it. Optionally, the touch panel 1071 may be realized by various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Optionally, other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.

Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event. The corresponding visual output is provided on the display panel 1061 . Although in FIG. 1, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated. The implementation of the input and output functions of the mobile terminal is not specifically limited here.

The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 may be used to receive input from an external device (for example, data information, power, etc.) and transmit the received input to one or more at least two elements within the mobile terminal 100 or may be used to 100 to transfer data between external devices.

The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.) and the like; the storage data area can be Stores data (such as audio data, phonebook, etc.) created according to the use of the mobile phone, etc. Optionally, the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 110 is the control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes operating systems, user interfaces, and application programs, etc. The demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

The mobile terminal 100 may also include a power source 111 (such as a battery) for supplying power to various components. Preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

Although not shown in FIG. 1 , the mobile terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.

In order to facilitate understanding of the embodiments of the present application, the following describes the communication network system on which the mobile terminal of the present application is based.

Please refer to FIG. 2. FIG. 2 is a structure diagram of a communication network system provided by an embodiment of the present application. The communication network system is an LTE system of general mobile communication technology, and the LTE system includes UEs (User Equipment, User Equipment, ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.

Optionally, the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.

E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on. Optionally, the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .

EPC203 may include MME (Mobility Management Entity, mobility management entity) 2031, HSS (Home Subscriber Server, home user server) 2032, other MME2033, SGW (Serving Gate Way, serving gateway) 2034, PGW (PDN Gate Way, packet data network gateway) 2035 and PCRF ( Policy and Charging Rules Function, policy and tariff function entity) 2036, etc. Optionally, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as the home location register (not shown in the figure), and save some user-specific information about service characteristics and data rates. All user data can be sent through SGW2034, PGW2035 can provide UE 201 IP address allocation and other functions, PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.

The IP service 204 may include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.

Although the LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems. The network system, etc., are not limited here.

Based on the above mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

first embodiment

Referring to Fig. 3, the first embodiment of the present application proposes a shooting method, the method includes the following steps:

Step S10, acquiring the target special effect template when the special effect template operation is triggered on the preview interface;

Step S20, when a shooting request is received, image frames are collected;

Step S30, generating a target video based on the image frame and the target special effect template.

The preview interface is an interface for previewing the photographed video images. The preview interface includes the elements of the special effect template. The special effect template operation is the operation of selecting a special effect template. This operation is triggered by the user, and the target special effect template is the special effect selected by the user. Templates, target special effect templates are used to process photographic videos, the types of target special effect templates include filter templates and or video screen flip templates, filter templates include various processing templates for changing the color of captured video screens, filter templates For example, a gray filter template, a blue filter template, a red filter template and a yellow filter template, and the video image inversion template includes mirror image inversion, up-down inversion and left-right inversion of the video image.

The video mobile terminal can detect the operation of the special effect template by detecting the operation of the controls in the preview interface, and obtain the target special effect template. Template operation, and the special effect template corresponding to the clicked special effect template control can be used as the target special effect template, or, after the user's voice command is detected, the keyword in the voice command can be extracted, and the trigger associated with the keyword can be found The operation of the special effect template, and query the selected target special effect template from the voice command.

Referring to Figure 4, Figure 4 is a preview interface diagram. In the preview interface shown in Figure 4, it includes a recording button element at the bottom and a special effect template located above the recording button element, optionally showing 5 special effect templates , the quadrilateral marked with a solid line indicates the selected special effect template, that is, the target special effect template, and the one marked with a dotted line is an unselected candidate special effect template. The special effect template located directly above the recording button can be used as the currently selected target special effect template. You can slide the special effect template left and right, and slide a certain special effect template directly above the recording button to select the target special effect template, or you can directly click on a special effect template to select the target special effect template. After detecting that the user has selected the target special effect template, A preview screen can also be displayed; optionally, the way to trigger the operation of the filter template is not limited to the way shown in Figure 4, and the special effect template can also be displayed in other areas, such as displayed on the right or above the preview interface, or Display the special effect templates in the preview interface in the form of a grid or a list.

After obtaining the target special effect template, in order to facilitate the user to preview the effect of the target special effect template, the mobile terminal can process the image collected by the camera through the target special effect template, and display the processed image as a preview screen. Therefore, after each selection of a target special effect template, the user can view the corresponding effect.

The photography video shooting request is a request to trigger shooting a photography video, and a shooting control can be displayed in the preview interface, such as the recording button control shown in Figure 4, or the photography video shooting request can also be detected based on the received user voice signal, optional Specifically, when it is detected that the user clicks the recording button or the voice signal includes a request for shooting a photographic video, it is determined that the shooting request is received, and image frames are collected at this time.

The target video is the finally generated photographic video with special effects. After the image frames are collected, each image frame can be saved first, and then a specific image frame is extracted from the saved image frames according to a specific frame extraction frequency, and the target special effect The template performs special effect processing on the extracted specific image frames, and generates a time-series video of the specific image frames after the special effect processing to obtain the target video, that is, extract the target number of key frames from the image frames, and the total number of key frames extracted by the target number , the target number can be a preset number, or it can also be a number determined based on the frame extraction frequency selected by the user; or, each image frame can be processed with special effects first, and a specific image frame can be extracted from each image frame after the special effect processing , and generate a time-series video according to the specific image frame processed by special effects to obtain the target video.

In this embodiment, when the special effect template operation is triggered on the preview interface of the mobile terminal, the target special effect template is obtained, and when a shooting request is received, the image frame is collected, and the target video is generated based on the image frame and the target special effect template, so that a special effect template can be obtained. The photographic video enriches the picture effect of the photographic video and enhances the user experience.

second embodiment

Referring to FIG. 5 , the second embodiment of the present application proposes a shooting method. Based on the first embodiment, step S30 includes:

Step S31, using the target special effect template to perform special effect processing on the image frame;

Step S32, extracting a target number of key frames from the image frames after special effect processing;

Step S33, generating the target video based on the key frame.

After the image frame is collected, the target special effect template is used to perform special effect processing on each collected image frame, and the special effect processing is based on the difference of the target special effect template, including filter processing and/or image inversion processing; optionally, special effect processing It can be divided into different processing effects or processing precision. In the case of high processing effect or processing precision, the performance consumed by special effect processing is high, and in the case of low processing effect or processing precision, the performance consumed by special effect processing is low. , based on this, in order to reduce the performance consumed when previewing photographic video images, the special effect processing process of the first processing precision is used to process each captured image frame, and after the target number of key frames are extracted from the image frames after special effect processing , the key frame can also be processed again based on the second processing precision, or the original image corresponding to the key frame stored in the memory can also be called, and the original image corresponding to the key frame can be processed with special effects by using the second processing precision, optionally , the second processing accuracy is greater than the first processing accuracy, and the processing accuracy refers to the degree of processing each area in the image when processing the image with special effects. For example, when the first processing accuracy is low, the edge area in the image can be omitted processing and special effects processing of detail parts. In the case of high precision of the second special effect processing, special effects processing can be performed on the edge area and detail parts as much as possible, so that it is convenient for the user to preview the special effect processing screen, and it can also be avoided. The power consumption of the special effect processing process is too high, and the special effect effect or special effect precision of the final generated target video can be made higher, a better photographic video can be obtained, and the user's shooting video experience can be improved.

After the special effect processing is performed on the image frame, in order to facilitate the user to view, the image frame after the special effect processing is also displayed on the preview interface, so that the user can view the effect of the special effect processing.

When extracting image frames, it is necessary to extract the target number of key frames, the target number can be preset, or the target number can be determined according to the frame extraction frequency set by the user, optionally, after the collected image frames , can output prompt information for setting the frame pumping frequency. The prompt information can be an interface element for setting the frame pumping frequency displayed on the interface, or a voice prompt message. The user can trigger the setting of the frame pumping frequency based on the prompt information. When setting the frame frequency command, obtain the target frame rate corresponding to the setting command, and determine the target number of key frames to be extracted according to the target frame rate. For example, if the target frame rate is to extract one frame every 15 seconds, then in Among the image frames, a key frame is extracted every 15 seconds, including 120 key frames, and the target number is 120. At this time, if the target video is generated at a frame rate of 30 frames per second, the final generated target delay Photography includes a 4-second video, so that based on the target video, the object changes in a long period of time can be presented in a short period of time. Since the generated target video has special effects, it can improve the picture richness of the photography video and improve the user experience. According to the needs of users, different frame extraction frequencies can be set to obtain photography videos with different time-lapse photography effects.

In this embodiment, by using the target special effect template to perform special effect processing on the image frame, extract a target number of key frames from the image frames after special effect processing, and generate a target video based on the key frames, thereby obtaining a photographic video with special effects, enriching The display effect of the picture of the photographed video is improved, thereby improving the user experience.

third embodiment

Referring to FIG. 6 , the third embodiment of the present application proposes a shooting method. Based on the first embodiment, after step S30, it also includes:

Step S40, buffering the target video;

Step S50, when receiving the recording end instruction, save the target video.

After the target video is generated, the target video is cached in the memory. In this embodiment, the mobile terminal can periodically generate the target video and cache it during the shooting video, or can generate The target video from the start of shooting to the pause of shooting is cached; optionally, the purpose of regularly generating the target video and caching is that during the actual shooting process, if the shooting application crashes, it may result in the loss of the captured photography video, In order to prevent it from being lost, the target video is regularly generated and cached. Optionally, in this embodiment, caching the target video is an internal processing process of the mobile terminal. In the exemplary technology, when the shooting application crashes, the mobile terminal will save it by default. The target video is stored in the album. At this time, the recording process of the user may not be over. For the user, even if the shooting application is restarted, a new recording video can only be recorded, and it cannot continue on the basis of the previous recording video. Recording, if you need to combine the newly recorded photography video with the previously recorded time-lapse photography photography into a video, you can only edit it manually, the editing process is more cumbersome, which makes the user experience poorer, and this embodiment will first cache the target video, Instead of directly saving it as the final video output to the album, after the target video is cached, it will also detect whether the recording is over. When the recording end command is received, the cached target video will be obtained and the cached target video will be saved. , when saving the target video, you can save it to the camera roll or save it to other applications.

After obtaining the cached target video, the mobile terminal can also detect whether the target video includes at least two, at least two means more than two, and when it includes at least two, splice each target video to obtain a spliced video, and save the spliced video.

When splicing at least two target videos, the splicing may be performed according to the buffer sequence of the target videos, or may be spliced according to the splicing sequence selected by the user.

When splicing according to the cache order of the target videos, the cache time of each target video can be obtained, and each target video can be automatically spliced according to the order of the cache time; when splicing is performed according to the splicing sequence selected by the user, a prompt message of the splicing sequence can be output , the prompt information of splicing order is the prompt information used to prompt the user to adjust the sequence of video splicing. The prompt information can display each target video in the interface based on the form of grid or list, and let the user adjust each target in the interface The splicing sequence of the video, after detecting that the user has adjusted it, splicing each target video based on the splicing sequence adjusted by the user to obtain a spliced video, save the spliced video, and output it to the photo album.

Referring to FIG. 7, the prompt information of the splicing sequence output can be displayed based on a grid form. As shown in FIG. 7, an implementation of the prompt information when adjusting the splicing sequence is shown. "1", "2", and "3" in the figure indicate the sequence of splicing, that is, during splicing, 1, 2, and 3 are spliced in sequence. Thumbnail, the user can adjust the splicing order by sliding the thumbnail left and right, and adjust each target video in the order of 1, 2, and 3. After the adjustment is completed, click the "√" below to save the spliced target video. If you need to cancel the adjustment order, you can click “×”.

Optionally, this embodiment also provides an implementation of segmented recording of photographic videos. If the user needs to record each segment of target video separately and stitch each segment of target video, the mobile terminal provides three options: start recording, pause recording, and end recording. Operation, optionally, start recording is used to trigger shooting of photographic video, pause recording is used to trigger caching of target video, and end recording is used to trigger splicing of cached target video, refer to Figure 4, Figure 8 and Figure 9, based on Figure 4 As shown, after clicking "Record", the recording will start, and it will be converted to display the interface shown in Figure 8. In the interface shown in Figure 8, the recording button will change to a pause recording button. When it is detected that the user clicks the pause recording button, the The interface shown in Figure 8 is transformed into the interface shown in Figure 9, and a segment of the target video before pausing the recording is cached, and the thumbnail of the generated target video is displayed in the "Cached Video Thumbnail" column at the bottom left, which is used to remind the user that the current For each target video that has been cached, optionally, if the user clicks on the "cached video thumbnail", it can also enter the interface for adjusting the splicing order. The interface for adjusting the splicing order can be as shown in Figure 7. After detecting When the user clicks the "√" button in Figure 7, the splicing sequence can be saved, but the video splicing will not be performed temporarily until the user returns to the interface shown in Figure 9, and then save after clicking "√", if the user still needs to continue recording For the next video, you can click the button to continue recording, and the display screen of the mobile terminal will switch from the interface shown in Figure 9 to the interface shown in Figure 8. If the user clicks "√" at the bottom right, the mobile terminal will automatically splice the current video. The multi-segment target videos that have been cached are saved and output to the photo album after the spliced video is obtained, and can be returned to the interface shown in Figure 4 to start recording a new target video.

In this embodiment, by caching the target video; when the recording end instruction is received, the target video is saved; thus, the problem of loss or unexpected termination of the target video caused by application crashes and the like can be avoided, and the multi-segment recording target can be further realized video.

The present application also provides a mobile terminal. The mobile terminal includes a memory and a processor. The memory stores a photographing program. When the photographing program is executed by the processor, the steps of the photographing method in any of the foregoing embodiments are implemented.

The present application also provides a computer-readable storage medium, on which a photographing program is stored, and when the photographing program is executed by a processor, the steps of the photographing method in any of the foregoing embodiments are implemented.

In the embodiment of the mobile terminal and the computer-readable storage medium provided in this application, all the technical features of any of the above-mentioned shooting method embodiments can be included. Do repeat.

An embodiment of the present application further provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on the computer, the computer is made to execute the methods in the above various possible implementation manners.

The embodiment of the present application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device installed with the chip executes the above various possible implementation modes. Methods.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The steps in the methods of the embodiments of the present application can be adjusted, combined and deleted according to actual needs.

Units in the device in the embodiment of the present application may be combined, divided and deleted according to actual needs.

In this application, descriptions of the same or similar terms, concepts, technical solutions and/or application scenarios are generally only described in detail when they appear for the first time, and when they appear repeatedly later, for the sake of brevity, they are generally not repeated. When understanding the technical solutions and other contents of the present application, for the same or similar term concepts, technical solutions and/or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

In this application, the description of each embodiment has its own emphasis. For the parts that are not detailed or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

The various technical features of the technical solution of the present application can be combined arbitrarily. For the sake of concise description, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, all It should be regarded as the scope described in this application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in one of the above storage media (such as ROM/RAM, magnetic CD, CD), including several instructions to make a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) execute the method of each embodiment of the present application.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product comprises one or at least two computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. coaxial cable, optical fiber, digital subscriber line) or wirelessly (eg, infrared, wireless, microwave, etc.) to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Usable media can be magnetic media, (for example, floppy disks, memory disks, magnetic tape), optical media (for example, DVD), or semiconductor media (for example, solid State Disk (SSD)), etc.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent protection scope of the present application in the same way.

Claims

A shooting method, wherein the method includes:

Trigger the special effect template operation on the preview interface to obtain the target special effect template;

Receive the shooting request and collect the image frame;

A target video is generated based on the image frame and the target special effect template.
The shooting method according to claim 1, wherein said step of generating a target video based on said image frame and said target special effect template comprises:

performing special effect processing on the image frame by using the target special effect template;

Extract key frames of a target number from the image frames after special effect processing;

The target video is generated based on the key frame.
The shooting method according to claim 1, wherein the step of generating a target video based on the image frame and the target special effect template comprises:

Extracting a target number of key frames from the image frame;

performing special effect processing on the key frame by using the target special effect template;

The target video is generated based on the key frame after special effect processing.
The shooting method according to claim 2 or 3, wherein, after the step of collecting image frames when the shooting request is received, the method further comprises:

receiving a setting instruction of the frame drawing frequency, and acquiring a target frame drawing frequency corresponding to the setting instruction;

The target quantity for extracting the key frames is determined according to the target frame extraction frequency.
The shooting method according to any one of claims 1 to 3, wherein, after the step of generating a target video based on the image frame and the target special effect template, further comprising:

cache the target video;

When the recording end instruction is received, the target video is saved.
The shooting method according to claim 5, wherein, after receiving the recording end instruction, further comprising:

When it is detected that the cached target time-lapse photography includes at least two, splicing at least two of the target videos.
The shooting method according to claim 6, wherein the step of splicing at least two of the target videos comprises:

Splicing at least two of the target videos according to the order of cache time.
The shooting method according to claim 6, wherein the step of splicing at least two of the target videos comprises:

Output the prompt information of splicing sequence;

When the setting operation of the target splicing sequence corresponding to the prompt information is detected, at least two of the target videos are spliced according to the target splicing sequence.
A mobile terminal, wherein the mobile terminal includes: a memory, a processor, optionally, a photographing program is stored in the memory, and when the photographing program is executed by the processor, the process described in claims 1 to 8 is realized. The steps of any one of the photographing methods.
A readable storage medium, wherein a computer program is stored on the readable storage medium, and when the computer program is executed by a processor, the steps of the photographing method according to any one of claims 1 to 8 are realized.