WO2020192461A1 - Recording method for time-lapse photography, and electronic device - Google Patents

Abstract

The present application relates to the technical field of terminals, and provides a recording method for time-lapse photography, and an electronic device. A time-lapse photography video can be recorded at the frame extraction frequency which dynamically changes so as to emphatically present the highlight having a high image change degree in time-lapse photography and improve the user experience. The method comprises: an electronic device displays a preview interface in a time-lapse photography mode; in response to a recording operation executed by a user, the electronic device starts to record frames of photography images captured by a camera; the electronic device extracts X frames of photography images at a first frame extraction frequency from N1 frames of photography images acquired within a first recording period of time; the electronic device extracts Y frames of photography images at a second frame extraction frequency from N2 frames of photography images acquired within a second recording period of time, the second frame extraction frequency being different from the first frame extraction frequency; in response to a recording stopping operation executed by the user, the electronic device encodes extracted M frames of photography images into a time-lapse photography video.

Description

Time-lapse photography recording method and electronic equipment

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office of China, the application number is 201910229645.5, and the invention title is "a recording method and electronic equipment for time-lapse photography" on March 25, 2019. The entire content of the application is approved The reference is incorporated in this application.

Technical field

This application relates to the field of terminal technology, and in particular to a recording method and electronic equipment for time-lapse photography.

Background technique

Camera applications in electronic devices such as mobile phones generally have a time-lapse photography function. Time-lapse photography can also be called time-lapse photography or time-lapse video. It is a shooting technique that can compress time and reproduce the process of slowly changing scenes in a short time.

Take the example of the user using the time-lapse photography function in the mobile phone to photograph the blooming process of flowers. It takes about 3 days and 3 nights (approximately 72 hours) for the buds to open. After the user activates the time-lapse photography function, the mobile phone can extract frames from the video being shot at a certain frame rate. For example, a mobile phone can extract a picture frame every half an hour, and record the slight changes in the flowering movement in the order of frame drawing. In this way, the phone can obtain 144 frames after 72 hours. Furthermore, the mobile phone can play these 144 frames in sequence at a normal frame rate (for example, 24 frames per second), thereby reproducing the blossoms captured by the mobile phone in 3 days and 3 nights within 6 seconds (ie, 144/30=6) process.

Generally, the frame sampling frequency in the time-lapse photography function is preset when the mobile phone leaves the factory, or the frame sampling frequency can be manually set by the user. Once the frame rate is determined, the mobile phone will collect frames according to the set frame rate during time-lapse photography and form a time-lapse video. However, when shooting flower blooming process, sunrise process and other changing scenes, using a fixed frame rate to extract each frame will make the rapid change of the flower blooming moment, sunrise moment and other fast-changing wonderful pictures less and shorter. During the opening or sunrise preparation process, the pictures extracted are many and relatively long, which cannot highlight the wonderful parts of time-lapse photography, and the user experience is not high.

Summary of the invention

This application provides a recording method and electronic equipment for time-lapse photography, which can record time-lapse photography video with a dynamically changing frame rate, so as to highlight the highlights of the time-lapse photography and improve the user's use Experience.

In order to achieve the above objectives, this application adopts the following technical solutions:

In the first aspect, this application provides a recording method for time-lapse photography, including: an electronic device displays a preview interface of the time-lapse photography mode; in response to a recording operation performed by the user (for example, the operation of clicking the recording button in the preview interface, etc.), The electronic device can start recording each frame captured by the camera; in this recording process, the electronic device can use the first frame rate to extract X(X) from the N1 frames captured during the first recording period. ＜N1) Frame shooting images; and the electronic device can use the second frame drawing frequency (the second frame drawing frequency is different from the first frame drawing frequency) to extract Y from the N2 frames of the shooting images collected during the second recording time period (Y<N2) frame shooting screen; in response to the user's stop recording operation (for example, the user clicks the record button again in the preview interface), the electronic device can extract the M frames of shooting screen (including The above-mentioned X-frame shooting picture and Y-frame shooting picture) are encoded as time-lapse photography video.

That is to say, during the shooting process of a time-lapse photography video, the electronic device can dynamically use different frame extraction frequencies to extract the shooting pictures being recorded to form this time-lapse photography video. In this way, the time-lapse photography video produced by the electronic device can dynamically present the changes of the shooting content in different recording time periods, which improves the photography effect of the time-lapse photography and the user experience.

In a possible implementation manner, after the electronic device starts to record each frame of the shooting image captured by the camera, it further includes: if it is detected that the variation of the shooting content in the shooting image during the first recording time period is less than the threshold, then the electronic device The device can determine that the frame sampling frequency in the first recording time period is the first frame sampling frequency; if it is detected that the change in the shooting content in the shooting image during the second recording time period is greater than or equal to the threshold, the electronic device can determine the second The frame sampling frequency in the recording period is the second frame sampling frequency, and the second frame sampling frequency is greater than the first frame sampling frequency.

That is to say, during the recording process, the electronic device can select the corresponding frame extraction frequency according to the change of the shooting content in the shooting screen to extract the frames to form a time-lapse video. When the change of the shooting content in the shooting picture is not obvious, it means that the motion speed of the shooting content is relatively slow at this time, and the electronic device can use a lower frame drawing frequency to extract the frame picture. When the change of the shooting content in the shooting screen is more obvious, it means that the shooting content is moving faster at this time. The electronic device can use a higher frame sampling frequency to extract more frames, and more frames can be more accurate Reflect the changes in the details of the shooting content, so that the time-lapse photography video recorded by the electronic device can focus on the highlights that change quickly, thereby improving the photography effect of the time-lapse photography and the user experience.

Exemplarily, after the electronic device starts to record each frame of the shooting picture captured by the camera, it further includes: the electronic device calculates the optical flow intensity between two adjacent frames of the shooting picture collected each time, and the optical flow intensity is used for Reflects the change range of the shooting content in two adjacent frames of shooting; then, if it is detected that the optical flow intensity between two adjacent frames of shooting during the first recording period is less than the first preset value, it indicates that the scene in the shooting screen If the change is not obvious, the electronic device can determine that the frame sampling frequency in the first recording period is the first frame sampling frequency with a smaller value; if it is detected that there is a gap between two adjacent frames in the second recording period The optical flow intensity of is greater than or equal to the first preset value, indicating that the scene changes in the shooting image are more obvious, and the electronic device can determine the frame sampling frequency in the second recording period as the second frame sampling frequency with a larger value .

Or, if it is detected that the N1 frames of shooting images collected during the first recording time period belong to the preset first shooting scene, the electronic device may determine that the frame sampling frequency in the first recording time period is the first frame sampling frequency; if If it is detected that the N2 frames of shooting images collected during the second recording time period belong to the preset second shooting scene, the electronic device may determine that the frame sampling frequency in the second recording time period is the second frame sampling frequency. Generally, the movement speed of the scene in the first shooting scene is slow, and the movement speed of the scene in the first shooting scene is faster. In this way, the time-lapse photography video finally produced by the electronic device can accurately present the dynamic process of scene changes in different shooting scenes, and improve the shooting effect of the time-lapse photography video and the user experience.

Or, if it is detected that the movement speed of the shooting target in the first recording time period is less than the second preset value, the electronic device may determine that the frame drawing frequency in the first recording time period is the first frame drawing frequency; if the first recording time period is detected 2. The moving speed of the shooting target during the recording time period is greater than or equal to the second preset value, the electronic device can determine that the frame drawing frequency in the second recording time period is the second frame drawing frequency, so as to focus on the rapid movement of the shooting target Presented in time-lapse video.

In a possible implementation manner, before the electronic device encodes the extracted M-frame shooting picture into a time-lapse photography video, it further includes: the electronic device uses the third frame sampling frequency to collect N3 from the third recording time period. Extracting Z frames from the frame shooting picture (this Z frame shooting picture is part of the M frame shooting picture extracted by the electronic device), the third frame sampling frequency is different from the above second frame sampling frequency and the first frame sampling frequency Similarly, the third recording time period does not overlap with the foregoing second recording time period and the first recording time period.

In a possible implementation manner, after the electronic device starts to record each frame of the shooting picture captured by the camera, the method further includes: the electronic device displays each frame of the shooting picture being recorded in the preview picture in real time.

In a possible implementation manner, when the electronic device displays each frame of the shooting frame being recorded in the preview screen in real time, it also includes: the electronic device displays the current recording duration in the preview screen in real time, and is related to the recording The playback time of the time-lapse photography video corresponding to the duration allows the user to know the video length of the time-lapse photography video in real time.

In a possible implementation manner, the electronic device encodes the extracted M-frame shooting picture into a time-lapse photography video, including: the electronic device encodes the extracted M-frame shooting picture into this time-lapse photography according to a preset frame rate Time-lapse video.

In a possible implementation manner, after the electronic device encodes the extracted M-frame shooting picture into a time-lapse photography video, the method further includes: in response to an operation of the user to open the time-lapse photography video, the electronic device uses a preset frame rate Play the time-lapse video. When playing the time-lapse photography video, since the electronic device extracts more shooting pictures when the scene moves quickly, the electronic device can highlight the highlights of the high-level picture change during the time-lapse photography recording process.

In a second aspect, this application provides an electronic device, including: a touch screen, one or more processors, one or more memories, one or more cameras, and one or more computer programs; wherein the processor and the touch screen, the memory And the camera are both coupled, the above one or more computer programs are stored in the memory, when the electronic device is running, the processor executes the one or more computer programs stored in the memory, so that the electronic device executes any of the above The recording method of time-lapse photography.

In a third aspect, the present application provides a computer storage medium, including computer instructions, which when the computer instructions run on an electronic device, cause the electronic device to execute the time-lapse photography recording method described in any one of the first aspect.

In a fourth aspect, the present application provides a computer program product, which when the computer program product runs on an electronic device, causes the electronic device to execute the recording method of time-lapse photography as described in any one of the first aspect.

Understandably, the electronic equipment described in the second aspect, the computer storage medium described in the third aspect, and the computer program product described in the fourth aspect provided above are all used to execute the corresponding methods provided above. For the beneficial effects that can be achieved, please refer to the beneficial effects in the corresponding method provided above, which will not be repeated here.

Description of the drawings

FIG. 1 is a first structural diagram of an electronic device according to an embodiment of the application;

FIG. 2 is a schematic diagram of a photographing principle provided by an embodiment of the application;

3 is a schematic flowchart of a recording method for time-lapse photography according to an embodiment of the application;

4 is a schematic diagram 1 of a scene of a recording method for time-lapse photography according to an embodiment of the application;

5 is a second schematic diagram of a scene of a recording method for time-lapse photography according to an embodiment of the application;

FIG. 6 is a third scene schematic diagram of a recording method for time-lapse photography according to an embodiment of the application;

FIG. 7 is a fourth schematic diagram of a scene of a recording method for time-lapse photography according to an embodiment of the application;

FIG. 8 is a schematic diagram five of a scene of a recording method for time-lapse photography according to an embodiment of the application;

FIG. 9 is a sixth schematic diagram of a scene of a recording method for time-lapse photography according to an embodiment of the application;

10 is a seventh schematic diagram of a scene of a recording method for time-lapse photography according to an embodiment of the application;

11 is an eighth schematic diagram of a scene of a recording method for time-lapse photography according to an embodiment of the application;

FIG. 12 is a scene schematic diagram 9 of a recording method for time-lapse photography according to an embodiment of the application;

FIG. 13 is a tenth schematic diagram of a scene of a recording method for time-lapse photography according to an embodiment of the application;

14 is a schematic diagram eleventh scene of a recording method for time-lapse photography according to an embodiment of the application;

15 is a schematic diagram twelfth of a scene of a recording method for time-lapse photography according to an embodiment of this application;

FIG. 16 is a second structural diagram of an electronic device provided by an embodiment of this application;

FIG. 17 is a third structural diagram of an electronic device provided by an embodiment of this application.

detailed description

The implementation of this embodiment will be described in detail below with reference to the accompanying drawings.

Exemplarily, the recording method of time-lapse photography provided by the embodiments of this application can be applied to mobile phones, tablet computers, notebook computers, ultra-mobile personal computers (UMPC), handheld computers, netbooks, and personal digital computers. Electronic devices such as personal digital assistants (PDAs), wearable electronic devices, virtual reality devices, etc., are not limited in the embodiments of the present application.

Exemplarily, FIG. 1 shows a schematic structural diagram of an electronic device 100.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2. , Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195, etc.

It can be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc. Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous transmitter) interface. receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / Or Universal Serial Bus (USB) interface, etc.

The I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor, charger, flash, camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor through an I2C interface, so that the processor 110 and the touch sensor communicate through the I2C bus interface to realize the touch function of the electronic device 100.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled with the audio module 170 through an I2S bus to realize communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit audio signals to the wireless communication module 160 through an I2S interface, so as to realize the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 may transmit audio signals to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with the display screen 194, the camera 193 and other peripheral devices. The MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through a CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through a DSI interface to realize the display function of the electronic device 100.

The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and so on. GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely illustrative and does not constitute a structural limitation of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.

The charging management module 140 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 can receive input from the battery 142 and/or the charging management module 140, and supply power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.

The power management module 141 can be used to monitor performance parameters such as battery capacity, battery cycle times, battery charging voltage, battery discharging voltage, and battery health status (such as leakage, impedance). In some other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100. The mobile communication module 150 may include one or more filters, switches, power amplifiers, low noise amplifiers (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating one or more communication processing modules. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic wave radiation via the antenna 2.

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).

The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, and N is a positive integer greater than one.

The electronic device 100 can realize a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the electrical signal to the ISP for processing and is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or videos. In some embodiments, the mobile phone 100 may include 1 or N cameras, and N is a positive integer greater than 1. The camera 193 may be a front camera or a rear camera. As shown in FIG. 2, the camera 193 generally includes a lens and a sensor. The photosensitive element may be a CCD (charge-coupled device) or a CMOS (complementary metal oxide semiconductor, complementary metal oxide semiconductor). ) And other arbitrary photosensitive devices.

As shown in FIG. 2, during the shooting process, the reflected light of the object being photographed can generate an optical image after passing through the lens. The optical image is projected onto the photosensitive element, and the photosensitive element converts the received light signal into an electrical signal, and further, The camera 193 sends the obtained electrical signal to a DSP (Digital Signal Processing) module for digital signal processing, and finally obtains a frame of digital image.

Similarly, in the process of recording a video, the DSP can obtain a continuous multi-frame digital image according to the above-mentioned shooting principle, and the continuous multi-frame digital image can be encoded according to a certain frame rate to form a video. Due to the special physiological structure of the human eye, when the frame rate of the picture being viewed is higher than 16 frames per second (fps), the human eye will consider the picture to be seen as coherent. This phenomenon can be called visual stay. In order to ensure the continuity of users watching the video, the mobile phone can encode the multi-frame digital image output by the DSP according to a certain frame rate (for example, 24fps or 30fps). For example, if the DSP collects 300 frames of digital images through the camera 193, the mobile phone can encode these 300 frames of digital images into a video of 10 seconds (300 frames/30fps=10) at a preset frame rate of 30fps.

Among them, one or more frames of digital images output by the DSP can be output on the mobile phone 100 through the display 194, or the digital images can be stored in the internal memory 121 (or the external memory 120), which is not done in the embodiment of the application. Any restrictions.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects the frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in a variety of encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information and can continuously learn by itself. The NPU can realize applications such as intelligent cognition of the electronic device 100, such as image recognition, face recognition, voice recognition, text understanding, and so on.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store one or more computer programs, and the one or more computer programs include instructions. The processor 110 can execute the above-mentioned instructions stored in the internal memory 121 to enable the electronic device 100 to execute the method for intelligently recommending contacts provided in some embodiments of the present application, as well as various functional applications and data processing. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store the operating system; the storage program area can also store one or more application programs (such as a gallery, contacts, etc.) and so on. The data storage area can store data (such as photos, contacts, etc.) created during the use of the electronic device 101. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, universal flash storage (UFS), etc. In other embodiments, the processor 110 executes the instructions stored in the internal memory 121 and/or the instructions stored in the memory provided in the processor to cause the electronic device 100 to execute the smart device provided in the embodiments of the present application. Recommended number method, as well as various functional applications and data processing.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110, or part of the functional modules of the audio module 170 may be provided in the processor 110.

The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or voice message, it can receive the voice by bringing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can approach the microphone 170C through the mouth to make a sound, and input the sound signal to the microphone 170C. The electronic device 100 may be provided with one or more microphones 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, which can implement noise reduction functions in addition to collecting sound signals. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.

The earphone interface 170D is used to connect wired earphones. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The sensor 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc. The embodiments of the application This does not impose any restrictions.

Of course, the electronic device 100 provided in the embodiment of the present application may further include one or more devices such as the button 190, the motor 191, the indicator 192, and the SIM card interface 195, which is not limited in the embodiment of the present application.

In order to facilitate a clear understanding of the following embodiments, a brief introduction of related technologies is first given:

Time-lapse photography, also called time-lapse photography or time-lapse video recording, is a shooting technique that can compress time and reproduce the process of slowly changing scenes in a short time. After the time-lapse photography function is turned on, the electronic device 100 can start to record each frame of the shooting picture captured by the camera 193. In addition, the electronic device 100 can extract M (M<N) frames from the N (N>1) frames captured by the camera 193 at a certain frame rate as the time-lapse photography video of this time-lapse photography. Subsequently, when the user opens the time-lapse photography video, the electronic device 100 can play the extracted M frames of shooting images at a certain frame rate, so as to reproduce the N frames of shooting images actually captured by the electronic device 100 through the M frames of shooting images Changes in the scene.

Optical flow (optical flow) is the instantaneous velocity of the pixel movement of a spatial moving object on an imaging plane (for example, a photographed picture). When the time interval is very small (for example, between two consecutive frames in the video), the optical flow is also equivalent to the displacement of the target point. When the human eye observes a moving object, the scene of the object forms a series of continuously changing images on the retina of the human eye. This series of continuously changing information constantly "flows through" the retina (i.e. imaging plane), like a kind of light. "Flow", so called optical flow.

Optical flow expresses the violent degree of image change, and it contains the motion information of objects between adjacent frames. For example, the position of point A in the t-th frame shooting picture is (x1, y1), if the position of point A in the t+1-th frame shooting picture is (x2, y2), then point A is in the t-th frame shooting picture The intensity of the optical flow between the captured image and the t+1th frame can be represented by a two-dimensional vector u. Among them, u=(u,v)=(x2,y2)-(x1,y1). When the intensity of the optical flow is greater, it means that point A has a larger movement amplitude and faster movement speed in the shooting picture at this time; when the intensity of the optical flow is smaller, it means that the movement amplitude of point A in the shooting picture is smaller at this time. Movement speed is slower.

Since each frame of the shooting picture is composed of multiple pixels, the optical flow intensity of each pixel between two adjacent frames can be calculated according to the above method. Then, based on the optical flow intensity of each pixel in the shooting image, the electronic device 100 can determine the optical flow intensity between the t-th frame shooting image and the t+1-th frame shooting image using a preset optical flow algorithm. Similarly, when the intensity of the optical flow is greater, it means that the shooting content in the t-th frame and the t+1-th frame has a greater change; when the intensity of the optical flow is smaller, it means that the t-th frame and the t-th frame have changed. In the +1 frame shooting screen, the change in the shooting content is small.

In the embodiment of the present application, after the electronic device 100 turns on the time-lapse photography function, the electronic device 100 can use a dynamic frame sampling frequency to extract M (M<N) frames from the N frames captured by the camera 193 as the original Time-lapse video. For example, if the optical flow intensity of two adjacent frames of the captured images in the first 10 seconds is less than the preset value, it means that the degree of change in the captured images captured in the first 10 seconds is small. At this time, the electronic device 100 can use the smaller first The frame rate (e.g., one frame every 3 seconds) extracts the shots taken in the previous 10 seconds. If the optical flow intensities of the two adjacent frames in the 11-20 seconds are greater than the preset value, it means that the previously captured images in the 11-20 seconds have changed greatly. At this time, the electronic device 100 can be used The larger second frame rate (for example, one frame every 0.5 second) extracts the shooting pictures taken within 11-20 seconds, and finally, the M frames of shooting pictures extracted by the electronic device 100 can form the video of this time-lapse photography .

That is to say, in the time-lapse photography method provided by the embodiments of the present application, the electronic device can select the corresponding frame extraction frequency according to the changes of the shooting content in the shooting screen during the recording process to extract frames to form a time-lapse photography video. When the change of the shooting content in the shooting picture is not obvious, it means that the motion speed of the shooting content is relatively slow at this time, and the electronic device can use a lower frame drawing frequency to extract the frame picture. When the change of the shooting content in the shooting screen is more obvious, it means that the shooting content is moving faster at this time. The electronic device can use a higher frame sampling frequency to extract more frames, and more frames can be more accurate Reflect the changes in the details of the shooting content, so that the time-lapse photography video recorded by the electronic device can focus on the highlights that change quickly, thereby improving the photography effect of the time-lapse photography and the user experience.

The following will take a mobile phone as an example of the above-mentioned electronic device 100 to describe in detail a recording method of time-lapse photography provided in an embodiment of the present application. As shown in FIG. 3, the method includes steps S301-S306.

S301. In response to the recording operation performed by the user in the time-lapse photography mode, the mobile phone starts to collect each frame of the shooting picture captured by the camera.

Generally, the camera application of the mobile phone has the function option of time-lapse photography. As shown in FIG. 4, after detecting that the user opens the camera application, the preview interface 401 displayed by the mobile phone is set with a function option 402 of time-lapse photography. If it is detected that the user selects the function option 402, the mobile phone can enter the time-lapse photography mode of the camera application. Of course, one or more shooting modes such as photo mode, portrait mode, panorama mode, video mode, or slow motion mode can also be set in the preview interface 401, and the embodiment of the present application does not impose any limitation on this.

After the mobile phone enters the time-lapse photography mode, the preview interface 401 can display the shooting image 403 currently captured by the camera. Since the time-lapse photography video has not yet been recorded at this time, the shooting screen 403 displayed in real time in the preview interface 401 may be referred to as a preview screen. In addition, the preview interface 401 also includes a recording button 404 for time-lapse photography. If it is detected that the user clicks the record button 404 in the preview interface 401, it means that the user has performed the recording operation in the time-lapse photography mode. At this time, the mobile phone can continue to use the camera to capture each frame of the camera captured by the camera and start recording the delay Photography video.

For example, the mobile phone can collect each frame of the shooting image at a certain collection frequency. Taking the acquisition frequency of 30 frames per second for example, after the user clicks the record button 404 in the preview interface 401, the phone can capture 30 frames of shooting within 0-1 seconds, and 30 frames of shooting within 1-2 seconds Picture. As the recording time elapses, the number of frames of the shooting pictures collected by the mobile phone will gradually accumulate. The multi-frame shooting pictures extracted by the mobile phone from these collected shooting pictures according to the frame rate can finally form the time-lapse photography. Time-lapse video.

In the embodiment of the present application, the mobile phone can copy the video stream formed by each frame of the captured picture into a dual-channel video stream. Each video stream includes every frame captured in real time after the mobile phone turns on the time-lapse recording function. Furthermore, the mobile phone can use one of the video streams to execute the following step S302 to complete the display task of the preview interface during the time-lapse photography. At the same time, the mobile phone can use another video stream to perform the following steps S303-S305 to complete the time-lapse video production task.

S302. The mobile phone displays each frame of the captured shooting picture in the preview interface in real time.

In step S302, after the mobile phone starts to record the time-lapse photography video, as shown in FIG. 5, the mobile phone can display in the preview interface 401 in real time each frame of the shooting picture 501 currently collected by the camera. In addition, the mobile phone may display a shooting prompt 502 in the preview interface 401 to remind the user that the user is currently in the recording state. Of course, the mobile phone can also load corresponding animation special effects on the recording button 404 to remind the user that the user is currently in the recording state.

In some embodiments, as shown in FIG. 5, the mobile phone may also display the currently recorded duration 503 in the preview interface 401. The recorded time 503 may reflect the current recording time. In addition, the mobile phone can also display the duration 504 of the time-lapse video corresponding to the currently recorded duration 503 in the preview interface 401. For example, if the mobile phone plays the final time-lapse photography video at a frame rate of 30 frames per second, when the duration 504 of the time-lapse photography video is 1 second, 30 frames of shooting pictures need to be extracted from the shooting pictures collected by the mobile phone. If the frame rate of the mobile phone extracting the shooting picture is one frame per second, the mobile phone can extract 30 frames of the shooting picture every 30 seconds. That is, when the recorded duration 503 is 30 seconds, the duration 504 of the corresponding time-lapse photography video is 1 second. In this way, through time-lapse photography, a video recorded in a longer period of time can be compressed into a shorter time-lapse photography video, thereby reproducing the process of slowly changing scenes in a short period of time.

S303: The mobile phone determines the optical flow intensity of two adjacent frames of the captured N frames of captured images.

In step S303, as shown in FIG. 6, after the mobile phone activates the recording function of time-lapse photography, N frames of shooting pictures can be collected at a certain collection frequency, where N dynamically changes with the length of the recording time. Exemplarily, after the mobile phone obtains the first frame and the second frame, the preset optical flow algorithm can be used to calculate the optical flow intensity Q between the first frame and the second frame (1) . The greater the optical flow intensity Q(1), the greater the degree of change in the image between the first frame and the second frame, that is, the faster the movement speed of the scene in the first frame and the second frame. fast. Similarly, after the mobile phone obtains the third frame, the mobile phone can continue to calculate the optical flow intensity Q(2) between the second frame and the third frame; after the mobile phone obtains the fourth frame, the mobile phone It can continue to calculate the optical flow intensity Q(3) between the shooting screen of the third frame and the shooting screen of the fourth frame,..., after the mobile phone obtains the shooting screen of the Nth frame, the mobile phone can continue to calculate the The optical flow intensity Q(N-1) between the shots of the Nth frame.

The optical flow intensity Q calculated by the mobile phone each time can reflect the degree of change of the two adjacent frames. Furthermore, as shown in Fig. 7, the mobile phone can determine the change of the optical flow intensity Q with the recording time during the recording of this time-lapse video according to the optical flow intensity Q between two adjacent frames of the shooting pictures obtained each time. Situation, that is, the change curve of optical flow intensity Q-recording time (referred to as optical flow curve in subsequent embodiments). The optical flow curve can reflect the changes of the shooting picture during the recording process. It should be noted that since the length of the recording time is generally manually operated by the user, the optical flow curve can dynamically change with the length of the recording time.

Taking a time-lapse photography of a sunrise process as an example, as shown in Figure 7, the shooting content in the shots before and after sunrise generally changes slowly. Therefore, it is the same as before and after sunrise. The value of the optical flow intensity Q corresponding to a period of time is relatively small. If the mobile phone extracts the pictures taken at a higher frame rate during the two periods of time before and after the sunrise, the resulting time-lapse photography video will have more pictures before and after sunrise. There is no significant change between shots.

The relative speed of the sun during the sunrise is relatively fast. Therefore, the value of the optical flow intensity Q corresponding to this period of time during the sunrise is relatively large. If the mobile phone extracts the shooting images at a lower frame rate during the sunrise shooting, the resulting time-lapse video will have fewer sunrise-related shooting images and greater changes between these shooting images . In this regard, the mobile phone can dynamically set the frame drawing frequency of each recording period according to the above optical flow curve by executing the following step S304, so as to improve the photographic effect of time-lapse photography.

S304a: If the optical flow intensity corresponding to the N1 frame of the shooting image within T1 is less than the first threshold, the mobile phone extracts X frames of the shooting image from the N1 frame of the shooting image according to the first frame sampling frequency.

S304b: If the optical flow intensity corresponding to the N2 frames of the shooting pictures within the T2 time is greater than the first threshold, the mobile phone extracts Y frames of the shooting pictures from the N2 frames of the shooting pictures according to the second frame sampling frequency.

In steps S304a-S304b, the mobile phone can detect the magnitude of the optical flow intensity Q in the optical flow curve formed in step S303 in real time. Still taking the optical flow curve shown in Figure 7 as an example, if it is detected that the optical flow intensity Q corresponding to the optical flow curve from the first second to the tenth second is less than the first threshold, it means that the first second to the tenth second The shot scene has not changed drastically. The mobile phone can set the frame rate from the 1st to the 10th second to the lower first frame rate. For example, the first frame rate is 1 frame every 2 seconds. Take a picture. Then, as shown in FIG. 8, the mobile phone can extract 5 frames of shooting images at the first frame rate of 1 frame every 2 seconds from the N1 frames of shooting images collected from the 1st to 10th seconds.

Correspondingly, still taking the optical flow curve shown in Figure 7 as an example, if it is detected that the optical flow intensity Q corresponding to the optical flow curve from the 10th second to the 15th second is greater than the first threshold, it means that the 10th second to the first The scene shot within 15 seconds has changed drastically. The mobile phone can set the frame rate from the 10th second to the 15th second to the second frame rate with a higher value. For example, the second frame rate is every Take 1 frame of shooting in 1 second. Then, as shown in FIG. 9, the mobile phone can extract 5 frames of shooting images at the second sampling frequency of 1 frame every 1 second from the N2 frames of shooting images collected from the 10th to 15th seconds.

Of course, if the time-lapse photography recording has not ended after the 15th second, the mobile phone can continue to dynamically adjust the frame rate of different recording time periods according to the optical flow curve after the 15th second. The embodiment of this application does not do anything about this. limit.

In other words, when it is detected that the change in the scene in the shooting picture is not obvious, the mobile phone can use a lower first frame extraction frequency to extract frames from the shooting picture collected by the mobile phone; when the change in the scene in the shooting picture is detected When it is more obvious, the mobile phone can use a higher second frame extraction frequency to extract frames from the shooting images collected by the mobile phone. In this way, when the captured scene changes significantly, the mobile phone can extract a larger number of shots through a higher second frame rate, and these more shots can more accurately reflect the changes in the details of the shot content. Thus, in the final recorded time-lapse photography video, the dynamic process when the scene changes significantly is highlighted.

In other embodiments, the mobile phone can also dynamically adjust the frame drawing frequency in different recording time periods in units of a preset time window. As shown in (a) in Figure 10, the mobile phone can preset a length of 5 seconds The unit time window is 1001. The mobile phone can use the time window 1001 from the starting position of the optical flow curve to calculate the average value of the optical flow intensity Q in the time window 1001, that is, the average value of the optical flow intensity Q from the first second to the fifth second. If the calculated average value is greater than the threshold value, the mobile phone can extract frames according to the higher second frame sampling frequency for the shooting images collected in the time window 1001; if the calculated average value is less than the threshold value, the mobile phone can extract frames according to the The low first frame sampling frequency performs frame sampling on the captured images collected in the time window 1001. Furthermore, as shown in (b) in Figure 10, the mobile phone can move the time window 1001 to the next 5 seconds (that is, the 5th to the 10th second) of the optical flow curve, and the mobile phone can repeat the calculation The average value of the optical flow intensity Q in the time window 1001 after each time window 1001 moves. In this way, the mobile phone can dynamically adjust the frame sampling frequency in different recording time periods when recording the time-lapse video in the unit of 5 seconds. Of course, the size of the above-mentioned time window may be fixed or may be dynamically changed, and the embodiment of the present application does not impose any limitation on this.

In addition, in the foregoing embodiment, the method for dynamically adjusting the frame rate is explained by taking the setting of two frame sampling frequencies (ie, the first frame rate and the second frame rate) for dynamic adjustment of the mobile phone as an example. It is understandable that the mobile phone can also set three or more frame draw frequencies for the mobile phone to dynamically adjust.

For example, as shown in FIG. 11, the mobile phone can preset the first threshold and the second threshold of the optical flow intensity (the second threshold is greater than the first threshold). When it is detected that the optical flow intensity Q at the time 0-T1 in the optical flow curve is less than the first threshold, the mobile phone can extract the X frames of the shooting pictures at the time 0-T1 according to the first frame rate; when the T1 in the optical flow curve is detected -When the optical flow intensity Q at time T2 is greater than the first threshold and less than the second threshold, the mobile phone can extract the Y frames at time T1-T2 according to the second frame rate (the second frame rate is greater than the first frame rate) Picture; when it is detected that the optical flow intensity Q after T2 in the optical flow curve is greater than the second threshold, the mobile phone can extract Z after T2 at the third frame rate (the third frame rate is greater than the second frame rate) Frame the picture. That is to say, when the change of the scene in the shooting picture is more obvious and violent, the more frequently the mobile phone extracts the frame of the shooting picture in the time-lapse photography. Correspondingly, when the scene change in the shooting picture is slower, the mobile phone will delay. In time photography, the lower the frame rate for extracting the captured image.

In other embodiments, the mobile phone may also provide the user with the function of manually setting the frame rate for different recording periods. For example, before recording a time-lapse video, the user can manually enter the frame rate for different recording periods in the camera's setting interface. For example, the user can set the recording time of the entire time-lapse photography to 30 minutes. Within these 30 minutes, the frame rate set by the user in the first 10 minutes and the last 10 minutes is 1 frame per second. The frame rate set by the user in minutes is 1 frame taken every 0.5 seconds. Later, in the process of recording the time-lapse video, the mobile phone can dynamically adjust the corresponding frame sampling frequency in different recording time periods according to the frame sampling frequency set by the user, and the embodiment of the present application does not impose any limitation on this.

S305. In response to the recording stop operation performed by the user in the time-lapse photography mode, the mobile phone encodes the extracted M-frame shooting picture into a time-lapse photography video, and the M-frame shooting picture includes the foregoing X-frame shooting picture and Y-frame shooting picture.

When the user wants to end this time-lapse photography, as shown in FIG. 12, the user can click the record button 404 in the preview interface 401 again. In response to the user clicking the record button 404 to stop the recording operation, the mobile phone may encode the M frames of shooting pictures extracted at this time into this time-lapse photography video in chronological order. Among them, the extracted M frames of shooting pictures include the respective shooting pictures extracted by the mobile phone according to the corresponding frame sampling frequency in different recording time periods.

Exemplarily, when the user clicks the record button 404, if the mobile phone extracts a total of 300 frames of shooting images, the mobile phone may encode the 300 frames of shooting images according to the preset frame rate. Taking the preset frame rate of 30 frames per second as an example, the mobile phone can encode the extracted 300 frames of shooting images into a time-lapse video of 10 seconds at a frame rate of 30 frames per second.

In the foregoing embodiment, a method for dynamically adjusting the frame rate during time-lapse photography is provided by the mobile phone by calculating the optical flow intensity of the captured image as an example. In other embodiments of the present application, the correspondence between different shooting scenes and different frame sampling frequencies may be stored in the mobile phone in advance. For example, when the shooting scene is a scene where the scene changes slowly, such as a sky scene, the corresponding frame extraction frequency is one frame every 2 seconds; when the shooting scene is a scene where the scene changes quickly, such as a bird scene, the corresponding frame extraction frequency Take one frame every 0.5 seconds.

In this way, when the mobile phone starts to record the time-lapse photography video, the mobile phone can recognize in real time the shooting scene being shot in the captured shooting screen. For example, the mobile phone can recognize the shooting scene in the shooting screen through image analysis or AI (artificial intelligence) recognition algorithms. As shown in Figure 13, if the mobile phone recognizes that the shooting scenes from the 1st to the 10th second are all sky scenes, the mobile phone can extract one frame every 2 seconds from the shooting screen captured from the 1st to the 10th second The first frame frequency of the shooting picture is to extract the shooting picture. If the mobile phone recognizes that the shooting scenes from the 10th to the 14th second are all flying bird scenes, the mobile phone can extract the second shot of the shooting frame every 0.5 seconds from the shooting images collected from the 11th to the 14th second. The frame rate extracts the captured image. In the end, the mobile phone can encode the extracted shooting picture into this time-lapse video.

That is to say, when the mobile phone records time-lapse photography video, it can use different frame extraction frequencies in different shooting scenes to extract the shooting images of the time-lapse photography video from the shooting images recorded by the mobile phone, so that the final time-lapse photography is formed Video can accurately present the dynamic process of scene changes in different shooting scenes, improving the shooting effect of time-lapse video and the user experience.

Or, in some other embodiments of the present application, after the mobile phone starts to record the time-lapse photography video, the mobile phone can recognize the shooting target in the captured shooting frame in real time and the movement speed of the shooting target. As shown in Figure 14, if the mobile phone recognizes that the shooting target of the picture taken from the first second to the fifth second is the person 1401, and the movement speed of the person 1401 is less than the preset value, then the mobile phone can be used in the first second to the fifth second Among the captured shooting images, the shooting images are extracted at the first frame rate at which one frame of the shooting images is extracted every 2 seconds. If the mobile phone recognizes that the shooting target of the shooting frame from the 5th to the 10th second is the person 1402, and the movement speed of the person 1402 is greater than the preset value, then the mobile phone can capture the shooting frame from the 5th to the 10th second. The captured image is extracted at the second frame rate at which one frame of the captured image is extracted every 0.5 seconds. In the end, the mobile phone can encode the extracted shooting picture into this time-lapse video.

It should be noted that the foregoing shooting target may be manually selected by the user. For example, the user may select the shooting target in the shooting screen displayed on the preview interface by manual focusing. Alternatively, the aforementioned shooting target may also be automatically recognized by the mobile phone through image analysis or AI recognition and other algorithms, and the embodiment of the present application does not impose any limitation on this.

It should be noted that in the above embodiment, a time-lapse photography video of a sunrise process is taken as an example. It is understandable that the mobile phone can also use the above-mentioned time-lapse photography recording method to record the sunset process, the blooming process, or the flower blooming process. For the time-lapse photography video of the falling process, the embodiment of this application does not impose any limitation on this.

Take a time-lapse photography video of a flower blooming process as an example. After the mobile phone starts to record each frame of the shooting picture, the phone can determine the optical flow intensity Q between the two adjacent frames of the shooting picture collected each time. Generally, during the waiting process before the flower blooms, the variation range of the shooting content in the shooting picture will not be too large. At this time, the optical flow intensity Q between two adjacent shooting pictures is generally small. When the flowers are blooming, the variation range of the shooting content in the shooting images will increase. At this time, the optical flow intensity Q between two adjacent shooting images is generally larger. Then, if it is detected within T1 that the optical flow intensity Q between two adjacent frames of shooting pictures is less than the first threshold, it means that the change of the scene in the shooting picture is not obvious, then the mobile phone can follow the smaller value of the first The frame rate is used to extract X frames of shooting pictures; if it is detected within T2 that the optical flow intensity Q between two adjacent frames of shooting pictures is greater than or equal to the first threshold, the scene changes in the shooting picture are more obvious, then the mobile phone can follow The second sampling frequency with a larger value extracts Y frames of the shooting picture. In this way, the finally formed time-lapse photography video can accurately present the dynamic process of flower bud opening during the blooming process, thereby improving the shooting effect of the time-lapse photography video and the user experience.

Of course, when shooting a time-lapse video of the flower blooming process, the mobile phone can not only adjust the frame frequency to extract the captured images according to the optical flow intensity Q between two adjacent frames of shooting images in real time, but also according to other changes that can reflect the changes in the shooting content. The amplitude parameter adjusts the frame rate. For example, the mobile phone can use flowers in the shooting screen as the shooting target to detect the speed of the shooting target. Furthermore, the mobile phone can adjust the frame sampling frequency in real time according to the motion speed of the shooting target to extract the shooting pictures of this time-lapse photography video, which is not limited in the embodiment of the present application.

That is to say, when the mobile phone is recording a time-lapse photography video, if it detects that the movement speed of the shooting target is slow, the mobile phone can use a slower frame extraction frequency to extract the shooting pictures in the time-lapse video from the shooting pictures recorded by the mobile phone. ; If the fast moving speed of the shooting target is detected, the mobile phone can use a higher frame extraction frequency to extract the shooting pictures in the time-lapse photography video from the shooting pictures recorded by the mobile phone, so as to present the fast moving parts of the shooting target. Time-lapse video.

In some other embodiments of the present application, the mobile phone can save each frame of the shooting picture collected by the camera during the process of recording the time-lapse video without performing the above steps S303-S305. After the user stops recording the time-lapse photography video, the mobile phone can dynamically adjust the frame drawing frequency of different recording time periods by performing the above steps S303-S304, and extract each shooting picture according to the corresponding frame drawing frequency during different recording time periods to form This time-lapse photography video does not impose any restriction on this embodiment of the application.

S306. In response to the user's operation of opening the aforementioned time-lapse photography video, the mobile phone plays the aforementioned time-lapse photography video at a preset frame rate.

After the user finishes this time-lapse photography, the mobile phone can store the time-lapse photography video obtained in step S305 in the photo album application (also referred to as a gallery application) of the mobile phone. As shown in Figure 15, when the user previews the time-lapse video 1501 in the album application, if it is detected that the user clicks the play button 1502 on the time-lapse video 1501, the mobile phone can encode the time-lapse video 1501 at the frame rate (For example, 30 frames/second) play the time-lapse video 1501.

In the process of playing the time-lapse video 1501, because the mobile phone uses a higher frame rate in the shooting pictures with more dramatic changes in the scene, the shooting pictures are extracted into the time-lapse video 1501, so the time-lapse video 1501 is displayed There are more shots of this scene change. For example, when the mobile phone is recording a time-lapse photography video 1501 during the time period when the sun rises, the frame rate is increased from one frame every 1 second to one frame every 0.5 second. Then, the phone finally picked up the rising sun There are more shooting images, and the extracted shooting images can more vividly and accurately reflect the changes in details when the sun rises, so that the time-lapse photography video 1501 can focus on the dynamic process when the scene changes significantly during playback. , Thereby improving the recording effect of time-lapse photography and the user experience.

As shown in FIG. 16, an embodiment of the present application discloses an electronic device, which can be used to implement the methods described in each of the above method embodiments. The electronic device may specifically include: an acquisition module 1601, a preview module 1602, an optical flow analysis module 1603, a frame extraction module 1604, an encoding module 1605, and a playback module 1606.

Among them, the collection module 1601 is used to support the electronic device to perform the process S301 in FIG. 3; the preview module 1602 is used to support the electronic device to perform the process S302 in FIG. 3; the optical flow analysis module 1603 is used to support the electronic device to perform the process S303 in FIG. 3; The frame extraction module 1604 is used to support the electronic device to perform the processes S304a, S304b, ... in FIG. 3; the encoding module 1605 is used to support the electronic device to perform the process S305 in FIG. 3; the playback module 1606 is used to support the electronic device to perform the processes in FIG. The process S306. Among them, all relevant content of each step involved in the above method embodiment can be cited in the function description of the corresponding function module, and will not be repeated here.

As shown in FIG. 17, an embodiment of the present application discloses an electronic device, including: a touch screen 1701, the touch screen 1701 includes a touch-sensitive surface 1706 and a display screen 1707; one or more processors 1702; memory 1703; one or more One camera 1708; and one or more computer programs 1704. The aforementioned devices may be connected via one or more communication buses 1705. The aforementioned one or more computer programs 1704 are stored in the aforementioned memory 1703 and are configured to be executed by the one or more processors 1702, and the one or more computer programs 1704 include instructions, and the aforementioned instructions can be used to execute the aforementioned Each step in the embodiment should be implemented.

Exemplarily, the foregoing processor 1702 may specifically be the processor 110 shown in FIG. 1, the foregoing memory 1703 may specifically be the internal memory 121 and/or the external memory 120 shown in FIG. 1, and the foregoing display screen 1707 may specifically be FIG. As shown in the display screen 194, the aforementioned camera 1708 may specifically be the camera 193 shown in FIG. 1, and the aforementioned touch-sensitive surface 1706 may specifically be a touch sensor in the sensor module 180 shown in FIG. 1, which is not done in this embodiment of the application. Any restrictions.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated as needed. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the system, device, and unit described above, reference may be made to the corresponding process in the foregoing method embodiment, which is not repeated here.

The functional units in the various embodiments of the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application essentially or the part that contributes to the prior art or all or part of the technical solutions can be embodied in the form of software products, and the computer software products are stored in a storage The medium includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.

The above are only specific implementations of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited to this. Any changes or substitutions within the technical scope disclosed in the embodiments of the present application shall be covered by this Within the protection scope of the application embodiments. Therefore, the protection scope of the embodiments of the present application should be subject to the protection scope of the claims.

Claims (22)

1. A recording method for time-lapse photography, characterized in that it comprises:

   The electronic device displays the preview interface of the time-lapse photography mode;

   In response to the recording operation performed by the user, the electronic device starts to record each frame of the shooting picture captured by the camera;

   The electronic device uses the first frame sampling frequency to extract X frames of shooting images from N1 frames of shooting images collected during the first recording time period, X<N1;

   The electronic device uses the second frame sampling frequency to extract Y frames of shooting images from N2 frames of shooting images collected during the second recording time period, Y<N2, and the second frame sampling frequency is the same as the first frame sampling frequency Not the same, the second recording time period does not overlap with the first recording time period;

   In response to the recording stop operation performed by the user, the electronic device encodes the extracted M frame shooting pictures into a time-lapse photography video, and the M frame shooting pictures include the X frame shooting pictures and the Y frame shooting pictures.
2. The method according to claim 1, characterized in that, after the electronic device starts recording each frame captured by the camera, the method further comprises:

   If it is detected that the variation amplitude of the shot content in the shooting picture during the first recording time period is less than a threshold, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency;

   If it is detected that the variation range of the captured content in the captured image during the second recording period is greater than or equal to the threshold, the electronic device determines that the frame drawing frequency in the second recording period is the second sampling. Frame frequency, the second frame sampling frequency is greater than the first frame sampling frequency.
3. The method according to claim 2, characterized in that, after the electronic device starts to record each frame captured by the camera, the method further comprises:

   The electronic device calculates the intensity of the optical flow between two adjacent frames of shooting images collected each time, and the optical flow intensity is used to reflect the variation range of the shooting content in the adjacent two frames of shooting images;

   Wherein, if it is detected that the variation amplitude of the shot content in the shooting picture during the first recording time period is less than a threshold, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency ,include:

   If it is detected that the optical flow intensity between two adjacent frames of shooting images in the first recording time period is less than a first preset value, the electronic device determines that the frame drawing frequency in the first recording time period is The first frame sampling frequency;

   Wherein, if it is detected that the variation range of the shot content in the shooting picture during the second recording time period is greater than or equal to the threshold, the electronic device determines that the frame sampling frequency in the second recording time period is the first Two frame rate, including:

   If it is detected that the optical flow intensity between two adjacent frames of captured images in the second recording time period is greater than or equal to the first preset value, the electronic device determines The frame sampling frequency is the second frame sampling frequency.
4. The method according to claim 2, wherein:

   If it is detected that the variation amplitude of the shot content in the shooting picture during the first recording time period is less than a threshold, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency, including :

   If it is detected that the N1 frames of shooting pictures collected in the first recording time period belong to the preset first shooting scene, the electronic device determines that the frame drawing frequency in the first recording time period is the first Frame rate

   If it is detected that the variation range of the captured content in the captured image during the second recording period is greater than or equal to the threshold, the electronic device determines that the frame drawing frequency in the second recording period is the second sampling. Frame frequency, including:

   If it is detected that the N2 frames of shooting pictures collected in the second recording time period belong to the preset second shooting scene, the electronic device determines that the frame sampling frequency in the second recording time period is the second Frame rate.
5. The method according to claim 2, wherein:

   If it is detected that the variation amplitude of the shot content in the shooting picture during the first recording time period is less than a threshold, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency, including :

   If it is detected that the moving speed of the shooting target in the first recording time period is less than a second preset value, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency;

   If it is detected that the variation range of the captured content in the captured image during the second recording period is greater than or equal to the threshold, the electronic device determines that the frame drawing frequency in the second recording period is the second sampling. Frame frequency, including:

   If it is detected that the movement speed of the shooting target in the second recording time period is greater than or equal to the second preset value, the electronic device determines that the frame sampling frequency in the second recording time period is the second Frame rate.
6. The method according to any one of claims 1 to 5, characterized in that, before the electronic device encodes the extracted M-frame shooting picture into a time-lapse photography video, the method further comprises:

   The electronic device uses a third frame sampling frequency to extract Z frames of shooting images from N3 frames of shooting images collected during the third recording time period. The third frame sampling frequency is compared with the second frame sampling frequency and the first frame sampling frequency. The frequency of one frame is different, the third recording time period does not overlap with the second recording time period and the first recording time period, and the M frame shooting picture includes the Z frame shooting picture.
7. The method according to any one of claims 1 to 6, characterized in that, after the electronic device starts to record each frame captured by the camera, the method further comprises:

   The electronic device displays each frame of the shooting picture being recorded in the preview picture in real time.
8. 8. The method according to claim 7, wherein when the electronic device displays each frame of the shooting picture being recorded in the preview picture in real time, the method further comprises:

   The electronic device displays the current recording duration and the playback duration of the time-lapse photography video corresponding to the recording duration in the preview screen in real time.
9. The method according to any one of claims 1-8, wherein the electronic device encoding the extracted M-frame shooting picture into a time-lapse photography video, comprising:

   The electronic device encodes the extracted M-frame shooting picture according to the preset frame rate as the time-lapse video of this time-lapse photography.
10. The method according to any one of claims 1-9, characterized in that, after the electronic device encodes the extracted M-frame shooting picture into a time-lapse photography video, the method further comprises:

    In response to the user's operation of opening the time-lapse video, the electronic device plays the time-lapse video according to a preset frame rate.
11. An electronic device, characterized in that it comprises:

    A touch screen, the touch screen including a touch-sensitive surface and a display screen;

    One or more processors;

    One or more memories;

    One or more cameras;

    And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions, when the instructions are executed by the electronic device When the time, the electronic device is caused to perform the following steps:

    Display the preview interface of time-lapse photography mode;

    In response to the recording operation performed by the user, start to record each frame of the shooting picture captured by the camera;

    Use the first frame drawing frequency to extract X frames of shooting pictures from N1 frames of shooting pictures collected in the first recording time period, X<N1;

    Use the second frame drawing frequency to extract Y frames of shooting pictures from the N2 frames of shooting pictures collected in the second recording time period, Y<N2, the second frame drawing frequency is different from the first frame drawing frequency, so The second recording time period does not overlap with the first recording time period;

    In response to the stop recording operation performed by the user, the extracted M-frame shooting pictures are encoded into a time-lapse photography video, and the M-frame shooting pictures include the X-frame shooting pictures and the Y-frame shooting pictures.
12. 11. The electronic device according to claim 11, wherein after the electronic device starts to record each frame captured by the camera, the electronic device is further configured to execute:

    If it is detected that the variation amplitude of the shot content in the shooting image during the first recording time period is less than a threshold value, determining that the frame drawing frequency in the first recording time period is the first frame drawing frequency;

    If it is detected that the variation range of the shooting content in the shooting image during the second recording time period is greater than or equal to the threshold, it is determined that the frame drawing frequency in the second recording time period is the second frame drawing frequency, so The second frame sampling frequency is greater than the first frame sampling frequency.
13. The electronic device according to claim 12, wherein after the electronic device starts to record each frame of the shooting picture captured by the camera, the electronic device is further configured to execute:

    Calculate the intensity of the optical flow between two adjacent frames of shooting images collected each time, where the optical flow intensity is used to reflect the variation range of the shooting content in the adjacent two frames of shooting images;

    Wherein, if it is detected that the variation amplitude of the shot content in the shooting picture during the first recording time period is less than a threshold, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency , Specifically including:

    If it is detected that the optical flow intensity between two adjacent frames of shooting images in the first recording time period is less than the first preset value, it is determined that the frame drawing frequency in the first recording time period is the first Frame rate

    Wherein, if it is detected that the variation range of the shot content in the shooting picture during the second recording time period is greater than or equal to the threshold, the electronic device determines that the frame sampling frequency in the second recording time period is the first Two frame rate, including:

    If it is detected that the optical flow intensity between two adjacent frames of shooting pictures in the second recording time period is greater than or equal to the first preset value, it is determined that the frame drawing frequency in the second recording time period is The second frame rate.
14. The electronic device according to claim 12, wherein:

    If it is detected that the variation amplitude of the shot content in the shooting picture during the first recording time period is less than the threshold, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency, specifically include:

    If it is detected that the N1 frames of shooting pictures collected during the first recording time period belong to the preset first shooting scene, the determining that the frame drawing frequency in the first recording time period is the first frame drawing frequency;

    If it is detected that the variation range of the captured content in the captured image during the second recording period is greater than or equal to the threshold, the electronic device determines that the frame drawing frequency in the second recording period is the second sampling. Frame frequency, including:

    If it is detected that the N2 frames of shooting pictures collected in the second recording time period belong to the preset second shooting scene, it is determined that the frame drawing frequency in the second recording time period is the second frame drawing frequency.
15. The electronic device according to claim 12, wherein:

    If it is detected that the variation amplitude of the shot content in the shooting picture during the first recording time period is less than the threshold, the electronic device determines that the frame drawing frequency in the first recording time period is the first frame drawing frequency, specifically include:

    If it is detected that the movement speed of the shooting target in the first recording time period is less than a second preset value, determining that the frame drawing frequency in the first recording time period is the first frame drawing frequency;

    If it is detected that the variation range of the captured content in the captured image during the second recording period is greater than or equal to the threshold, the electronic device determines that the frame drawing frequency in the second recording period is the second sampling. Frame frequency, including:

    If it is detected that the moving speed of the shooting target in the second recording time period is greater than or equal to the second preset value, it is determined that the frame drawing frequency in the second recording time period is the second frame drawing frequency.
16. The electronic device according to any one of claims 11-15, wherein before the electronic device encodes the extracted M-frame shooting picture into a time-lapse video, the electronic device is further configured to execute:

    Use the third frame sampling frequency to extract Z frames of shooting images from the N3 frames of shooting images collected during the third recording time period, the third frame sampling frequency is the same as the second frame sampling frequency and the first frame sampling frequency All are different, the third recording time period does not overlap with the second recording time period and the first recording time period, and the M frames of shooting pictures include the Z frames of shooting pictures.
17. 15. The electronic device according to any one of claims 11-16, wherein after the electronic device starts to record each frame captured by the camera, the electronic device is further configured to execute:

    The electronic device displays each frame of the shooting picture being recorded in the preview picture in real time.
18. The electronic device according to claim 17, wherein when the electronic device displays each frame of the shooting picture being recorded in the preview screen in real time, the electronic device is further configured to execute:

    The current recording duration and the playback duration of the time-lapse photography video corresponding to the recording duration are displayed in the preview screen in real time.
19. The electronic device according to any one of claims 11-18, wherein the electronic device encodes the extracted M-frame shooting picture into a time-lapse photography video, which specifically comprises:

    The extracted M-frame shooting pictures are encoded according to the preset frame rate as the time-lapse video of this time-lapse photography.
20. The electronic device according to any one of claims 11-19, wherein after the electronic device encodes the extracted M-frame shooting picture into a time-lapse video, the electronic device is further configured to execute:

    In response to the user's operation of opening the time-lapse photography video, the time-lapse photography video is played according to a preset frame rate.
21. A computer-readable storage medium having instructions stored in the computer-readable storage medium, characterized in that, when the instructions are executed on an electronic device, the electronic device is caused to execute any one of claims 1-10 The recording method of time-lapse photography described in the item.
22. A computer program product containing instructions, characterized in that, when the computer program product runs on an electronic device, the electronic device is caused to perform the recording of time-lapse photography according to any one of claims 1-10 method.

Images