WO2019183784A1 - 一种录像方法及电子设备 - Google Patents

一种录像方法及电子设备 Download PDF

Info

Publication number
WO2019183784A1
WO2019183784A1 PCT/CN2018/080575 CN2018080575W WO2019183784A1 WO 2019183784 A1 WO2019183784 A1 WO 2019183784A1 CN 2018080575 W CN2018080575 W CN 2018080575W WO 2019183784 A1 WO2019183784 A1 WO 2019183784A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
recording
electronic device
type
frame rate
Prior art date
Application number
PCT/CN2018/080575
Other languages
English (en)
French (fr)
Inventor
李远友
王妙锋
罗巍
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to PCT/CN2018/080575 priority Critical patent/WO2019183784A1/zh
Priority to EP18912537.0A priority patent/EP3764632B1/en
Priority to CN201880003516.8A priority patent/CN110506415B/zh
Priority to CA3095209A priority patent/CA3095209A1/en
Priority to JP2020551891A priority patent/JP7139440B2/ja
Priority to KR1020207030586A priority patent/KR102488747B1/ko
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to US17/041,971 priority patent/US20210092321A1/en
Priority to ES18912537T priority patent/ES2943093T3/es
Priority to BR112020019378-0A priority patent/BR112020019378A2/pt
Priority to AU2018415667A priority patent/AU2018415667B2/en
Publication of WO2019183784A1 publication Critical patent/WO2019183784A1/zh
Priority to PH12020551564A priority patent/PH12020551564A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/783Adaptations for reproducing at a rate different from the recording rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2621Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/951Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B2020/10935Digital recording or reproducing wherein a time constraint must be met
    • G11B2020/10981Recording or reproducing data when the data rate or the relative speed between record carrier and transducer is variable
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/005Reproducing at a different information rate from the information rate of recording

Definitions

  • the present application relates to the field of electronic technologies, and in particular, to a video recording method and an electronic device.
  • the number of frames played by the electronic device such as a mobile phone per second is less than the number of frames recorded per second during video recording, there will be a slow motion playback effect. For example, if the video is played at a frame rate of 30 frames per second (fps), if the electronic device records the video at a frame rate of 60 fps, there will be 2 times slow motion playback; if the electronic device Recording video at a video frame rate of 120fps will have 4 times slow motion playback.
  • fps frames per second
  • the human eye has limited ability to resolve high-speed moving objects, and slow-motion video helps people to see the details of motion during high-speed motion.
  • the higher the recording frame rate when recording video the better the slow motion playback effect, and the easier it is for the human eye to see the specific motion details.
  • the maximum frame rate supported by the image sensor is usually low, for example, 30fps, 60fps, 120fps or 240fps, and the recording frame rate of the electronic device is also 30fps, 60fps, 120fps or 240fps, which is usually not satisfied.
  • People want to distinguish the need for high-speed motion processes For example, referring to the playback effect diagram shown in FIG. 1, when the video of the drop falling process is recorded at a video frame rate of 240 fps, when the video is played at a playback frame rate of 30 fps, it is still difficult for the user to see the rebound process of the water drop falling on the water surface or fall. The details of the movement of the small drops of water splashing into the water.
  • the embodiment of the present invention provides a video recording method and an electronic device, which can make the video frame rate larger than the maximum frame rate supported by the image sensor hardware, and improve the user experience of recording slow motion video.
  • the embodiment of the present application provides a video recording method, which can be applied to an electronic device having an image sensor, including: the electronic device first turns on the camera, then displays a video preview interface, and records a video after detecting the user's recording instruction.
  • the video frame rate of the video is greater than the original frame rate, and the original frame rate is the maximum frame rate supported by the image sensor hardware during recording.
  • the video includes a slow motion type of video.
  • the recording frame rate of the electronic device can be greater than the maximum recording frame rate supported by the image sensor hardware, that is, the recording frame rate of the electronic device can be higher, and the slow motion video in the video recorded by the electronic device can be better. Meet the needs of users to distinguish high-speed motion processes.
  • the video further includes at least one of a fast motion type video or a normal speed type video; the video recording frame rate is a slow motion type video recording frame rate, and a slow motion type video The maximum or average of the recording frame rate and the recording frame rate of the slow motion type video.
  • the action of the video playback is fast and slow, which can give the user a strong visual impact and improve the user's shock and recording experience.
  • the length of the video is a preset length
  • the format of the video is a preset format.
  • the format includes the position of the video corresponding to the video type and the video type in the video, and the video type includes slow motion video and normal speed. At least one of a video or a fast motion video.
  • the method before recording the video, the method further includes: in the preview state, the electronic device collects the original video frame according to the original frame rate, and the electronic device caches the original video frame collected in the last T time, T is the preset length.
  • the recording of the video by the electronic device specifically includes: the electronic device generates the video according to the buffered original video frame and a preset format. In this scheme, the electronic device can cache the original video frame a certain time in advance, and generate a video according to the buffered original video frame, so as to be able to more effectively record the high-speed motion process that the user wants to play in slow motion.
  • the electronic device records the video, and specifically includes: the electronic device recording the video of the first video type. After the electronic device detects the second video type indication, switching to recording a video of the second video type, the first video type or the second video type is a slow motion video type. In this scheme, the user can control the type and format of the currently recorded video in real time.
  • the electronic device recording the video further includes: after detecting the pause indication of the user, the electronic device pauses to record the video; after detecting the user's continued recording indication, the electronic device continues to record the video; After the user stops the instruction, the electronic device stops recording the video.
  • the user can control the duration of the currently recorded video in real time.
  • the method further includes: the electronic device saves the video; and after detecting the parameter information indication of the user, the electronic device displays the parameter information of the video.
  • the parameter information includes a video frame rate of the video. In this way, the user can understand the video frame rate corresponding to the recorded video.
  • the electronic device recording the video includes: the electronic device acquiring the original video frame according to the original frame rate; inserting at least one new video frame between the different original video frames; the electronic device according to the original video frame and the new Video frames generate video. That is to say, the electronic device can increase the video frame rate by inserting frames.
  • the electronic device when the video to be recorded is of a slow motion type, the electronic device records the slow motion type video, which may include: the electronic device collects the original video frame according to the original video frame; the electronic device is adjacent to the original two. n new video frames are inserted between the video frames, n is a positive integer; the electronic device generates a slow motion type video according to the original video frame and the new video frame.
  • the electronic device can increase the video frame rate by inserting a frame, thereby improving the playback effect of the slow motion video.
  • the electronic device inserts n new video frames between two adjacent original video frames, where n is a positive integer, specifically including: the electronic device will be the first of the two adjacent original video frames.
  • An original video frame and a second original video frame are respectively divided into q image blocks, and q is a positive integer.
  • the electronic device searches for the image block j with the smallest residual value of the image block i in the preset range of the position corresponding to the image block i of the first original video frame on the second original video frame, and the image block j is the image Block i matches the image block.
  • the electronic device determines a motion vector of the image block according to a position of the image block on the second original video frame that matches the first original video frame. Thereafter, the electronic device determines the position of the image block in the n new video frames to be inserted according to the motion vector of the image block. Then, the electronic device generates n new video frames to be inserted according to the positions of the image blocks in the n new video frames to be inserted. The electronic device then inserts the generated n new video frames between the first original video frame and the second original video frame. In this scheme, the electronic device can accurately determine the motion vector through the matched image block, and generate a video frame to be inserted according to the motion vector, thereby inserting a new video frame in a software manner, which can save cost and is easy to maintain.
  • an embodiment of the present application provides a video recording method, including: First, an electronic device turns on a camera. Then, the electronic device displays a video preview interface. In the preview state, the electronic device acquires the original video frame according to the original frame rate. After detecting the user's recording instruction, the electronic device generates a video according to the cached original video frame and a preset format. The video frame rate of the video is greater than the original frame rate, and the original frame rate is the maximum frame rate supported by the image sensor hardware during recording, and the video includes a slow motion type video.
  • the length of the video is a preset length
  • the format of the video is a preset format, where the format includes a video type and a video type corresponding to the position of the video in the video, and the video type includes slow motion video, constant speed video, or fast motion video. At least one.
  • an embodiment of the present application provides an electronic device, where the electronic device includes an image sensor, the electronic device further includes: an opening unit for turning on the camera; a display unit for displaying a video preview interface; and a recording unit for detecting Recording video after the user's recording instruction, the video recording frame rate is greater than the original frame rate, the original frame rate is the maximum frame rate supported by the image sensor hardware during recording, and the video includes slow motion type video.
  • the video also includes at least one of a fast action type video or a normal speed type video.
  • the video frame rate of the video is the maximum or average of the recording frame rate of the slow motion type video, the video frame rate of the slow motion type video, and the video frame rate of the slow motion type video.
  • the length of the video is a preset length
  • the format of the video is a preset format.
  • the format includes the position of the video corresponding to the video type and the video type in the video, and the video type includes slow motion video and normal speed. At least one of a video or a fast motion video.
  • the recording unit is specifically configured to: before the video is recorded, in the preview state, collect the original video frame according to the original frame rate; cache the original video frame collected in the last T time, and T is a preset length. ; Generate video based on the cached original video frame and the preset format.
  • the recording unit is specifically configured to: record the video of the first video type; after detecting the second video type indication, switch to recording the video of the second video type, the first video type or the second
  • the video type is a slow motion video type.
  • the recording unit is specifically configured to: after detecting the pause indication of the user, pause the recording of the video; after detecting the continuous recording instruction of the user, continue to record the video; after detecting the stop instruction of the user , stop recording video.
  • the electronic device further includes: a saving unit, configured to save the video after the recording unit records the video; the display unit is further configured to: after detecting the parameter information indication of the user, display the parameter information of the video, The parameter information includes the video frame rate of the video.
  • the recording unit is specifically configured to: acquire an original video frame according to an original frame rate; insert at least one new video frame between different original video frames; generate a video according to the original video frame and the new video frame. .
  • an embodiment of the present application provides an electronic device including one or more processors and one or more memories.
  • the one or more memories are coupled to one or more processors for storing computer program code, the computer program code comprising computer instructions for causing the electronic device to perform when the one or more processors execute the computer instructions
  • embodiments of the present application provide a computer storage medium comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform a video recording method in any of the above-described possible aspects.
  • embodiments of the present application provide a computer program product that, when run on a computer, causes the computer to perform a video recording method in any of the possible designs of any of the above aspects.
  • FIG. 1 is a schematic diagram of a slow motion video playback effect in the prior art
  • FIG. 2 is a schematic structural diagram of hardware of a mobile phone according to an embodiment of the present application.
  • FIG. 3 is a flowchart of a video recording method according to an embodiment of the present application.
  • FIG. 4 is a schematic diagram of a video recording process according to an embodiment of the present application.
  • FIG. 5 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a slow motion video playback effect according to an embodiment of the present application.
  • FIG. 7 is a comparison diagram of slow motion, normal speed, and fast motion video according to an embodiment of the present application.
  • 8-1 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • 8-2 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • 8-3 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • FIG. 10-1 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • FIG. 10 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • Figure 11-1 is a schematic diagram of a setting interface provided by an embodiment of the present application.
  • FIG. 11-2 is a schematic diagram of another setting interface provided by an embodiment of the present application.
  • FIG. 12 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • FIG. 13 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • FIG. 14-1 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • 14-2 is a schematic diagram of another video recording process according to an embodiment of the present application.
  • FIG. 15 is a schematic diagram of another setting interface provided by an embodiment of the present application.
  • FIG. 16-1 is a schematic diagram of a playback process according to an embodiment of the present application.
  • FIG. 16 is a schematic diagram of a playback process according to an embodiment of the present application.
  • FIG. 17-1 is a schematic diagram of parameter information display according to an embodiment of the present application.
  • FIG. 17 is a schematic diagram of another parameter information display according to an embodiment of the present application.
  • FIG. 18 is a flowchart of another video recording method according to an embodiment of the present application.
  • FIG. 19 is a schematic diagram of a downsampling process according to an embodiment of the present application.
  • FIG. 20 is a schematic diagram of a motion vector calculation process according to an embodiment of the present application.
  • FIG. 21 is a schematic diagram of two motion vector fields provided by an embodiment of the present application.
  • FIG. 22 is a schematic diagram of a frame insertion effect according to an embodiment of the present application.
  • FIG. 23 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • Original Frame Rate The maximum number of video frames that can be captured per unit of time supported by the image sensor's hardware during video recording.
  • Recording frame rate The number of video frames recorded by the electronic device per unit time.
  • the video frame rate is the total number of video frames per unit time after the frame insertion, which is greater than the original frame rate.
  • Play Frame Rate The number of video frames played by the electronic device per second during video playback.
  • the recording method provided by the embodiment of the present application can be applied to a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an augmented reality (AR)/virtual reality (VR) device, a notebook computer, a super mobile personal computer (
  • the ultra-mobile personal computer (UMPC), the netbook, the personal digital assistant (PDA), and the like can be used for any video recording by the camera.
  • the mobile phone 200 may include a communication module 220, a memory 230, a sensor module 240, an input device 250, a display screen 260, an audio module 280, a processor 210, a camera module 291, a power management module 295, and the like. These components can be connected by bus or directly. It will be understood by those skilled in the art that the structure of the handset shown in FIG. 2 does not constitute a limitation to the handset, and may include more components than FIG. 2, or combine some components, or different component arrangements.
  • the camera module 291 can be used to collect images through the camera, thereby performing photographing, video recording, video chatting, video conferencing, scanning two-dimensional code/barcode, and facial information recognition.
  • the video can include slow motion video, normal speed video or fast lens video.
  • the communication module 220 is configured to communicate with other network entities, such as receiving information from a server or transmitting related data to a server.
  • the communication module 220 may include a radio frequency (RF) module 229, a cellular module 221, a wireless fidelity (WIFI) module 223, a GPS module 227, and the like.
  • the RF module 229 can be used for transmitting and receiving information or during a call, receiving and transmitting signals, and in particular, processing the received information to the processor 210; in addition, transmitting the signal generated by the processor 210.
  • RF circuitry 21 may include, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like.
  • the RF circuit 21 can also communicate with the network and other devices through wireless communication.
  • the cellular module 221 and the WIFI module 223 can be used to connect to a network.
  • the GPS module can be used for positioning or navigation.
  • the processor 210 is a control center of the handset 200 that connects various portions of the entire handset using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 230, and recalling data stored in the memory 230, The various functions and processing data of the mobile phone 200 are executed to perform overall monitoring of the mobile phone 200.
  • processor 210 may include one or more processing units.
  • the memory 230 can be used to store data, software programs, and modules, and can be a volatile memory, such as a random-access memory (RAM), or a non-volatile memory.
  • RAM random-access memory
  • non-volatile memory For example, a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or a combination of the above types of memories.
  • the program code is stored in the memory 230, and the program code is used to enable the processor 210 to execute the prompt information display method provided by the embodiment of the present application by executing the program code.
  • the memory 230 can include an internal memory 232 and an external memory 234.
  • the sensor module 240 may include a gesture sensor 240A, a gyro sensor 240B, a barometric pressure sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, etc., and may be used to detect the magnitude of the acceleration of the mobile phone in various directions (generally three axes), and may be detected at rest.
  • the size and direction of gravity can be used to identify the gesture of the phone (such as the angle of the phone tilt, face up, side up, horizontal and vertical screen switching, related games, magnetometer attitude calibration or motion), vibration recognition related functions (such as Pedometer, tapping or moving).
  • the mobile phone 200 may further include other sensors, such as a grip force sensor (which can be used to detect whether the mobile phone is in a handheld state), a proximity sensor (a displacement sensor can be used to identify a close object to identify the proximity of the object), RGB Sensors, biometric sensors, temperature/humidity sensors, light sensors (which can be used to detect whether the phone is in a pocket, bag, etc.) or UV sensors, etc., are not described here.
  • sensors such as a grip force sensor (which can be used to detect whether the mobile phone is in a handheld state), a proximity sensor (a displacement sensor can be used to identify a close object to identify the proximity of the object), RGB Sensors, biometric sensors, temperature/humidity sensors, light sensors (which can be used to detect whether the phone is in a pocket, bag, etc.) or UV sensors, etc., are not described here.
  • the input device 250 can include a touch panel (TP) 252, a pen sensor 254, a button 256, an ultrasound input device 258, and an input sensing module 259, etc., for implementing input and output functions of the handset 200.
  • TP touch panel
  • pen sensor 254 a pen sensor 254
  • button 256 a button 256
  • ultrasound input device 258 an ultrasound input device 258
  • input sensing module 259 etc.
  • Display 260 can include devices such as display panel 262, holographic device 264, and projector 266.
  • the display panel 262 can be used to display a graphical user interface (GUI) on the mobile phone, and the graphic user interface includes various application icons, service icons, widgets, or logos.
  • GUI graphical user interface
  • the display screen 260 may be an LCD or OLED screen with a touch function or the like.
  • the touch panel 252 and the display panel 262 may also be referred to as a touch display screen, and the touch display screen may collect touch operations on or near the user (such as the user using a finger, a stylus, or the like, any suitable object or accessory in the touch display.
  • the operation on the screen or near the touch display screen), and the corresponding connection device is driven according to a preset program. It can also be used to display information entered by the user or information provided to the user (such as images captured by the camera) as well as various menus of the mobile phone.
  • the touch display screen can be implemented in various types, such as a resistive type, a capacitive type, an infrared light sensation, and an ultrasonic wave, which is not limited in the embodiment of the present invention.
  • the operation of the user in the vicinity of the touch display screen may be referred to as a hovering touch
  • the touch display screen capable of performing the hover touch may be implemented by using a capacitive type, an infrared light sense, and an ultrasonic wave.
  • a target such as a finger approaches or moves away from the capacitive touch display screen
  • the current of the self-capacitance and mutual capacitance in the touch display screen changes accordingly, so that the electronic device can detect the floating measurement and control.
  • the infrared light touch display screen can use the infrared LED and the infrared light emitting diode to emit light, and the mobile phone realizes the recognition and tracking of the hovering gesture by detecting the screen light reflected back by the target such as the user's finger.
  • the audio module 280 can include a speaker 282, a receiver 284, an earphone 286, or a microphone 288, etc., which the user can capture or play.
  • the power management module 295 can include a battery 296 for logically connecting to the processor 210 through the power management system to implement functions such as managing charging, discharging, and power management through the power management system.
  • the mobile phone 200 may further include a function module such as a user identification module, an indicator, a motor, and the like, and details are not described herein again.
  • a function module such as a user identification module, an indicator, a motor, and the like, and details are not described herein again.
  • an embodiment of the present application provides a video recording method, which can be applied to an electronic device having an image sensor, and the method may include:
  • the electronic device turns on the camera.
  • the user can instruct the electronic device to turn on the camera.
  • the user can instruct the electronic device to turn on the camera by clicking the camera icon, or the user can instruct the electronic device to turn on the camera by voice, or the user can draw a "C" shaped trajectory on the screen in a black screen state to instruct the electronic device to turn on the camera, etc.
  • the triggering manner of the electronic device to turn on the camera is not limited in the embodiment of the present application.
  • the electronic device displays a video preview interface.
  • the electronic device if the electronic device directly enters the photographing mode or other non-recording mode after the camera is turned on, the user can instruct to switch to the recording mode, and the electronic device opens the recording preview interface 110.
  • the electronic device directly enters the recording mode after the camera is turned on (for example, the recording mode is defaulted after the electronic device is turned on, or the recording mode is used when the user last used the camera), the electronic device directly opens the recording preview interface. 110.
  • the video preview interface the user can preview the object to be photographed.
  • the electronic device records a video after detecting the user's recording instruction, and the video recording frame rate is greater than the original frame rate, and the original frame rate is a maximum frame rate supported by the image sensor hardware during recording, and the video includes a slow motion type video.
  • the electronic device starts to record a video after detecting the user's recording instruction
  • the recording instruction may be in various forms, for example, may be a voice indication, or may be a user clicking an indication of the recording button 120 as shown in FIG. 4 or FIG. 5, etc., the application The embodiment does not specifically limit this.
  • the video frame rate of the video is greater than the original frame rate, that is, the video frame rate of the electronic device is not limited by the image sensor hardware capability in the electronic device. For example, if the maximum frame rate supported by the image sensor hardware of the electronic device is 240 fps, the actual recording frame rate when the electronic device records the video may be greater than 240 fps.
  • the maximum frame rate that can be supported by the image sensor hardware used in the electronic device can be known according to the model of the image sensor, the data sheet, and the specification parameters.
  • the average video frame rate of the video recorded by the electronic device and the actual video frame rate of the video during each time period can be obtained through testing.
  • the higher the video frame rate the more video frames the electronic device records per unit time, the more motion details presented on the video frames, and the jump between image details on different video frames.
  • the recording frame rate of the electronic device when the recording frame rate of the electronic device is greater than the maximum recording frame rate supported by the image sensor hardware, the recording frame rate of the electronic device can be higher, and the slow motion video in the video recorded by the electronic device can be more Good to meet the needs of users to distinguish high-speed motion process.
  • FIG. 6 can be seen as a schematic diagram of the playback effect of the slow motion video recorded by the recording method provided by the embodiment of the present application. As can be seen by comparing Fig. 6 with Fig. 1, Fig. 6 allows the user to more clearly see the details of the motion of the collision and rebound when the water drop falls.
  • the recording frame rate of the electronic device is larger than the maximum frame rate supported by the image sensor hardware, which is equivalent to expanding the recording capability of the image sensor itself, and the electronic device adopts an image sensor with a lower hardware configuration ( For example, when the original frame rate is 30fps or 60fps, the video frame rate can be increased to 960tps or higher, which can meet the user's demand for slow-motion video recording and improve the user's recording experience.
  • the prior art which further includes a layer of dynamic random access memory (DRAM) between the pixel section and the circuit section.
  • DRAM dynamic random access memory
  • the DRAM can be used to temporarily store recorded image data, enabling the image sensor to process more image frames per unit time, enabling the three-layer image sensor hardware to support a maximum frame rate of 960 fps.
  • the recording frame rate of the electronic device can only be the maximum frame rate supported by the image sensor hardware, and does not exceed the maximum frame rate supported by the image sensor hardware. .
  • the electronic device using the special three-layer image sensor has a short recording time (for example, only 0.2 seconds can be recorded), and the resolution is low (for example, only 720p), which is difficult to satisfy the user. Video needs.
  • the video frame rate of the electronic device can be not only greater than the maximum frame rate supported by the image sensor hardware, and the limitation of the hardware DRAM storage capacity is not considered, and the recording duration and resolution are not limited (for example, video recording)
  • the duration can be ten minutes or longer, and the resolution can be 1080p or higher.
  • Normal image sensors that do not include DRAM can also be used.
  • the electronic device may first record the original video frame according to the original frame rate, and then insert the frame between the adjacent original video frames according to the original video frame, so that the recording frame rate is higher than the original frame rate.
  • the electronic device can increase the recording frame rate by inserting a frame; and when recording a non-slow motion type video, the frame insertion processing is not performed, and the original frame rate is used for video recording.
  • the video recorded by the electronic device may include at least one of a fast action type video or a normal speed type video, in addition to the slow motion type video.
  • the fast action type may also include time-lapse photography (or time-lapse photography). That is to say, the video recorded by the electronic device can be a combination of videos of different video types.
  • the slow motion type video can be understood as the video frame captured during the T1 time period is played in the T2 time period, and T1 ⁇ T2; corresponding to the slow motion video type, the fast motion type video can be understood as the T1 time period.
  • the captured video frame is played during the T3 time period, and T1>T3.
  • the video of the normal speed type is recorded and played according to the normal time relationship. It can be understood that the video frame captured during the T1 time period is played during the T1 time period.
  • the electronic device may perform an equally spaced frame processing on the original video frame collected according to the original frame rate, thereby generating a fast action type video according to the framed video frame.
  • the action of the video playback is fast and slow, which can give the user a strong visual impact and improve the user's shock and recording experience.
  • the video frame rate of the video when the recorded video includes only the slow motion type video, the video is entirely a slow motion video, and the video frame rate of the video is the video frame rate of the slow motion type video, the slow motion type video.
  • the video frame rate is greater than the original frame rate.
  • the frame rate of the video may be the maximum value of the corresponding video frame rate of different types of video, or respectively corresponding to different types of video.
  • the recording mode of the electronic device may include a plurality of types.
  • the recording mode may specifically include a first recording mode and a second recording mode, where the first recording mode is used for recording a normal normal speed video; when the user selects the second recording mode, the electronic device passes the application.
  • the method provided by the embodiment performs video recording, and the recording frame rate is greater than the original frame rate.
  • the user can click the setting button to open various settings related to recording, and select one of a plurality of specific recording modes.
  • the video preview interface of the super video mode is entered, and the electronic device performs video recording by using the method provided by the embodiment of the present application, and the recording frame rate is greater than the original frame. rate.
  • the user can also click the setting button to open various settings related to photographing and recording, and select super recording from a variety of specific recording modes.
  • the mode is to enter the video preview interface of the super video mode, and the video recording is performed by the method provided by the embodiment of the present application.
  • the length of the video recorded by the electronic device may be a preset duration, which may be preset when the electronic device is shipped from the factory, or may be preset by the user.
  • the video is a preset length, the user only needs to trigger the recording instruction, and the video recording can be automatically completed without triggering the stop instruction, thereby reducing the manual operation of the user and giving the user a better experience of intelligent recording.
  • the electronic device may only include a recording button without including a pause button and a stop button.
  • the preset length may be shorter, for example, may be less than or equal to 1 minute, to meet the requirement for the user to automatically record short video. Moreover, since some sharing platforms have restrictions on the duration of the video (for example, the duration of the video requested by WeChat should not exceed 10 s), when the video is a preset length, the preset length may be less than or equal to the duration limit of the sharing platform, so that It is convenient for users to upload and share this video.
  • the electronic device may generate a video according to the cached original video frame. Before the step 303, in the preview state, the electronic device may also collect the original video frame according to the original frame rate, and cache the original video frame collected in the last T time.
  • the motion process to be photographed may have started for a while, especially when the motion process is high speed.
  • the motion process to be photographed may have ended, so the electronic device can buffer the original video frame a certain time in advance, and generate a video according to the buffered original video frame, so as to be able to record more effectively the user wants to play in slow motion.
  • the high speed movement process The way in which an electronic device caches a video frame a certain time in advance can improve the user experience when recording an object that is instantaneously moving at a high speed.
  • T may be the preset length.
  • FIG. 10-1 and FIG. 10-2 a schematic diagram of a recording process corresponding to the implementation manner can be seen in FIG. 10-1 and FIG. 10-2.
  • the electronic device may not generate a video immediately after the electronic device clicks the record button and display the generated video at 130 positions, see Figure 10-1 and Figure 10- (d) of 2, after a while, the electronic device will display the generated video at area 130 to prompt the user that the video has been recorded.
  • the electronic device since the original video frame needs to be buffered in advance, in the preview state, the electronic device needs to align the subject to perform image acquisition in real time.
  • the video recorded by the electronic device may have a plurality of different formats
  • the format content may include a video type and a video type corresponding to the position of the video in the video, the video type including slow motion video, and often At least one of a speed video or a fast motion video.
  • the format can be seen in Table 1 below.
  • the format of the video recorded by the electronic device may be a preset format.
  • the identification and identification of the electronic device or the electronic device of the model can be improved.
  • the electronic device can automatically generate a video with strong identification and easy sharing after the user triggers the recording instruction.
  • the electronic device can collect the original video frame according to the original frame rate, and cache the most recent video frame.
  • the original video frame captured in the preset length T time.
  • the electronic device may generate a video having a preset length and a preset format according to the buffered original video frame and a preset format.
  • the recording process diagram can also be seen in FIG. 10-1 or FIG. 10-2.
  • the user before recording a video, the user can open a setting interface to select a format to be recorded from among multiple candidate formats of the video; when recording the video, the electronic device can be based on the user. Record the video in the format you want to record.
  • the user can also independently set the format of the video to be recorded, and the electronic device can generate a personalized video according to the format set by the user.
  • the length of the video is controlled by the user in real time during the recording process according to actual needs, and the user can select the motion process to be recorded by pausing, continuing, and stopping instructions, skipping the unwanted motion.
  • the motion of the recording Specifically, referring to FIG. 12, when the video is recorded, if the electronic device detects the user's pause indication, the video is paused; if the electronic device detects the user's continued recording instruction, the video is continuously recorded; if the electronic device detects the user's Stop the recording and stop recording the video.
  • 160 denotes a pause button, 170 denotes a resume recording button, and 180 denotes a stop button.
  • the electronic device may also collect the original video frame according to the original frame rate, and cache the most recent T time.
  • the original video frame in step 303, the electronic device generates a video frame according to the buffered original video frame and the original video frame acquired after detecting the user's recording instruction.
  • the electronic device may not cache the original video frame in advance, and the electronic device performs real-time processing according to the collected original video frame after detecting the user's recording instruction, thereby generating a video. Therefore, after the user triggers the stop instruction, the electronic device basically completes the recording of the video. As shown in FIG. 12, after the user clicks the stop button 180, the electronic device can display the generated video almost at the area 130.
  • the recording of the video by the electronic device in step 303 may specifically include: the electronic device recording the video of the first video type; after detecting the second video type indication The electronic device switches to recording a video of the second video type.
  • the first video type is different from the second video type, and the first video type or the second video type is a slow motion video type.
  • the initial video type that the electronic device detects the user's recording instruction and has just started recording may be a preset video type.
  • the electronic device may start recording the video corresponding to the initial video type after detecting the user's recording indication and the initial video type indication.
  • the initial video type is a constant speed video type
  • the user records a constant speed video type video after the user clicks the recording button
  • the time period T before the detection of the user slow motion type indication time and the detection of the user may be specifically
  • the slow motion type indicates that the video frame after the time is interpolated to generate a slow motion video.
  • the motion process to be shot may have started for a while, especially When the motion process is a high-speed motion process, the motion process to be photographed may have ended, and thus the electronic device may record the slow motion video for a period of time in advance according to the original video frame in the time period T before the time indicating the user's slow motion type. So that the user can more effectively record the motion process that you want to play in slow motion.
  • the electronic device can automatically switch the video recording type during the recording process. For example, when the moving speed of the subject is greater than or equal to the preset value, it can be switched to the slow motion type video for recording; when the moving speed of the subject is less than the preset value, it can be switched to the normal speed type or the fast motion type. Video recording.
  • the electronic device recognizes the subject, the image is switched to the format corresponding to the object to be photographed for video shooting. For example, the electronic device can initially record a video of a default type (for example, a normal speed type).
  • format 4 can be: fixed time 0.3s, fast motion video (0.05s) + slow motion video (0.25s).
  • the electronic device automatically switches the video recording type, the type of video recorded at the current time can also be displayed in real time during recording.
  • the correspondence between the object to be photographed and the format may be pre-stored in the electronic device.
  • the electronic device detects the object to be photographed indicated by the user, the video may be recorded according to the format corresponding to the object to be photographed.
  • the video recorded by the electronic device may also include only at least one of a fast action type or a slow motion type
  • the format of the video in Table 1 may also include only the fast action type or the slow motion type. At least one of them.
  • the format of the video in Table 1 may further include format 7: t1 second constant speed video + t2 second fast video + t3 second constant speed video.
  • the electronic device can automatically play the recorded video, so that the user can view the recording effect of the slow motion video in time; or, after the video recording is completed, the electronic device can display the waiting as shown in Figure 16-1.
  • the play interface plays the video after the user instructs to play; or, as shown in FIG. 16-2, after the video recording is completed, the video is played after the user's play instruction is detected.
  • the electronic device may save the recorded video, and after detecting the parameter information indication used by the user to view the saved video, display the parameter information of the video.
  • the parameter information includes the video frame rate of the video, so that the user can understand the recorded video, especially the video frame rate of the slow motion video.
  • the parameter information can also have other information, so that the user has a more detailed understanding of various aspects of the video.
  • other information may include one or more of a file name, time, location, file format, width, height, duration, file size, resolution, model, manufacturer, or path.
  • the video frame rate of the video in the parameter information may also be the maximum value or the average value; or the parameter information may also display different types of video respectively.
  • the corresponding video frame rate may also be the maximum value or the average value; or the parameter information may also display different types of video respectively.
  • the electronic device displays specific parameter information.
  • step 303 of the embodiment of the present application regardless of whether the format of the video to be recorded is a preset format, if the video or video to be recorded at the current moment is of a slow motion type, the electronic device records the video of the slow motion type. Specifically, it may include:
  • the electronic device collects an original video frame according to the original video frame.
  • the electronic device inserts n new video frames between two adjacent original video frames, where n is a positive integer.
  • the original video frame in which the n new video frames are inserted may be the original video frame buffered in advance in the preview state, or may be the video frame collected by the electronic device after detecting the video indication of the user. By inserting the frame processing, the electronic device can increase the video frame rate to the n* original frame rate.
  • the electronic device generates a slow motion type video according to the original video frame and the new video frame.
  • the electronic device does not need to perform frame interpolation processing.
  • FIG. 18 shows a flow chart of another type of electronic device recording a slow motion type video, which may mainly include an image sensor in the electronic device to acquire an original video frame, and an image signal processor.
  • the image signal processing (ISP) processes the original video frame, and then the electronic device increases the video frame rate, and then the electronic device performs video encoding to generate a video.
  • the process of increasing the video frame rate of the electronic device may include preprocessing, motion estimation, motion vector post-processing, and frame interpolation processing. The following description will be made by taking the adjacent original video frame 1 and the original video frame 2 as an example.
  • a small image block subsequent processing will be based on the image block.
  • the electronic device downsamples the original video frame 1 and the original video frame 2, respectively, into an image with a smaller resolution, so as to perform subsequent complicated calculation based on the small resolution map, thereby reducing the amount of calculation.
  • 100 denotes an original video frame
  • 190 denotes an image block
  • small dots in Figs. (a) and (b) denote pixels.
  • the electronic device calculates the motion vector (x+u, y+v) of the current image block 1 according to the coordinates of the current image block 1 in the original video frame 1 and the coordinates of the image block 2 in the original video frame 2.
  • x, y represents the coordinates of the current image block 1 in the original video frame 1
  • (u, v) represents the positional offset of the image block 2 with respect to the current image block 1.
  • the electronic device can improve the accuracy and smoothness of the motion vector by smoothing filtering methods such as neighborhood value filtering or weighted average filtering.
  • smoothing filtering methods such as neighborhood value filtering or weighted average filtering.
  • the electronic device calculates the positions of the n image blocks corresponding to the image block 1 and the image block 2 among the n new video frames to be inserted according to the processed motion vector. After determining the positions of the q image blocks in the n new video frames to be inserted, respectively, the n image blocks to be inserted are generated, and the n image blocks to be inserted are inserted into the original video block 1 and the original video block. Between 2.
  • a schematic diagram of the effect after inserting a frame can be seen in FIG. 22. Specifically, in Fig. 22, (a) and (b) represent original video frames, and (c) and (d) represent new video frames inserted between the original video frames (a) and (b).
  • the embodiment of the present application performs frame insertion by a software method, which is lower in cost and easy to update and maintain.
  • the recording method provided by the embodiment of the present application is to insert a frame during the recording process, and the frame insertion process can be transmitted to other devices or transferred to other devices during the recording process compared with the frame insertion process during the playback process. Slow motion playback is still achieved when the media is played back again.
  • the electronic device includes corresponding hardware structures and/or software modules for performing various functions.
  • the present application can be implemented in a combination of hardware or hardware and computer software in combination with the algorithmic steps of the various examples described in the embodiments disclosed herein. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present application.
  • the embodiments of the present application may divide the functional modules of the electronic device and the server according to the foregoing method.
  • each functional module may be divided according to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of the modules in the embodiments of the present application is schematic, and only one logical function is divided, and the actual implementation may have another division manner.
  • FIG. 23 is a schematic diagram showing a possible composition of the electronic device involved in the foregoing embodiment.
  • the electronic device 2300 may include: a starting unit 2301. , a display unit 2302 and a recording unit 2303.
  • the determining unit 2301 can be used to support the electronic device 2300 to perform step 301 in the recording method shown in FIG.
  • the display unit 2302 can be used to support the electronic device 2300 to perform step 302 in the recording method shown in FIG.
  • the recording unit 2303 can be used to support the electronic device 2300 to perform step 303 in the recording method shown in FIG.
  • the recording unit 2303 is further configured to: support the electronic device 2300 to collect the original video frame according to the original frame rate in the preview state; cache the original video frame collected in the last T time, T is a preset length; according to the cached original video frame and the pre- Format the generated video.
  • the recording unit 2303 is further configured to support the electronic device 2300 to first record the video of the first video type; after detecting the second video type indication, switch to record the video of the second video type, the first video type or the second video.
  • the type is a slow motion video type.
  • the recording unit 2303 is further configured to: after the electronic device 2300 detects the pause indication of the user, pause the recording of the video; after detecting the continuous recording instruction of the user, continue to record the video; after detecting the stop instruction of the user, stop recording the video. .
  • the recording unit 2303 is further configured to support the electronic device 2300 to acquire an original video frame according to an original frame rate; insert at least one new video frame between different original video frames; and generate a video according to the original video frame and the new video frame.
  • the electronic device 2300 may further include a saving unit 2304, which may be used to support the electronic device 2300 to save the video after the recording unit records the video.
  • the display unit 232 is further configured to support the electronic device 2300 to display parameter information of the video after detecting the parameter information indication of the user, where the parameter information includes a video frame rate of the video.
  • the electronic device provided by the embodiment of the present application is configured to perform the above recording method, and thus the same effects as the above-described recording method and GUI display method can be achieved.
  • the above-mentioned opening unit 2301 and recording unit 2303 may be integrated into a processing module, and the above-mentioned display unit 2302 is integrated into a display module, and the above-mentioned saving unit is integrated into a storage module.
  • the processing module is configured to control and manage the actions of the electronic device.
  • the processing module is configured to support the electronic device to perform steps 301 and 303 in FIG. 3, and/or other processes for the techniques described herein.
  • the display module can be used to support the electronic device to perform step 302 in FIG. 3, and can also display a graphical user interface, image or parameter information, and the like to the user.
  • the storage module is used to store program code of the electronic device, recorded video, and various parameter information of the video.
  • the processing module may be a processor or a controller, for example, may be a central processing unit (CPU), a graphics processing unit (GPU), a general-purpose processor, a digital signal processor (digital signal processor, DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure.
  • the processor can also be a combination of computing functions, for example, including one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.
  • the display module can be a display, and can be used to display information input by the user, information provided to the user, and various menus of the terminal.
  • the display can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • a touch panel can be integrated on the display for collecting touch events on or near the display, and transmitting the collected touch information to other devices (such as a processor, etc.).
  • the memory module may be a memory, which may include a high speed RAM, and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • the electronic device can also include a communication module that can be used to support communication of the electronic device with other network entities, such as communication with a server.
  • the communication module may specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, and a WIFI chip.
  • the processing module is a processor
  • the display module is a display
  • the storage module is a memory
  • the electronic device involved in the embodiment of the present application may specifically be the mobile phone shown in FIG. 2 .
  • the embodiment of the present application further provides a computer storage medium, where the computer storage medium stores computer instructions.
  • the computer instruction When the computer instruction is run on the electronic device, the electronic device performs the foregoing method steps to implement the recording method in the foregoing embodiment.
  • the embodiment of the present application further provides a computer program product, when the computer program product is run on a computer, causing the computer to perform the above related method steps to implement the video recording method in the foregoing embodiment.
  • the embodiment of the present application further provides a device, which may be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store a computer to execute instructions, when the device is running, The processor may execute a computer-executable instruction stored in the memory to cause the chip to perform the recording method in the various method embodiments described above.
  • the electronic device, the computer storage medium, the computer program product, or the chip provided by the embodiment of the present application are all used to perform the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the corresponding correspondence provided above. The beneficial effects of the method are not repeated here.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of modules or units is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or It can be integrated into another device, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed to a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • An integrated unit can be stored in a readable storage medium if it is implemented as a software functional unit and sold or used as a standalone product.
  • the technical solution of the embodiments of the present application may be embodied in the form of a software product in the form of a software product in essence or in the form of a contribution to the prior art, and the software product is stored in a storage medium.
  • a number of instructions are included to cause a device (which may be a microcontroller, chip, etc.) or a processor to perform all or part of the steps of the various embodiments of the present application.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)
  • Studio Devices (AREA)
  • Television Systems (AREA)
  • Printers Or Recording Devices Using Electromagnetic And Radiation Means (AREA)
  • Recording Measured Values (AREA)
  • Electrophotography Using Other Than Carlson'S Method (AREA)

Abstract

本申请实施例提供了一种慢动作视频录制方法及电子设备,涉及摄像技术领域,能够使得录像帧率大于图像传感器硬件支持的最大帧率,提高用户录制慢动作视频的体验。具体方案为:电子设备通过插帧提高录制慢动作视频的录像帧率。本申请实施例用于录像。

Description

一种录像方法及电子设备 技术领域
本申请涉及电子技术领域,尤其涉及一种录像方法及电子设备。
背景技术
在进行视频播放时,若手机等电子设备每秒播放的帧数小于视频录制时每秒录制的帧数,则会有慢动作的播放效果。例如,如果以30帧/秒(frames per second,fps)的播放帧率播放视频,那么若电子设备以60fps的录像帧率录制视频,则会有2倍的慢动作播放效果;若电子设备以120fps的录像帧率录制视频,则会有4倍的慢动作播放效果。
人眼对高速运动物体的分辨能力有限,慢动作视频有助于人们看清楚高速运动过程的运动细节。录制视频时的录像帧率越高,慢动作播放效果越好,人眼越容易看清具体的运动细节。
目前,手机等电子设备中,图像传感器支持的最大帧率为通常较低,例如为30fps、60fps、120fps或240fps等,电子设备的录像帧率也为30fps、60fps、120fps或240fps,通常不能满足人们希望分辨高速运动过程的需求。例如,参见图1所示的播放效果图,当采用240fps的录像帧率录制水滴下落过程的视频,采用30fps的播放帧率播放视频时,用户仍然难以看清水滴落到水面的反弹过程或者落到水面时溅起的小水珠的运动细节。
发明内容
本申请实施例提供一种录像方法及电子设备,能够使得录像帧率大于图像传感器硬件支持的最大帧率,提高用户录制慢动作视频的体验。
为达到上述目的,本申请实施例采用如下技术方案:
一方面,本申请实施例提供了一种录像方法,可以应用于具有图像传感器的电子设备,包括:电子设备首先打开相机,而后显示录像预览界面,并在检测到用户的录像指示后录制视频。其中,该视频的录像帧率大于原始帧率,该原始帧率为录像时图像传感器硬件支持的最大帧率。并且,该视频包括慢动作类型的视频。在该方案中,电子设备的录像帧率可以大于图像传感器硬件支持的最大录像帧率,也就是说电子设备的录像帧率可以更高,电子设备录制的视频中的慢动作视频能够更好地满足用户分辨高速运动过程的需求。
在一种可能的设计中,视频还包括快动作类型的视频或常速类型的视频中的至少一种;视频的录像帧率为慢动作类型的视频的录像帧率、慢动作类型的视频的录像帧率和慢动作类型的视频的录像帧率中的最大值或平均值。在该方案中,当该视频为不同类型的视频的组合时,该视频播放的动作时快时慢,可以给用户以视觉上的强烈冲击,提高用户的震撼感和录制体验。
在另一种可能的设计中,视频的长度为预设长度,视频的格式为预设格式,格式 包括视频类型和视频类型对应的视频在视频中的位置,视频类型包括慢动作视频、常速视频或快动作视频中的至少一种。当电子设备录制的视频始终具有同一的、固定的格式时,可以提高该类电子设备或该型号的电子设备的辨识度和标识性。
在另一种可能的设计中,在录制视频之前,该方法还包括:在预览状态下,电子设备根据原始帧率采集原始视频帧,并且,电子设备缓存最近T时间内采集的原始视频帧,T为预设长度。电子设备录制视频具体包括:电子设备根据缓存的原始视频帧以及预设格式生成视频。在该方案中,电子设备可以提前一段时间缓存原始视频帧,并根据缓存的原始视频帧生成视频,以便于能够更有效地记录用户想要慢动作播放的高速运动过程。
在另一种可能的设计中,电子设备录制视频,具体包括:电子设备录制第一视频类型的视频。在电子设备检测到第二视频类型指示后,切换为录制第二视频类型的视频,第一视频类型或第二视频类型为慢动作视频类型。在该方案中,用户可以实时控制当前录制视频的类型和格式。
在另一种可能的设计中,电子设备录制视频还包括:在检测到用户的暂停指示后,电子设备暂停录制视频;在检测到用户的继续录像指示后,电子设备继续录制视频;在检测到用户的停止指示后,电子设备停止录制视频。在该方案中,用户可以实时控制当前录制视频的时长。
在另一种可能的设计中,该方法还包括:电子设备保存视频;电子设备在检测到用户的参数信息指示后,显示视频的参数信息。其中,该参数信息包括视频的录像帧率。这样,可以便于用户了解所录制的视频对应的录像帧率。
在另一种可能的设计中,电子设备录制视频包括:电子设备根据原始帧率采集原始视频帧;在不同原始视频帧之间插入至少一个新的视频帧;电子设备根据原始视频帧以及新的视频帧生成视频。也就是说,电子设备可以通过插帧来提高录像帧率。
在另一种可能的设计中,当待录制视频为慢动作类型时,电子设备录制慢动作类型视频,具体可以包括:电子设备根据原始视频帧采集原始视频帧;电子设备在相邻两个原始视频帧之间插入n个新的视频帧,n为正整数;电子设备根据原始视频帧以及新的视频帧生成慢动作类型视频。在需要录制慢动作类型的视频时,电子设备可以通过插帧来提高录像帧率,从而提高慢动作视频的播放效果。
在另一种可能的设计中,电子设备在相邻两个原始视频帧之间插入n个新的视频帧,n为正整数,具体包括:电子设备将相邻两个原始视频帧中的第一原始视频帧和第二原始视频帧分别划分为q个图像块,q为正整数。然后,电子设备在第二原始视频帧上与第一原始视频帧的图像块i对应位置的预设范围内,搜索与图像块i的残差值最小的图像块j,图像块j为与图像块i匹配的图像块。其中,i为1至q之间的整数,j为正整数;电子设备根据第二原始视频帧上与第一原始视频帧上相匹配的图像块的位置确定图像块的运动矢量。之后,电子设备根据图像块的运动矢量确定待插入的n个新的视频帧中图像块的位置。而后,电子设备根据待插入的n个新的视频帧中图像块的位置,生成待插入的n个新的视频帧。然后,电子设备将生成的n个新的视频帧插入第一原始视频帧和第二原始视频帧之间。在该方案中,电子设备可以通过相匹配的图像块准确地确定运动矢量,并根据运动矢量生成待插入的视频帧,从而以软件的方 式插入新的视频帧,可以节省成本,且易于维护。
另一方面,本申请实施例提供了一种录像方法,包括:首先,电子设备打开相机。而后,电子设备显示录像预览界面。在预览状态下,电子设备根据原始帧率采集原始视频帧。在检测到用户的录像指示后,电子设备根据缓存的原始视频帧以及预设格式生成视频。其中,视频的录像帧率大于原始帧率,原始帧率为录像时图像传感器硬件支持的最大帧率,视频包括慢动作类型的视频。并且,视频的长度为预设长度,视频的格式为预设格式,格式包括视频类型和视频类型对应的视频在视频中的位置,视频类型包括慢动作视频、常速视频或快动作视频中的至少一种。
另一方面,本申请实施例提供了一种电子设备,电子设备包括图像传感器,该电子设备还包括:开启单元,用于打开相机;显示单元,用于显示录像预览界面;录制单元,在检测到用户的录像指示后录制视频,视频的录像帧率大于原始帧率,原始帧率为录像时图像传感器硬件支持的最大帧率,视频包括慢动作类型的视频。
在一种可能的设计中,视频还包括快动作类型的视频或常速类型的视频中的至少一种。视频的录像帧率为慢动作类型的视频的录像帧率、慢动作类型的视频的录像帧率和慢动作类型的视频的录像帧率中的最大值或平均值。
在另一种可能的设计中,视频的长度为预设长度,视频的格式为预设格式,格式包括视频类型和视频类型对应的视频在视频中的位置,视频类型包括慢动作视频、常速视频或快动作视频中的至少一种。
在另一种可能的设计中,录制单元具体用于:在录制视频之前,在预览状态下,根据原始帧率采集原始视频帧;缓存最近T时间内采集的原始视频帧,T为预设长度;根据缓存的原始视频帧以及预设格式生成视频。
在另一种可能的设计中,录制单元具体用于:录制第一视频类型的视频;在检测到第二视频类型指示后,切换为录制第二视频类型的视频,第一视频类型或第二视频类型为慢动作视频类型。
在另一种可能的设计中,录制单元具体用于:在检测到用户的暂停指示后,暂停录制视频;在检测到用户的继续录像指示后,继续录制视频;在检测到用户的停止指示后,停止录制视频。
在另一种可能的设计中,电子设备还包括:保存单元,用于在录制单元录制视频之后保存视频;显示单元还用于,在检测到用户的参数信息指示后,显示视频的参数信息,参数信息包括视频的录像帧率。
在另一种可能的设计中,录制单元具体用于:根据原始帧率采集原始视频帧;在不同原始视频帧之间插入至少一个新的视频帧;根据原始视频帧以及新的视频帧生成视频。
另一方面,本申请实施例提供了一种电子设备,包括一个或多个处理器和一个或多个存储器。该一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机程序代码,计算机程序代码包括计算机指令,当一个或多个处理器执行计算机指令时,使得电子设备执行上述任一方面任一项可能的设计中的录像方法。
另一方面,本申请实施例提供了一种计算机存储介质,包括计算机指令,当计算机指令在电子设备上运行时,使得电子设备执行上述任一方面任一项可能的设计中的 录像方法。
另一方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行上述任一方面任一项可能的设计中的录像方法。
附图说明
图1为现有技术中的慢动作视频播放效果示意图;
图2为本申请实施例提供的一种手机的硬件结构示意图;
图3为本申请实施例提供的一种录像方法流程图;
图4为本申请实施例提供的一种录像过程示意图;
图5为本申请实施例提供的另一种录像过程示意图;
图6为本申请实施例提供的一种慢动作视频播放效果示意图;
图7为本申请实施例提供的慢动作、常速与快动作视频对比图;
图8-1为本申请实施例提供的另一种录像过程示意图;
图8-2为本申请实施例提供的另一种录像过程示意图;
图8-3为本申请实施例提供的另一种录像过程示意图;
图9为本申请实施例提供的另一种录像过程示意图;
图10-1为本申请实施例提供的另一种录像过程示意图;
图10-2为本申请实施例提供的另一种录像过程示意图;
图11-1为本申请实施例提供的一种设置界面示意图;
图11-2为本申请实施例提供的另一种设置界面示意图;
图12为本申请实施例提供的另一种录像过程示意图;
图13为本申请实施例提供的另一种录像过程示意图;
图14-1为本申请实施例提供的另一种录像过程示意图;
图14-2为本申请实施例提供的另一种录像过程示意图;
图15为本申请实施例提供的另一种设置界面示意图;
图16-1为本申请实施例提供的一种播放过程示意图;
图16-2为本申请实施例提供的一种播放过程示意图;
图17-1为本申请实施例提供的一种参数信息显示示意图;
图17-2为本申请实施例提供的另一种参数信息显示示意图;
图18为本申请实施例提供的另一种录像方法流程图;
图19为本申请实施例提供的一种下采样过程示意图;
图20为本申请实施例提供的一种运动矢量计算过程示意图;
图21为本申请实施例提供的两种运动矢量场示意图;
图22为本申请实施例提供的一种插帧效果示意图;
图23为本申请实施例提供的一种电子设备的结构示意图。
具体实施方式
为了便于理解,示例的给出了部分与本申请实施例相关概念的说明以供参考。如下所示:
原始帧率:在进行视频录制时,图像传感器的硬件支持的单位时间内可以采集的最大视频帧的数量。
录像帧率:电子设备在单位时间内录制的视频帧的数量。在本申请实施例中,当存在插帧时,录像帧率为插帧后单位时间内的总的视频帧的数量,大于原始帧率。
播放帧率:在进行视频播放时,电子设备每秒播放的视频帧的数量。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;本文中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,在本申请实施例的描述中,“多个”是指两个或多于两个。
本申请实施例提供的录像方法可以应用于手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本、个人数字助理(personal digital assistant,PDA)等任意可以通过摄像头进行视频录制的电子设备上,本申请实施例对此不作任何限制。
以本申请实施例中的电子设备为手机为例,对手机的通用硬件架构进行说明。如图2所示,手机200可以包括:通信模块220、存储器230、传感器模块240、输入设备250、显示屏260、音频模块280、处理器210、相机模块291、电源管理模块295等。这些部件之间可以以总线连接,也可以直连连接。本领域技术人员可以理解,图2中示出的手机结构并不构成对手机的限定,可以包括比图2更多的部件,或者组合某些部件,或者不同的部件布置。
其中,相机模块291可以用于通过摄像头采集图像,从而进行拍照、录像、视频聊天、视频会议、扫描二维码/条码以及面部信息识别等。其中,录像可以包括慢镜头录像、正常速度录像或快镜头录像等。
通信模块220用于与其它网络实体进行通信,例如从服务器接收信息或向服务器发送相关数据等。通信模块220可以包括射频(radio frequency,RF)模块229、蜂窝模块221、无线保真(wireless fidelity,WIFI)模块223、以及GPS模块227等。RF模块229可以用于收发信息或通话过程中,信号的接收和发送,特别地,将接收到的信息给处理器210处理;另外,将处理器210生成的信号发送出去。通常,RF电路21可以包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(low noise amplifier,LNA)、双工器等。此外,RF电路21还可以通过无线通信与网络和其他设备通信。蜂窝模块221和WIFI模块223可以用于连接网络。GPS模块可以用于进行定位或导航。
处理器210是手机200的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器230内的软件程序和/或模块,以及调用存储在存储器230内的数据,执行手机200的各种功能和处理数据,从而对手机200进行整体监控。在具体实现中,作为一种实施例,处理器210可包括一个或多个处理单元。
存储器230可用于存储数据、软件程序以及模块,可以是易失性存储器(volatile memory),例如随机存取存储器(random-access memory,RAM);或者非易失性存 储器(non-volatile memory),例如只读存储器(read-only memory,ROM),快闪存储器(flash memory),硬盘(hard disk drive,HDD)或固态硬盘(solid-state drive,SSD);或者上述种类的存储器的组合。具体的,存储器230内可存储程序代码,该程序代码用于使处理器210通过执行该程序代码,执行本申请实施例提供的提示信息显示方法。存储器230可以包括内部存储器232和外部存储器234。
传感器模块240可以包括手势传感器240A、陀螺仪传感器240B、气压传感器240C、磁传感器240D和加速度传感器240E等,可以用于检测手机在各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如手机倾斜的角度、正面朝上、侧面朝上、横竖屏切换、相关游戏、磁力计姿态校准或运动)、振动识别相关功能(比如计步器、敲击或运动)等。需要说明的是,手机200还可以包括其它传感器,比如握力传感器(可以用于检测手机是否为手持状态)、接近传感器(可以利用位移传感器对接近的物体具有敏感特性来识别物体的接近)、RGB传感器、生物特征传感器、温度/湿度传感器、光传感器(可以用于检测手机是否在口袋、包里等)或UV传感器等,在此不再赘述。
输入设备250可以包括触控面板(touch panel,TP)252、笔传感器254、按键256、超声输入设备258以及输入感测模块259等,用于实现手机200的输入和输出功能。
显示屏260可以包括显示面板262、全息设备264、以及投影仪266等设备。其中,显示面板262可以用于在手机上显示图形用户界面(graphical user interface,GUI),图形用户界面上包括各种应用图标(icon)、服务图标、组件(widget)或标识等。具体的,显示屏260可以是具有触摸功能的LCD或OLED屏幕等。
其中,触控面板252和显示面板262还可以称为触摸显示屏幕,触摸显示屏幕可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触摸显示屏幕上或在触摸显示屏幕附近的操作),并根据预先设定的程式驱动相应的连接装置。还可用于显示由用户输入的信息或提供给用户的信息(如通过摄像头采集到的图像)以及手机的各种菜单。例如,可以采用电阻式、电容式、红外光感以及超声波等多种类型实现触摸显示屏幕,本发明实施例对此不进行限定。
其中,用户在触摸显示屏幕附近的操作可以称之为悬浮触控,能够进行悬浮触控的触摸显示屏幕可以采用电容式、红外光感以及超声波等实现。例如,当手指等目标靠近或远离电容式触摸显示屏幕时,触摸显示屏幕中的自电容和互电容的电流会随之发生变化,从而使得电子设备可以检测到悬浮测控。再例如,红外光感触摸显示屏幕可以利用红外LED和红外发光二极管发射光线,手机通过检测用户手指等目标反射回的屏幕光线,实现悬浮手势的识别和追踪。
音频模块280可以包括扬声器282、接收机284、耳机286或麦克风288等,用户采集或播放音频信号。
电源管理模块295,可以包括电池296,用于通过电源管理系统与处理器210逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。
此外,手机200还可以包括用户识别模块、指示器、电机等功能模块,在此不再一一赘述。
以下将通过具体实施例对本申请提供的录像方法进行详细描述。
参见图3,本申请实施例提供一种录像方法,可以应用于具有图像传感器的电子设备,该方法可以包括:
301、电子设备打开相机。
用户在需要录像时,可以指示电子设备打开相机。例如,用户可以通过点击相机图标来指示电子设备打开相机,或者用户可以通过语音方式指示电子设备打开相机,或者用户可以在黑屏状态下在屏幕上画“C”形轨迹来指示电子设备打开相机等,本申请实施例对电子设备打开相机的触发方式不予限定。
302、电子设备显示录像预览界面。
示例性的,参见图4,若打开相机后电子设备直接进入拍照模式或其它非录像模式,则用户可以指示切换到录像模式,此时电子设备打开录像预览界面110。
示例性的,参见图5,若打开相机后电子设备直接进入录像模式(例如电子设备打开相机后默认为录像模式,或者用户上次使用相机时为录像模式),则电子设备直接打开录像预览界面110。在录像预览界面,用户可以预览待拍摄对象。
303、电子设备在检测到用户的录像指示后录制视频,视频的录像帧率大于原始帧率,该原始帧率为录像时图像传感器硬件支持的最大帧率,该视频包括慢动作类型的视频。
电子设备在检测到用户的录像指示后开始录制视频,该录像指示可以有多种形式,例如可以是语音指示,也可以是用户点击如图4或图5的录制按钮120的指示等,本申请实施例对此不予具体限定。
在本申请实施例中,视频的录像帧率大于原始帧率,也就是说电子设备的录像帧率不受电子设备中图像传感器硬件能力的限制。举例来说,若电子设备采用的图像传感器硬件支持的最大帧率为240fps,则电子设备录制视频时的实际录像帧率可以大于240fps。
具体的,电子设备中采用的图像传感器硬件可支持的最大帧率,可以根据图像传感器的型号、数据手册以及规格参数等获知。电子设备录制的视频整体的平均录像帧率,以及该视频各时间段内实际的录像帧率可以通过测试获得。
在录制慢动作视频时,录像帧率越高,则电子设备在单位时间内录制的视频帧数越多,视频帧上呈现的运动细节也越多,不同视频帧上图像细节之间的跳跃性越小;在播放帧率相同的条件下,录像帧率越高则播放时长越长,用户也就有更为充足的时间看清高速运动中的更多运动细节。
因而,在本申请实施例中,当电子设备的录像帧率大于图像传感器硬件支持的最大录像帧率时,电子设备的录像帧率可以更高,电子设备录制的视频中的慢动作视频能够更好地满足用户分辨高速运动过程的需求。
举例来说,在录制水滴下落后反弹的过程时,实际碰撞和反弹时间是在一瞬间(例如仅为0.1秒(s))发生的。若采用现有技术录制频率为240tps,播放帧率为30tps,则正常0.1s内发生的运动过程在0.8s内播放,慢动作播放效果示意图可以参见上述图1;在本申请实施例中,若录像帧率大于为240tps,例如为960tps,则0.1s内发生的运动过程在3.2s内播放。示例性的,采用本申请实施例提供的录像方法录制的慢动作视频的播放效果示意图可以参见图6。对比图6和图1可知,图6可以使得用户更为清 楚地看到水滴下落时碰撞并反弹的运动细节。
在本申请实施例提供的录像方法中,电子设备的录像帧率大于图像传感器硬件支持的最大帧率相当于扩展了图像传感器本身具有的录像能力,当电子设备采用硬件配置较低的图像传感器(例如原始帧率为30fps或60fps的图像传感器)时,也可以将录像帧率提高到960tps或更高,从而可以满足用户对慢动作视频录像的需求,提高用户的录像体验。
此外,现有技术中还存在一种三层式图像传感器,在成像区域(pixel section)和处理回路(circuit section)之间还包括一层动态随机存取存储器(dynamic random access memory,DRAM),该DRAM可以用于暂存录制的影像数据,使得图像传感器在单位时间内能够处理更多的图像帧,从而使得三层式图像传感器硬件支持的最大帧率可以达到960fps。然而,即使电子设备采用该种高硬件配置的三层式图像传感器,也仅能使得电子设备的录像帧率为图像传感器硬件支持的最大帧率,而不会超过图像传感器硬件支持的最大帧率。并且,由于受DRAM存储能力的局限,采用该种特殊的三层式图像传感器的电子设备的录像时间短(例如仅能录制0.2秒),分辨率低(例如仅为720p),很难满足用户的录像需求。
而在本申请实施例中,电子设备的录像帧率不仅可以大于图像传感器硬件支持的最大帧率,而且不需要考虑硬件DRAM存储能力的局限,录像时长和分辨率都不受限制(例如,录像时长可以为十几分钟或更长,分辨率可以为1080p或更高),不包括DRAM的普通图像传感器也可以适用。
其中,在录制视频时,电子设备可以首先根据原始帧率录制原始视频帧,而后根据原始视频帧在相邻原始视频帧之间进行插帧,从而使得录像帧率高于原始帧率。具体的,电子设备在录制慢动作类型的视频时,可以通过插帧提高录像帧率;而在录制非慢动作类型的视频时,则不进行插帧处理,采用原始帧率进行视频录制。
在本申请实施例中,电子设备录制的视频除了可以包括慢动作类型的视频以外,还可以包括快动作类型的视频或常速类型的视频等中的至少一种。其中,快动作类型还可以包括缩时摄影(或延时摄影)。也就是说,电子设备录制的视频可以是不同视频类型的视频的组合。
参见图7,慢动作类型视频可以理解为T1时间段内采集的视频帧在T2时间段内播放,且T1<T2;与慢动作视频类型相对应,快动作类型视频可以理解为T1时间段内采集的视频帧在T3时间段内播放,且T1>T3。常速类型的视频是指按照正常的时间关系进行录制和播放,可以理解为T1时间段内采集的视频帧在T1时间段内播放。其中,在录制快动作类型的视频时,电子设备可以将根据原始帧率采集到的原始视频帧进行等间隔抽帧处理,从而根据抽帧后的视频帧生成快动作类型的视频。
需要说明的是,当该视频为不同类型的视频的组合时,该视频播放的动作时快时慢,可以给用户以视觉上的强烈冲击,提高用户的震撼感和录制体验。
对于视频的录像帧率来说,当所录制的视频仅包括慢动作类型的视频时,该视频整个为慢动作视频,该视频的录像帧率为慢动作类型视频的视频帧率,慢动作类型视频的视频帧率大于原始帧率。当所录制的视频包括慢动作类型的视频以外的其它类型的视频时,该视频的帧率可以为不同类型的视频分别对应的录像帧率中的最大值,或 者为不同类型的视频分别对应的录像帧率的平均值。具体的,不同类型的视频分别对应的录像帧率中的最大值为慢动作类型的视频对应的录像帧率。
由于本申请实施例中的视频包括慢动作视频,与常规的常速录像模式不同,因而电子设备的录像模式可以包括多种。例如,参见图8-1,录像模式具体可以包括第一录像模式和第二录像模式,第一录像模式用于录制常规的常速视频;当用户选择第二录像模式时,电子设备通过本申请实施例提供的方法进行视频录制,且录像帧率大于原始帧率。再例如,参见图8-2,在录像模式下,用户可以点击设置按钮,从而打开与录像相关的各项设置,并从多种具体的录像模式中选择一种。示例性的,当用户选择超级录像模式(或超级慢动作录像模式)时,进入超级录像模式的录像预览界面,电子设备通过本申请实施例提供的方法进行视频录制,且录像帧率大于原始帧率。再例如,参见图8-3,在打开相机后的非录像模式下,用户也可以点击设置按钮,从而打开与拍照和录像相关的各项设置,并从多种具体的录像模式中选择超级录像模式,进入超级录像模式的录像预览界面,并通过本申请实施例提供的方法进行视频录制。
在一种可能的设计中,电子设备录制的视频的时长可以为预设时长,该预设长度可以是电子设备出厂时预设的,也可以是用户预设的。当该视频为预设长度时,用户只需要触发录像指示,而不需触发停止指示就可以自动完成视频的录制,因而可以减少用户的手动操作,给用户以智能录制的较好体验。在该设计中,示例性的,参见图9,电子设备上可以仅包括录制按钮而不包括暂停按钮和停止按钮。
其中,该预设长度可以较短,例如可以小于或者等于1分钟,以满足用户自动录制短视频的需求。并且,由于某些分享平台对视频时长有限制(例如微信要求的视频时长不应超过10s),当该视频为预设长度时,该预设长度可以小于或者等于分享平台的时长限制,这样可以方便用户上传和分享该视频。
在一种可能的实施方式中,在上述步骤303中,电子设备可以根据缓存的原始视频帧生成视频。在步骤303之前,在预览状态下,电子设备还可以根据原始帧率采集原始视频帧,并缓存最近T时间内采集的原始视频帧。
由于从用户发现自己想要录制一个运动过程到用户触发录像指示之间存在时间差,当用户触发慢动作类型指示时,待拍摄的运动过程可能已经开始了一段时间,尤其是当该运动过程为高速运动过程时,待拍摄的运动过程可能已经结束了,因而电子设备可以提前一段时间T缓存原始视频帧,并根据缓存的原始视频帧生成视频,以便于能够更有效地记录用户想要慢动作播放的高速运动过程。电子设备提前一段时间缓存视频帧的方式在录制瞬时高速运动的物体时更能提高用户的使用体验。其中,当电子设备视频的长度为预设长度时,T可以为该预设长度。
示例性的,该种实现方式对应的录制过程示意图可以参见图10-1和图10-2。需要说明的是,由于用户在图10-1和图10-2中的(b)中点击录制按钮指示录制视频后,电子设备根据缓存的原始视频帧以及预设格式生成视频需要一定的时间,因而参见图10-1和图10-2中的(c),电子设备可能不会在电子设备点击录制按钮后立即生成视频并在130位置显示生成的视频,参见图10-1和图10-2中的(d),稍等片刻后电子设备才会在区域130处显示生成的视频,以提示用户视频已录制完成。并且,参见图10-1和图10-2中的(a),由于需要提前缓存原始视频帧,因而在预览状态下,电子 设备需要对准被拍摄对象以实时进行图像采集。
此外,在图10-2中,当用户点击超级录像模式右边的关闭标记140时,电子设备可以退出超级录像模式,回到常规录像模式或拍照模式。在图10-2中,当用户点击录像按钮右边的关闭标记150时,电子设备可以取消对当前视频的录制。
另外,在本申请实施例中,电子设备录制的视频可以具有多种不同的格式,该格式内容可以包括视频类型和视频类型对应的视频在视频中的位置,该视频类型包括慢动作视频、常速视频或快动作视频中的至少一种。示例性的,格式具体可以参见如下表1。
在一种可能的实现方式中,电子设备录制的视频的格式可以为预设格式。当电子设备录制的视频始终具有同一的、固定的格式时,可以提高该类电子设备或该型号的电子设备的辨识度和标识性。
表1
Figure PCTCN2018080575-appb-000001
在上述表1中,不同格式中的t1、t2、t3、t4以及时间片的大小可以根据实际需要进行设置。
当电子设备视频的长度为预设长度,视频的格式为预设格式时,电子设备可以在用户触发录像指示后自动生成标识性较强且便于分享的视频。
并且,当电子设备视频的长度为预设长度,视频的格式为预设格式时,在步骤303中录制视频之前,在预览状态下,电子设备可以根据原始帧率采集原始视频帧,并缓存最近预设长度T时间内采集的原始视频帧。在步骤303中,电子设备可以根据缓存的原始视频帧以及预设格式,生成具有预设长度和预设格式的视频。示例性的,该录制过程示意图也可以参见图10-1或图10-2。
在其它的实现方式中,参见图11-1,在录制视频前,用户可以打开设置界面,从多个视频的待选格式中选择一个待录制的格式;在录制视频时,电子设备可以根据用户选择的待录制的格式录制视频。或者,参见图11-2,用户还可以自主设置待录制视频的格式,电子设备可以根据用户自主设置的格式生成个性化的视频。
在本申请实施例另一种可能的设计中,视频的长度是用户根据实际需要在录像过程中实时控制的,用户可以通过暂停、继续和停止指示选择想要录制的运动过程,跳过不想要录制的运动过程。具体的,参见图12,在录制视频时,若电子设备检测到用户的暂停指示,则暂停录制视频;若电子设备检测到用户的继续录像指示,则继续录制视频;若电子设备检测到用户的停止指示,则停止录制视频。在图12中,160表示暂停按钮,170表示继续录制按钮,180表示停止按钮。
当视频长度由用户实时控制时,在步骤303中录制视频之前,在显示录像预览界面时,即在预览状态下,电子设备也可以根据原始帧率采集原始视频帧,并缓存最近T时间内采集的原始视频帧;在步骤303中,电子设备根据缓存的原始视频帧以及检测到用户的录像指示后采集的原始视频帧生成视频帧。
或者,当视频长度由用户实时控制时,电子设备可以不事先缓存原始视频帧,电子设备在检测到用户的录像指示后根据采集到的原始视频帧进行实时处理,从而生成视频。因而在用户触发停止指示后,电子设备基本上也完成了视频的录制,如图12所示,在用户点击停止按钮180后,电子设备几乎可以在区域130处立即显示生成的视频。
此外,当待录制视频的格式不是预设格式或用户选择的格式时,电子设备在步骤303中录制视频具体可以包括:电子设备录制第一视频类型的视频;在检测到第二视频类型指示后,电子设备切换为录制第二视频类型的视频。其中,第一视频类型与第二视频类型不同,且第一视频类型或第二视频类型为慢动作视频类型。具体的,电子设备在检测到用户的录像指示并刚刚开始录制的初始视频类型可以为预设的视频类型。或者,电子设备也可以在检测到用户的录像指示和初始视频类型指示后开始录制初始视频类型对应的视频。
示例性的,参见图13中的(a),初始视频类型为常速视频类型,用户在点击录制按钮后,电子设备录制常速视频类型视频;参见图13中的(b),当电子设备检测到用户的慢动作类型指示时,切换为录制慢动作类型视频;若电子设备检测到用户的快动作类型指示,则再次切换为录制快动作类型视频;若电子设备检测到用户的常速类型指示,则再次切换为录制常速类型视频。
在一种具体实施方式中,当电子设备检测到用户的慢动作类型指示,切换为录制慢动作视频时,具体可以对检测到用户慢动作类型指示时刻之前的时间段T内以及检测到用户的慢动作类型指示时刻之后的视频帧进行插帧,从而生成慢动作视频。由于在录制过程中,从用户发现自己想要录制一个运动过程到用户触发慢动作类型指示之间存在时间差,当用户触发慢动作类型指示时,待拍摄的运动过程可能已经开始了一段时间,尤其是当该运动过程为高速运动过程时,待拍摄的运动过程可能已经结束了,因而电子设备可以根据用户慢动作类型指示时刻之前时间段T内的原始视频帧,提前一段时间录制慢动作视频,以便于用户能够更有效地记录想要慢动作播放的运动过程。
另外,当待录制视频的格式不是预设格式或用户选择的格式时,电子设备还可以在录制过程中自动切换视频录制类型。例如,当被拍摄对象的运动速度大于或者等于预设值时,可以切换为慢动作类型视频进行录制;当被拍摄对象的运动速度小于预设值时,可以切换为常速类型或快动作类型视频录制。再例如,当电子设备识别到被拍摄对象时,切换为待拍摄对象对应的格式进行视频拍摄。例如,电子设备最初可以录制默认类型(例如常速类型)的视频,参见图14-1,当电子设备识别到被拍摄对象为水滴或水滴下落时,切换为根据水滴或水滴下落对应的格式4继续录制视频;或者,当电子设备识别到被拍摄对象为老鹰或老鹰起飞时,切换为老鹰或老鹰起飞对应的格式5继续录制视频;或者,参见图14-2,当电子设备识别到被拍摄对象为骏马或骏马奔驰时,切换为骏马或骏马奔驰对应的格式6继续录制视频。示例性的,格式4可以 为:固定时长0.3s,快动作视频(0.05s)+慢动作视频(0.25s)。此外,当电子设备自动切换视频录制类型时,还可以在录制过程中实时显示当前时刻录制的视频的类型。
在另一种可能的实现方式中,参见图15,电子设备中可以预先保存有待拍摄对象和格式的对应关系。当电子设备检测到用户指示的待拍摄对象时,可以根据该待拍摄对象对应的格式录制视频。
此外,在另一些实施例中,电子设备录制的视频也可以仅包括快动作类型或慢动作类型中的至少一种,表1中视频的格式中也可以仅包括快动作类型或慢动作类型中的至少一种。示例性的,表1中视频的格式还可以包括格式7:t1秒常速视频+t2秒快速视频+t3秒常速视频。
另外,在视频录制完成后,电子设备可以自动播放录制的视频,以便于用户及时查看慢动作视频的录制效果;或者,在视频录制完成后,电子设备可以显示如图16-1所示的待播放界面,在用户指示播放后播放该视频;或者,参见图16-2,在视频录制完成后,在检测到用户的播放指示后才播放该视频。
进一步地,在视频录制完成后,电子设备可以保存录制的视频,并在检测到用户用于查看保存的视频的参数信息指示后,显示该视频的参数信息。其中,该参数信息包括视频的录像帧率,以便于用户了解所录制的视频,尤其是慢动作视频的录像帧率是多大。此外,该参数信息还可以其它信息,以便于用户对该视频的各方面有更为详细的了解。例如,其它信息可以包括文件名、时间、拍摄地点、文件格式、宽度、高度、时长、文件大小、分辨率、机型、制造商或路径等中的一种或多种。
并且,当所录制的视频包括慢动作类型的视频以外的其它类型的视频时,参数信息中视频的录像帧率也可以为该最大值或平均值;或者参数信息中也可以显示不同类型的视频分别对应的录像帧率。
示例性的,参见图17-1或图17-2,当用户点击已保存视频的“参数信息”选项时,电子设备显示具体的参数信息。
具体的,在本申请实施例的步骤303中,不论待录制视频的格式是否为预设格式,若当前时刻待录制的视频或视频为慢动作类型,则电子设备录制该慢动作类型的视频,具体可以包括:
3031、电子设备根据原始视频帧采集原始视频帧。
3032、电子设备在相邻两个原始视频帧之间插入n个新的视频帧,n为正整数。
其中,插入n个新的视频帧的原始视频帧可以是在预览状态下提前缓存的原始视频帧,也可以是检测到用户的录像指示后电子设备采集到的视频帧。通过插帧处理,电子设备可以将录像帧率提高至n*原始帧率。
3033、电子设备根据原始视频帧以及新的视频帧生成慢动作类型视频。
此外,若待录制的视频为常速类型或快动作类型,则电子设备不需要进行插帧处理。
当待录制视频为慢动作类型时,图18示出了另一种电子设备录制慢动作类型视频的流程图,主要可以包括电子设备中的图像传感器(sensor)采集原始视频帧,图像信号处理器(image signal processing,ISP)对原始视频帧进行处理,而后电子设备提高录像帧率,之后电子设备进行视频编码,从而生成视频。其中,电子设备提高录像帧 率的过程可以包括预处理、运动估计、运动矢量后处理以及插帧处理等。以下将以相邻的原始视频帧1和原始视频帧2为例进行说明。
在预处理过程中,电子设备将原始视频帧1和原始视频帧2分别划分为q(例如在图20所举示例中,原始视频帧1和原始视频帧2分别被划分为q=M*N)个小的图像块,后续处理都将基于图像块进行。并且,电子设备将原始视频帧1和原始视频帧2分别进行下采样,转换为分辨率更小的图像,以便基于小分辨率的图进行后续复杂的计算,从而降低运算量。参见图19,100表示原始视频帧,190表示图像块,图(a)和图(b)中的小圆点表示像素。
在运动估计时,参见图20,针对原始视频帧1中的每一个图像块,在原始视频帧2中对应位置的周围一定范围内(例如图20中虚线框所示的[-p,p]范围内)搜索。当搜索到的图像块2与原始视频帧1中的当前图像块1的残差值最小时,可以认为原始视频帧2中的图像块2是与原始视频帧1中当前图像块1匹配的图像块。而后,电子设备根据原始视频帧1中当前图像块1的坐标与原始视频帧2中的图像块2的坐标,计算出当前图像块1的运动矢量(x+u,y+v),其中(x,y)表示原始视频帧1中当前图像块1的坐标,(u,v)表示图像块2相对于当前图像块1的位置偏移量。
在运动矢量后处理过程中,电子设备可以通过邻域中值滤波或加权平均滤波等平滑滤波方法,提高运动矢量的准确度和平滑度。示例性的,参见图21,(a)是计算获得的各图像块对应的运动矢量场,其中,有个别图像块的运动矢量出错;(b)是经过后处理纠正后的运动矢量场,各图像块的运动矢量趋势保持一致。
而后电子设备根据经过上述处理后的运动矢量,计算待插入的n个新的视频帧中与图像块1和图像块2对应的n个图像块的位置。在分别确定待插入的n个新的视频帧中q个图像块的位置后,生成该n个待插入的图像块,并将该n个待插入的图像块插入原始视频块1和原始视频块2之间。示例性的,插帧后的效果示意图可以参见图22。具体的,在图22中,(a)和(b)表示原始视频帧,(c)和(d)表示在原始视频帧(a)和(b)之间插入的新的视频帧。
需要说明的是,本申请实施例通过软件方法进行插帧,成本更低,且易于更新和维护。并且,本申请实施例提供的录像方法是在录制过程中进行插帧,与在播放过程中进行插帧相比,在录制过程中进行插帧可以在该视频传送给其它设备或转存到其它介质后再次播放时,仍然实现慢动作播放。
可以理解的是,为了实现上述功能,电子设备包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
本申请实施例可以根据上述方法示例对电子设备、服务器进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实 际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下,图23示出了上述实施例中涉及的电子设备的一种可能的组成示意图,如图23所示,该电子设备2300可以包括:启动单元2301、显示单元2302和录制单元2303。
其中,确定单元2301,可以用于支持电子设备2300执行图3所示录像方法中的步骤301。显示单元2302可以用于支持电子设备2300执行图3所示录像方法中的步骤302。录制单元2303可以用于支持电子设备2300执行图3所示录像方法中的步骤303。
录制单元2303还可以用于支持电子设备2300在预览状态下,根据原始帧率采集原始视频帧;缓存最近T时间内采集的原始视频帧,T为预设长度;根据缓存的原始视频帧以及预设格式生成视频。
此外,录制单元2303还可以用于支持电子设备2300首先录制第一视频类型的视频;在检测到第二视频类型指示后,切换为录制第二视频类型的视频,第一视频类型或第二视频类型为慢动作视频类型。
录制单元2303还可以用于支持电子设备2300在检测到用户的暂停指示后,暂停录制视频;在检测到用户的继续录像指示后,继续录制视频;在检测到用户的停止指示后,停止录制视频。
录制单元2303还可以用于支持电子设备2300根据原始帧率采集原始视频帧;在不同原始视频帧之间插入至少一个新的视频帧;根据原始视频帧以及新的视频帧生成视频。
进一步地,电子设备2300还可以包括保存单元2304,可以用于支持电子设备2300在录制单元录制视频之后保存视频。显示单元232还用于支持电子设备2300在检测到用户的参数信息指示后,显示视频的参数信息,参数信息包括视频的录像帧率。
需要说明的是,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。
本申请实施例提供的电子设备,用于执行上述录像方法,因此可以达到与上述录像方法和GUI显示方法相同的效果。
在采用集成的单元的情况下,可将上述开启单元2301和录制单元2303集成为处理模块,将上述显示单元2302集成为显示模块,将上述保存单元集成为存储模块。
其中,处理模块用于对电子设备的动作进行控制管理,例如,处理模块用于支持电子设备执行图3中的步骤301和303,和/或用于本文所描述的技术的其它过程。显示模块可以用于支持电子设备执行图3中的步骤302,还可以向用户显示图形用户界面、图像或参数信息等。存储模块用于存储电子设备的程序代码、录制的视频以及视频的各项参数信息。
其中,处理模块可以是处理器或控制器,例如可以是中央处理器(central processing unit,CPU),图形处理器(graphics processing unit,GPU),通用处理器,数字信号处理器(digital signal processor,DSP),专用集成电路(application-specific integrated circuit,ASIC),现场可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。
显示模块可以为显示器,可以用于显示由用户输入的信息、提供给用户的信息以及终端的各种菜单的设备,具体可以采用液晶显示器、有机发光二极管等形式来配置显示器。另外,显示器上还可以集成触控板,用于采集在其上或附近的触摸事件,并将采集到的触摸信息发送给其他器件(例如处理器等)。
存储模块可以是存储器,该存储器可以包括高速RAM,还可以包括非易失存储器,例如磁盘存储器件、闪存器件或其他易失性固态存储器件等。
此外,电子设备还可以包括通信模块,可以用于支持电子设备与其他网络实体的通信,例如与服务器之间的通信。该通信模块具体可以为射频电路、蓝牙芯片、WIFI芯片等与其他电子设备交互的设备。
在一种具体实现中,当处理模块为处理器,显示模块为显示器,存储模块为存储器时,本申请实施例所涉及的电子设备具体可以为图2所示的手机。
本申请实施例还提供一种计算机存储介质,该计算机存储介质中存储有计算机指令,当该计算机指令在电子设备上运行时,该电子设备执行上述相关方法步骤实现上述实施例中的录像方法。
本申请实施例还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述相关方法步骤,以实现上述实施例中的录像方法。
另外,本申请的实施例还提供一种装置,这个装置具体可以是芯片,组件或模块,该装置可包括相连的处理器和存储器;其中,存储器用于存储计算机执行指令,当装置运行时,处理器可执行存储器存储的计算机执行指令,以使芯片执行上述各方法实施例中的录像方法。
其中,本申请实施例提供的电子设备、计算机存储介质、计算机程序产品或芯片均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
通过以上实施方式的描述,所属领域的技术人员可以了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成 的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。

Claims (19)

  1. 一种录像方法,应用于具有图像传感器的电子设备,其特征在于,包括:
    打开相机;
    显示录像预览界面;
    在检测到用户的录像指示后录制视频,所述视频的录像帧率大于原始帧率,所述原始帧率为录像时所述图像传感器硬件支持的最大帧率,所述视频包括慢动作类型的视频。
  2. 根据权利要求1所述的方法,其特征在于,所述视频还包括快动作类型的视频或常速类型的视频中的至少一种;所述视频的录像帧率为所述慢动作类型的视频的录像帧率、所述慢动作类型的视频的录像帧率和所述慢动作类型的视频的录像帧率中的最大值或平均值。
  3. 根据权利要求1或2所述的方法,其特征在于,所述视频的长度为预设长度,所述视频的格式为预设格式,所述格式包括视频类型和所述视频类型对应的视频在所述视频中的位置,所述视频类型包括慢动作视频、常速视频或快动作视频中的至少一种。
  4. 根据权利要求3所述的方法,其特征在于,在所述录制视频之前,所述方法还包括:
    在预览状态下,根据所述原始帧率采集原始视频帧;
    缓存最近T时间内采集的所述原始视频帧,T为所述预设长度;
    所述录制视频具体包括:
    根据缓存的所述原始视频帧以及所述预设格式生成视频。
  5. 根据权利要求1或2所述的方法,其特征在于,所述录制视频,具体包括:
    录制第一视频类型的视频;
    在检测到第二视频类型指示后,切换为录制第二视频类型的视频,所述第一视频类型或所述第二视频类型为慢动作视频类型。
  6. 根据权利要求1、2或5所述的方法,其特征在于,所述录制视频还包括:
    在检测到用户的暂停指示后,暂停录制视频;
    在检测到用户的继续录像指示后,继续录制视频;
    在检测到用户的停止指示后,停止录制视频。
  7. 根据权利要求1-6任一项所述的方法,其特征在于,在所述录制视频之后,所述方法还包括:
    保存所述视频;
    在检测到用户的参数信息指示后,显示所述视频的参数信息,所述参数信息包括所述视频的录像帧率。
  8. 根据权利要求1-3或5-7任一项所述的方法,其特征在于,录制所述视频包括:
    根据所述原始帧率采集原始视频帧;
    在不同所述原始视频帧之间插入至少一个新的视频帧;
    根据所述原始视频帧以及所述新的视频帧生成所述视频。
  9. 一种电子设备,所述电子设备包括图像传感器,其特征在于,所述电子设备还 包括:
    开启单元,用于打开相机;
    显示单元,用于显示录像预览界面;
    录制单元,在检测到用户的录像指示后录制视频,所述视频的录像帧率大于原始帧率,所述原始帧率为录像时所述图像传感器硬件支持的最大帧率,所述视频包括慢动作类型的视频。
  10. 根据权利要求9所述的电子设备,其特征在于,所述视频还包括快动作类型的视频或常速类型的视频中的至少一种;所述视频的录像帧率为所述慢动作类型的视频的录像帧率、所述慢动作类型的视频的录像帧率和所述慢动作类型的视频的录像帧率中的最大值或平均值。
  11. 根据权利要求9或10所述的电子设备,其特征在于,所述视频的长度为预设长度,所述视频的格式为预设格式,所述格式包括视频类型和所述视频类型对应的视频在所述视频中的位置,所述视频类型包括慢动作视频、常速视频或快动作视频中的至少一种。
  12. 根据权利要求11所述的电子设备,其特征在于,所述录制单元具体用于:
    在预览状态下,根据所述原始帧率采集原始视频帧;
    缓存最近T时间内采集的所述原始视频帧,T为所述预设长度;
    根据缓存的所述原始视频帧以及所述预设格式生成视频。
  13. 根据权利要求9或10所述的电子设备,其特征在于,所述录制单元具体用于:
    录制第一视频类型的视频;
    在检测到第二视频类型指示后,切换为录制第二视频类型的视频,所述第一视频类型或所述第二视频类型为慢动作视频类型。
  14. 根据权利要求9、10或13所述的电子设备,其特征在于,所述录制单元具体用于:
    在检测到用户的暂停指示后,暂停录制视频;
    在检测到用户的继续录像指示后,继续录制视频;
    在检测到用户的停止指示后,停止录制视频。
  15. 根据权利要求9-14任一项所述的电子设备,其特征在于,所述电子设备还包括:
    保存单元,用于在录制单元录制所述视频之后保存所述视频;
    所述显示单元还用于,在检测到用户的参数信息指示后,显示所述视频的参数信息,所述参数信息包括所述视频的录像帧率。
  16. 根据权利要求9-11或13-15任一项所述的电子设备,其特征在于,所述录制单元具体用于:
    根据所述原始帧率采集原始视频帧;
    在不同所述原始视频帧之间插入至少一个新的视频帧;
    根据所述原始视频帧以及所述新的视频帧生成所述视频。
  17. 一种电子设备,其特征在于,包括一个或多个处理器和一个或多个存储器;
    所述一个或多个存储器与所述一个或多个处理器耦合,所述一个或多个存储器用于存 储计算机程序代码,所述计算机程序代码包括计算机指令,当所述一个或多个处理器执行所述计算机指令时,所述电子设备执行如权利要求1-8任一项所述的录像方法。
  18. 一种计算机存储介质,其特征在于,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-8任一项所述的录像方法。
  19. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-8任一项所述的录像方法。
PCT/CN2018/080575 2018-03-26 2018-03-26 一种录像方法及电子设备 WO2019183784A1 (zh)

Priority Applications (11)

Application Number Priority Date Filing Date Title
EP18912537.0A EP3764632B1 (en) 2018-03-26 2018-03-26 Method and electronic device for video recording
CN201880003516.8A CN110506415B (zh) 2018-03-26 2018-03-26 一种录像方法及电子设备
CA3095209A CA3095209A1 (en) 2018-03-26 2018-03-26 Video recording method and electronic device
JP2020551891A JP7139440B2 (ja) 2018-03-26 2018-03-26 ビデオ記録方法および電子デバイス
KR1020207030586A KR102488747B1 (ko) 2018-03-26 2018-03-26 비디오 레코딩 방법 및 전자 디바이스
PCT/CN2018/080575 WO2019183784A1 (zh) 2018-03-26 2018-03-26 一种录像方法及电子设备
US17/041,971 US20210092321A1 (en) 2018-03-26 2018-03-26 Video recording method and electronic device
ES18912537T ES2943093T3 (es) 2018-03-26 2018-03-26 Método y dispositivo electrónico para grabar video
BR112020019378-0A BR112020019378A2 (pt) 2018-03-26 2018-03-26 Método e dispositivo eletrônico para gravação de vídeo
AU2018415667A AU2018415667B2 (en) 2018-03-26 2018-03-26 Video recording method and electronic device
PH12020551564A PH12020551564A1 (en) 2018-03-26 2020-09-25 Video recording method and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/080575 WO2019183784A1 (zh) 2018-03-26 2018-03-26 一种录像方法及电子设备

Publications (1)

Publication Number Publication Date
WO2019183784A1 true WO2019183784A1 (zh) 2019-10-03

Family

ID=68062417

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/080575 WO2019183784A1 (zh) 2018-03-26 2018-03-26 一种录像方法及电子设备

Country Status (11)

Country Link
US (1) US20210092321A1 (zh)
EP (1) EP3764632B1 (zh)
JP (1) JP7139440B2 (zh)
KR (1) KR102488747B1 (zh)
CN (1) CN110506415B (zh)
AU (1) AU2018415667B2 (zh)
BR (1) BR112020019378A2 (zh)
CA (1) CA3095209A1 (zh)
ES (1) ES2943093T3 (zh)
PH (1) PH12020551564A1 (zh)
WO (1) WO2019183784A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110636375A (zh) * 2019-11-11 2019-12-31 RealMe重庆移动通信有限公司 视频流处理方法、装置、终端设备及计算机可读存储介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD950574S1 (en) * 2018-10-23 2022-05-03 Capital One Services, Llc Scanning device or portion thereof with a scanning user interface
US11760281B2 (en) * 2020-11-17 2023-09-19 Ford Global Technologies, Llc Battery-powered vehicle sensors
US11953586B2 (en) 2020-11-17 2024-04-09 Ford Global Technologies, Llc Battery-powered vehicle sensors
CN114520886A (zh) * 2020-11-18 2022-05-20 华为技术有限公司 一种慢动作录像方法及设备
CN112653920B (zh) * 2020-12-18 2022-05-24 北京字跳网络技术有限公司 视频处理方法、装置、设备及存储介质
US11951937B2 (en) 2021-03-12 2024-04-09 Ford Global Technologies, Llc Vehicle power management
US11912235B2 (en) 2021-03-12 2024-02-27 Ford Global Technologies, Llc Vehicle object detection
US11916420B2 (en) 2021-03-12 2024-02-27 Ford Global Technologies, Llc Vehicle sensor operation

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010086912A1 (ja) * 2009-01-30 2010-08-05 日本ビクター株式会社 記録装置及び記録方法
CN103428460A (zh) * 2012-05-24 2013-12-04 联发科技股份有限公司 针对影像撷取模组记录输出视讯序列的录影方法以及录影装置
CN105812651A (zh) * 2015-07-27 2016-07-27 维沃移动通信有限公司 一种视频数据的处理方法及终端设备
CN106161943A (zh) * 2016-07-29 2016-11-23 维沃移动通信有限公司 一种录像方法和移动终端
CN106210541A (zh) * 2016-08-11 2016-12-07 北京优友兴缘科技有限公司 一种视频生成方法、装置及移动终端
CN107155068A (zh) * 2017-07-11 2017-09-12 上海青橙实业有限公司 移动终端及用于视频拍摄的方法和装置

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7242850B2 (en) * 2001-02-23 2007-07-10 Eastman Kodak Company Frame-interpolated variable-rate motion imaging system
US8427578B2 (en) * 2005-10-14 2013-04-23 Broadcom Corporation Method and system for frame rate adaptation
US10298834B2 (en) * 2006-12-01 2019-05-21 Google Llc Video refocusing
JP5585693B2 (ja) 2011-03-29 2014-09-10 株式会社ニコン 画像再生装置
TW201318423A (zh) * 2011-10-18 2013-05-01 Acer Inc 即時影像編輯方法與電子裝置
JP2014160927A (ja) 2013-02-19 2014-09-04 Nikon Corp 撮像装置
JP2015056695A (ja) * 2013-09-10 2015-03-23 株式会社東芝 動画再生装置
JP2015122734A (ja) * 2013-11-25 2015-07-02 パナソニックIpマネジメント株式会社 撮像装置及び撮像方法
JP2015106820A (ja) 2013-11-29 2015-06-08 株式会社ニコン 撮像装置、画像処理方法および画像処理プログラム
US20150221335A1 (en) 2014-02-05 2015-08-06 Here Global B.V. Retiming in a Video Sequence
US9438868B2 (en) * 2014-02-13 2016-09-06 Semiconductor Components Industries, Llc Adaptive image sensor systems and methods
JP2015177341A (ja) * 2014-03-14 2015-10-05 株式会社東芝 フレーム補間装置、及びフレーム補間方法
US20160182866A1 (en) * 2014-12-19 2016-06-23 Sony Corporation Selective high frame rate video capturing in imaging sensor subarea
JP2017028466A (ja) 2015-07-22 2017-02-02 キヤノン株式会社 撮像装置及びその制御方法、プログラム
KR102449872B1 (ko) * 2015-12-18 2022-09-30 삼성전자주식회사 촬영 디바이스 및 그 제어 방법
JP2017192100A (ja) * 2016-04-15 2017-10-19 ソニー株式会社 撮像素子、撮像装置、および、撮像素子の制御方法
UA121608U (uk) * 2017-06-19 2017-12-11 Михайло Геннадійович Ковшов Автоматизована система для створення, обробки та генерації відеофільмів
JP7059662B2 (ja) * 2018-02-02 2022-04-26 トヨタ自動車株式会社 遠隔操作システム、及びその通信方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010086912A1 (ja) * 2009-01-30 2010-08-05 日本ビクター株式会社 記録装置及び記録方法
CN103428460A (zh) * 2012-05-24 2013-12-04 联发科技股份有限公司 针对影像撷取模组记录输出视讯序列的录影方法以及录影装置
CN105812651A (zh) * 2015-07-27 2016-07-27 维沃移动通信有限公司 一种视频数据的处理方法及终端设备
CN106161943A (zh) * 2016-07-29 2016-11-23 维沃移动通信有限公司 一种录像方法和移动终端
CN106210541A (zh) * 2016-08-11 2016-12-07 北京优友兴缘科技有限公司 一种视频生成方法、装置及移动终端
CN107155068A (zh) * 2017-07-11 2017-09-12 上海青橙实业有限公司 移动终端及用于视频拍摄的方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3764632A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110636375A (zh) * 2019-11-11 2019-12-31 RealMe重庆移动通信有限公司 视频流处理方法、装置、终端设备及计算机可读存储介质
CN110636375B (zh) * 2019-11-11 2022-03-11 RealMe重庆移动通信有限公司 视频流处理方法、装置、终端设备及计算机可读存储介质
US11711623B2 (en) 2019-11-11 2023-07-25 Realme Chongqing Mobile Telecommunications Corp., Ltd. Video stream processing method, device, terminal device, and computer-readable storage medium

Also Published As

Publication number Publication date
CA3095209A1 (en) 2019-10-03
CN110506415A (zh) 2019-11-26
AU2018415667A1 (en) 2020-10-29
JP2021517415A (ja) 2021-07-15
KR20200128581A (ko) 2020-11-13
CN110506415B (zh) 2021-03-30
EP3764632B1 (en) 2023-02-22
PH12020551564A1 (en) 2021-07-12
JP7139440B2 (ja) 2022-09-20
EP3764632A1 (en) 2021-01-13
US20210092321A1 (en) 2021-03-25
KR102488747B1 (ko) 2023-01-13
BR112020019378A2 (pt) 2021-01-05
AU2018415667B2 (en) 2022-05-19
ES2943093T3 (es) 2023-06-08
EP3764632A4 (en) 2021-01-13

Similar Documents

Publication Publication Date Title
WO2019183784A1 (zh) 一种录像方法及电子设备
CN110086905B (zh) 一种录像方法及电子设备
US11640235B2 (en) Additional object display method and apparatus, computer device, and storage medium
WO2021093793A1 (zh) 一种拍摄方法及电子设备
US11785331B2 (en) Shooting control method and terminal
US11276183B2 (en) Relocalization method and apparatus in camera pose tracking process, device, and storage medium
KR102018887B1 (ko) 신체 부위 검출을 이용한 이미지 프리뷰
CN110505408B (zh) 终端拍摄方法、装置、移动终端及可读存储介质
CN107786827B (zh) 视频拍摄方法、视频播放方法、装置及移动终端
CN108886574B (zh) 一种拍摄引导方法、设备及系统
EP3104304A1 (en) Electronic apparatus and method of extracting still images
US20240007588A1 (en) Slow-motion video recording method and device
US12022190B2 (en) Photographing method and electronic device
CN109618192B (zh) 播放视频的方法、装置、系统和存储介质
CN112749590B (zh) 目标检测方法、装置、计算机设备和计算机可读存储介质
WO2019134305A1 (zh) 确定姿态的方法、装置、智能设备、存储介质和程序产品
CN113095163A (zh) 视频处理方法、装置、电子设备和存储介质
WO2021218926A1 (zh) 图像显示方法、装置和计算机设备
CN117131225A (zh) 视频处理方法、装置、电子设备及存储介质
CN110012208B (zh) 拍照对焦方法、装置、存储介质及电子设备
RU2818577C1 (ru) Способ и устройство видеозаписи с замедленной съемкой
WO2019015120A1 (zh) 一种图像处理的方法及终端
CN112738332A (zh) 一种电子设备的交互方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18912537

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3095209

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2020551891

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018912537

Country of ref document: EP

Effective date: 20201008

Ref document number: 20207030586

Country of ref document: KR

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112020019378

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2018415667

Country of ref document: AU

Date of ref document: 20180326

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 112020019378

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20200924