CN107302664B - Shooting method and mobile terminal - Google Patents

Shooting method and mobile terminal Download PDF

Info

Publication number
CN107302664B
CN107302664B CN201710686756.XA CN201710686756A CN107302664B CN 107302664 B CN107302664 B CN 107302664B CN 201710686756 A CN201710686756 A CN 201710686756A CN 107302664 B CN107302664 B CN 107302664B
Authority
CN
China
Prior art keywords
scene
shooting
image
characteristic information
mobile terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710686756.XA
Other languages
Chinese (zh)
Other versions
CN107302664A (en
Inventor
李湘村
韦剑
吴宏信
鄢宇鹏
李世平
钟海波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201710686756.XA priority Critical patent/CN107302664B/en
Publication of CN107302664A publication Critical patent/CN107302664A/en
Application granted granted Critical
Publication of CN107302664B publication Critical patent/CN107302664B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a shooting method and a mobile terminal, and solves the problem that a large amount of power is consumed by the mobile terminal due to the fact that each frame of image needs to be stored when the existing zero-shutter delayed shooting is carried out. The shooting method of the present invention includes: acquiring scene characteristic information of a shooting scene in the process of acquiring a preview image by a camera; determining the frequency of storing image frames according to the scene characteristic information; storing each frame of image frame collected by the mobile terminal according to the frequency; if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction; generating a final output image based on the at least one target image frame. According to the embodiment of the invention, the storage frequency of the image frames is dynamically adjusted according to the scene characteristic information, so that the problem that a mobile terminal consumes a large amount of power because each frame of image needs to be stored when the existing zero-shutter delayed photographing is carried out is solved.

Description

Shooting method and mobile terminal
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a shooting method and a mobile terminal.
Background
At present, when a handheld mobile terminal takes a picture, the handheld mobile terminal generally faces the trouble of image quality reduction caused by shaking when a shutter is pressed by a hand or taking a moving object. In order to improve the photographing experience of the user, the zero shutter delay technology of the camera has been widely applied to various advanced handheld mobile terminal cameras. Among them, the most typical technique is to acquire a photographing picture with zero shutter delay by using a sensor of a full-resolution camera and saving each frame image.
Saving a full resolution image of each frame consumes a significant amount of power, especially in the application scenario of multi-camera photography. In addition, because different exposure processes need to be performed on multiple images in advanced high dynamic range photographing, the zero-shutter delay technology of the current camera cannot meet the requirement, and the photographing experience of a user is reduced.
Disclosure of Invention
The embodiment of the invention provides a shooting method and a mobile terminal, and aims to solve the problem that a large amount of power is consumed by the mobile terminal due to the fact that each frame of image needs to be stored when the existing zero-shutter delayed shooting is carried out.
In a first aspect, an embodiment of the present invention provides a shooting method applied to a mobile terminal, including:
acquiring scene characteristic information of a shooting scene in the process of acquiring a preview image by a camera;
determining the frequency of storing image frames according to the scene characteristic information;
storing each frame of image frame collected by the mobile terminal according to the frequency;
if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction;
generating a final output image based on the at least one target image frame.
In a second aspect, an embodiment of the present invention further provides a mobile terminal, including:
the acquisition module is used for acquiring scene characteristic information of a shooting scene in the process of acquiring the preview image by the camera;
the determining module is used for determining the frequency of the stored image frame according to the scene characteristic information;
the storage module is used for storing each frame of image frame collected by the mobile terminal according to the frequency;
the selection module is used for selecting at least one target image frame from the stored image frames according to the shooting mode indicated by the shooting instruction if the shooting instruction is received;
a generating module for generating a final output image based on the at least one target image frame.
In a third aspect, an embodiment of the present invention further provides a mobile terminal, including: a memory, a processor and a computer program stored on the memory and executable on the processor, which computer program, when being executed by the processor, carries out the steps of the photographing method as described above.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps of the shooting method described above.
In this way, according to the technical scheme of the embodiment of the invention, in the process of acquiring the preview image by the camera, the scene characteristic information of the shooting scene is acquired; determining the frequency of storing image frames according to the scene characteristic information; storing each frame of image frame collected by the mobile terminal according to the frequency; if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction; generating a final output image based on the at least one target image frame. According to the embodiment of the invention, the storage frequency of the image frames is dynamically adjusted according to the scene characteristic information, so that the problem that a mobile terminal consumes a large amount of power because each frame of image needs to be stored when the existing zero-shutter delayed photographing is carried out is solved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
FIG. 1 is a flow chart of a photographing method according to an embodiment of the present invention;
FIG. 2 is a first diagram illustrating a final output image generated by the photographing method according to the embodiment of the invention;
FIG. 3 is a second schematic diagram of generating a final output image in the photographing method according to the embodiment of the invention;
FIG. 4 is a third schematic diagram of a final output image generated by the photographing method according to the embodiment of the invention;
fig. 5 is a block diagram of a mobile terminal according to an embodiment of the present invention;
fig. 6 is a second block diagram of a mobile terminal according to the embodiment of the present invention;
fig. 7 is a block diagram of a mobile terminal according to an embodiment of the present invention;
fig. 8 is a second block diagram of the mobile terminal according to the embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a shooting method applied to a mobile terminal, including:
step 101: and in the process of acquiring the preview image by the camera, acquiring scene characteristic information of a shooting scene.
The scene feature information includes movement information of a subject and brightness of a shooting scene, wherein the movement information of the subject includes speed information of the subject. According to the method and the device, the mobile terminal determines the frequency of storing the image frames acquired by the mobile terminal in the shooting scene according to the scene characteristic information of the shooting scene.
Step 102: and determining the frequency of storing the image frames according to the scene characteristic information.
In the process of previewing, the mobile terminal usually first uses a camera and a sensor in the mobile terminal to collect Image pixel information, and then sends the collected Image pixel information to an Image Processor (ISP) for typical ISP processing such as linear correction, noise reduction, dead pixel removal, interpolation, white balance, color conversion, and the like. Since the ISP function is locked in time with each line scan of pixels, synchronized to the sensor, the ISP is also called a real time ISP.
Meanwhile, the output of the ISP includes statistical information of current environment and field characteristics, so the image control center analyzes the data (scene characteristic information) and camera tuning information, and determines the frequency of storing image frames acquired by the mobile terminal in the current photographing scene, so as to solve the problem that the mobile terminal consumes a large amount of power because each frame of image needs to be stored when the conventional zero-shutter delayed photographing is performed.
Step 103: and storing each frame of image frame collected by the mobile terminal according to the frequency.
Here, each frame of image frame collected by the mobile terminal is stored according to the frequency of storing image frames determined in the above steps, so that the power consumption of the mobile terminal is reduced, and the stored image frames are full-resolution image frames.
Step 104: and if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to the shooting mode indicated by the shooting instruction.
And selecting a corresponding number of target image frames from the stored image frames according to different shooting modes so as to generate high-quality images subsequently.
As an optional implementation manner, if the shooting mode is the high dynamic illumination rendering HDR mode, at least two target image frames are selected from the stored image frames according to an optimal image frame selection algorithm.
The optimal image frame selection algorithm compares at least one index of the indexes of definition, illumination uniformity, contrast, saturation, brightness, detail richness, whether overexposure or over darkness, whether color blocks exist, whether color cast exists, whether overcooling or over warming and the like among preview image frames stored by the mobile terminal to obtain the target image frame.
As another optional implementation manner, if the photographing mode is a single-image photographing mode, a target image frame is selected from the stored image frames according to an optimal image frame selection algorithm.
As another optional implementation manner, if the photographing mode is a multi-piece combination mode, at least two target image frames are selected from the stored image frames according to an optimal image frame selection algorithm.
Step 105: generating a final output image based on the at least one target image frame.
Here, the mobile terminal generates a final output image from the at least one target image frame by using an image generation technique in the related art. According to the shooting method, in the process of acquiring the preview image by the camera, scene characteristic information of a shooting scene is acquired; determining the frequency of storing image frames according to the scene characteristic information; storing each frame of image frame collected by the mobile terminal according to the frequency; if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction; generating a final output image based on the at least one target image frame. According to the embodiment of the invention, the storage frequency of the image frames is dynamically adjusted according to the scene characteristic information, so that the problem that a mobile terminal consumes a large amount of power because each frame of image needs to be stored when the existing zero-shutter delayed photographing is carried out is solved. Further, the step 102 includes:
and determining the target frame number of the collected image frames in the time interval of executing two adjacent storage actions according to the scene characteristic information of the shooting scene.
Specifically, if the scene characteristic information indicates that the brightness of the shooting scene is less than or equal to a preset brightness threshold, it is determined that the target frame number is zero.
Here, each image frame is saved in a shooting scene where the brightness of the shooting scene is less than or equal to the preset brightness threshold, that is, in a dark shooting scene, since the shooting preview frame rate is low in a dark light environment, the power for saving the image frame is not too high, and thus the mobile terminal does not consume too much power.
And if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold, determining the target frame number according to the movement information of the shot object.
At this time, if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is less than a preset speed threshold value, determining that the target frame number is a first numerical value; if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is greater than or equal to the preset speed threshold value, determining the target frame number to be a second numerical value;
wherein the second value is smaller than the first value, and the first value and the second value are both positive integers.
For example, when the shooting scene has a good lighting condition and the moving speed of the object is small, one image frame is stored every 3 or 4 image frames, and when the shooting scene has a good lighting condition and the moving speed of the object is large, one image frame is stored every 2 image frames.
Further, the step 105 includes: and if the current photographing mode is the high dynamic illumination rendering HDR mode, acquiring the image frame to be synthesized.
The image frame to be synthesized is at least one image frame collected by the mobile terminal after receiving a shooting instruction, and the exposure time of the image frame to be synthesized is less than that of the image frame stored in the mobile terminal.
And generating a final output image according to the at least two target image frames and the image frame to be synthesized.
As shown in fig. 2, in the high dynamic range photographing mode, a plurality of different exposure pictures are required due to the high dynamic range synthesis algorithm. When the user presses the shutter, the image control center selects the most appropriate plurality of image frames (a plurality of target image frames) from the saved picture set for synthesizing image contents of intermediate brightness and low brightness. At the same time, the image control center provides a new short exposure configuration to the camera's sensor to generate a new short exposure image frame (the image frame to be combined) for combining the high brightness image content to produce the final zero shutter delay image.
In addition, as shown in fig. 3, in the single-shot mode (the number of frames transmitted per second is 30fps), if the shooting scene has good lighting conditions and the moving speed of the object to be shot is slow, one frame of full-resolution image frame is saved every 2, 3, or 4 image frames. When the user presses the shutter, the image control center selects the most appropriate one of the pictures from the saved picture set to become the final zero shutter delay image.
As shown in fig. 4, if in a dark light shooting scene (the number of frames transmitted per second is less than 30fps), each frame of the full resolution image frame is saved. Because the photo preview frame rate is low in a dim light shooting scene, the power consumed by the mobile terminal is not too high. When the user presses the shutter, the image control center selects the most appropriate multiple pictures from the saved picture set for the multi-frame synthesis algorithm to produce the final zero shutter delay image. According to the embodiment of the invention, the storage frequency of the image frames is dynamically adjusted according to the scene characteristic information, so that the problem that a mobile terminal consumes a large amount of power because each frame of image needs to be stored when the existing zero-shutter delayed photographing is carried out is solved.
According to the shooting method, the purpose of reducing the power consumption of the mobile terminal is achieved by dynamically adjusting the storage frequency of the full-resolution image frame, namely, the preview image frame with the full resolution is stored most efficiently by using the current environment and field characteristic analysis results, and then the most appropriate storage image is selected according to the shooting mode to generate the final zero-shutter delay image.
As shown in fig. 5, an embodiment of the present invention further provides a mobile terminal 500, including:
the acquiring module 501 is configured to acquire scene feature information of a shooting scene in a process of acquiring a preview image by a camera;
a determining module 502, configured to determine a frequency of storing image frames according to the scene feature information;
a storage module 503, configured to store each frame of image frames acquired by the mobile terminal according to the frequency;
a selecting module 504, configured to select at least one target image frame from stored image frames according to a shooting mode indicated by a shooting instruction if the shooting instruction is received;
a generating module 505 for generating a final output image based on the at least one target image frame.
In the mobile terminal according to the embodiment of the present invention, the determining module 502 is configured to determine the target frame number of the image frames collected in the time interval between two adjacent storage actions according to the scene characteristic information of the shooting scene.
As shown in fig. 6, the determining module 502 of the mobile terminal according to the embodiment of the present invention includes:
the first determining submodule 5021 is used for determining that the target frame number is zero if the scene characteristic information indicates that the brightness of the shooting scene is smaller than or equal to a preset brightness threshold value;
the second determining submodule 5022 is configured to determine the number of target frames according to the movement information of the object to be shot if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold.
In the mobile terminal of the embodiment of the present invention, the second determining submodule 5022 includes:
a first determining unit 50221, configured to determine that the target frame number is a first numerical value if the scene feature information indicates that the brightness of the shooting scene is greater than the preset brightness threshold and the moving speed of the object to be shot is less than a preset speed threshold;
a second determining unit 50222, configured to determine that the target frame number is a second numerical value if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold and the moving speed of the object to be shot is greater than or equal to the preset speed threshold;
wherein the second value is smaller than the first value, and the first value and the second value are both positive integers.
In the mobile terminal of the embodiment of the present invention, the generating module 505 includes:
an obtaining sub-module 5051, configured to obtain an image frame to be synthesized if the current photographing mode is the high dynamic illumination rendering HDR mode;
a generating submodule 5052, configured to generate a final output image according to at least two of the target image frames and the image frame to be synthesized;
the image frame to be synthesized is at least one image frame collected by the mobile terminal after receiving a shooting instruction, and the exposure time of the image frame to be synthesized is less than that of the image frame stored in the mobile terminal.
In the mobile terminal of the embodiment of the invention, the scene characteristic information comprises the movement information of the shot object and the brightness of the shot scene;
wherein the movement information of the photographic subject includes speed information of the photographic subject.
It should be noted that the mobile terminal is a mobile terminal corresponding to the above method embodiment, and all implementation manners in the above method embodiment are applicable to the embodiment of the mobile terminal, and the same technical effect can be achieved.
According to the mobile terminal provided by the embodiment of the invention, in the process of acquiring the preview image by the camera, the scene characteristic information of a shooting scene is acquired; determining the frequency of storing image frames according to the scene characteristic information; storing each frame of image frame collected by the mobile terminal according to the frequency; if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction; generating a final output image based on the at least one target image frame. According to the embodiment of the invention, the storage frequency of the image frames is dynamically adjusted according to the scene characteristic information, so that the problem that a mobile terminal consumes a large amount of power because each frame of image needs to be stored when the existing zero-shutter delayed photographing is carried out is solved.
An embodiment of the present invention further provides a mobile terminal, including: the shooting method comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, each process in the shooting method embodiment is realized, the same technical effect can be achieved, and the repeated description is omitted for avoiding the repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process in the above-mentioned shooting method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
As shown in fig. 7, an embodiment of the present invention further provides a mobile terminal, where the mobile terminal 700 shown in fig. 7 includes: at least one processor 701, memory 702, at least one network interface 704, sensors of cameras 706 and other user interfaces 703. The processor 701 includes an image control center 7011 and an image processor 7012. The various components in the mobile terminal 700 are coupled together by a bus system 705. It is understood that the bus system 705 is used to enable communications among the components. The bus system 705 includes a power bus, a control bus, and a status signal bus in addition to a data bus. But for clarity of illustration the various busses are labeled in figure 7 as the bus system 705.
The user interface 703 may include, among other things, a display, a keyboard, or a pointing device (e.g., a mouse, trackball, touch pad, or touch screen, among others.
It is to be understood that the memory 702 in embodiments of the present invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of example, but not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic random access memory (Synchronous DRAM, SDRAM), Double Data rate Synchronous Dynamic random access memory (ddr SDRAM ), Enhanced Synchronous SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct memory bus RAM (DRRAM). The memory 702 of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.
In some embodiments, memory 702 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof: an operating system 7021 and application programs 7022.
The operating system 7021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application 7022 includes various applications, such as a Media Player (Media Player), a Browser (Browser), and the like, for implementing various application services. Programs that implement methods in accordance with embodiments of the present invention can be included within application program 7022.
In an embodiment of the present invention, by calling a program or an instruction stored in the memory 702, specifically a program or an instruction stored in the application 7022, when the computer program is executed by the processor 701, the following steps are implemented: acquiring scene characteristic information of a shooting scene in the process of acquiring a preview image by a camera;
determining the frequency of storing image frames according to the scene characteristic information;
storing each frame of image frame collected by the mobile terminal according to the frequency;
if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction;
generating a final output image based on the at least one target image frame.
Optionally, the computer program when executed by the processor 701 implements the following steps:
and determining the target frame number of the collected image frames in the time interval of executing two adjacent storage actions according to the scene characteristic information of the shooting scene.
Optionally, the computer program when executed by the processor 701 implements the following steps:
if the scene characteristic information indicates that the brightness of the shooting scene is less than or equal to a preset brightness threshold, determining that the target frame number is zero;
and if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold, determining the target frame number according to the movement information of the shot object.
Optionally, the computer program when executed by the processor 701 implements the following steps:
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is less than the preset speed threshold value, determining the number of the target frames as a first numerical value;
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is greater than or equal to the preset speed threshold value, determining the target frame number to be a second numerical value;
wherein the second value is smaller than the first value, and the first value and the second value are both positive integers.
Optionally, the computer program when executed by the processor 701 implements the following steps:
if the current photographing mode is a high dynamic illumination rendering HDR mode, acquiring an image frame to be synthesized;
generating a final output image according to the at least two target image frames and the image frame to be synthesized;
the image frame to be synthesized is at least one image frame collected by the mobile terminal after receiving a shooting instruction, and the exposure time of the image frame to be synthesized is less than that of the image frame stored in the mobile terminal.
Optionally, the scene characteristic information includes movement information of the object to be shot and brightness of the shooting scene;
wherein the movement information of the photographic subject includes speed information of the photographic subject.
In the mobile terminal 700 of the embodiment of the present invention, the processor 701 is configured to obtain scene characteristic information of a shooting scene in a process of acquiring a preview image by a camera; determining the frequency of storing image frames according to the scene characteristic information; storing each frame of image frame collected by the mobile terminal according to the frequency; if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction; generating a final output image based on the at least one target image frame. According to the embodiment of the invention, the storage frequency of the image frames is dynamically adjusted according to the scene characteristic information, so that the problem that a mobile terminal consumes a large amount of power because each frame of image needs to be stored when the existing zero-shutter delayed photographing is carried out is solved.
The mobile terminal of the present invention may be a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), or a vehicle-mounted computer.
The mobile terminal 700 can implement the processes implemented by the terminal in the foregoing embodiments, and details are not repeated here to avoid repetition.
The methods disclosed in the embodiments of the present invention may be implemented in the processor 701 or implemented by the processor 701. The processor 701 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be implemented by integrated logic circuits of hardware or instructions in the form of software in the processor 701. The Processor 701 may be a general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic device, or discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 702, and the processor 701 reads the information in the memory 702 and performs the steps of the above method in combination with the hardware thereof.
It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the Processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units configured to perform the functions described herein, or a combination thereof.
For a software implementation, the techniques described herein may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.
As shown in fig. 8, an embodiment of the present invention further provides a mobile terminal. The mobile terminal 800 shown in fig. 8 includes a Radio Frequency (RF) circuit 810, a memory 820, an input unit 830, a display unit 840, a sensor 850 of a camera, a processor 860, an audio circuit 870, a wifi (wireless fidelity) module 880, and a power supply 890. Processor 860 includes an image control center and an image processor.
The input unit 830 may be used, among other things, to receive numeric or character information input by a user and to generate signal inputs related to user settings and function control of the mobile terminal 800. Specifically, in the embodiment of the present invention, the input unit 830 may include a touch panel 831. The touch panel 831, also referred to as a touch screen, can collect touch operations performed by a user on or near the touch panel 831 (e.g., operations performed by the user on the touch panel 831 using a finger, a stylus, or any other suitable object or accessory), and drive the corresponding connection device according to a preset program. Alternatively, the touch panel 831 may include two portions, i.e., a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 860, and can receive and execute commands sent by the processor 860. In addition, the touch panel 831 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 831, the input unit 830 may include other input devices 832, and the other input devices 832 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
Among other things, the display unit 840 may be used to display information input by the user or information provided to the user and various menu interfaces of the mobile terminal 800. The display unit 840 may include a display panel 841, and the display panel 841 may be alternatively configured in the form of an LCD or an Organic Light-Emitting Diode (OLED), or the like.
It should be noted that the touch panel 831 can overlay the display panel 841 to form a touch display screen, which, when it detects a touch operation thereon or nearby, is passed to the processor 860 to determine the type of touch event, and then the processor 860 provides a corresponding visual output on the touch display screen according to the type of touch event.
The touch display screen comprises an application program interface display area and a common control display area. The arrangement modes of the application program interface display area and the common control display area are not limited, and can be an arrangement mode which can distinguish two display areas, such as vertical arrangement, left-right arrangement and the like. The application interface display area may be used to display an interface of an application. Each interface may contain at least one interface element such as an icon and/or widget desktop control for an application. The application interface display area may also be an empty interface that does not contain any content. The common control display area is used for displaying controls with high utilization rate, such as application icons like setting buttons, interface numbers, scroll bars, phone book icons and the like.
The processor 860 is a control center of the mobile terminal 800, connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions of the mobile terminal 800 and processes data by operating or executing software programs and/or modules stored in the first memory 821 and calling data stored in the second memory 822, thereby integrally monitoring the mobile terminal 800. Optionally, processor 860 may include one or more processing units.
In an embodiment of the invention, by calling software programs and/or modules stored in the first memory 821 and/or data in the second memory 822, the computer program when executed by the processor 860 performs the following steps: acquiring scene characteristic information of a shooting scene in the process of acquiring a preview image by a camera;
determining the frequency of storing image frames according to the scene characteristic information;
storing each frame of image frame collected by the mobile terminal according to the frequency;
if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction;
generating a final output image based on the at least one target image frame.
Optionally, the computer program when executed by the processor 860 performs the steps of:
and determining the target frame number of the collected image frames in the time interval of executing two adjacent storage actions according to the scene characteristic information of the shooting scene.
Optionally, the computer program when executed by the processor 860 performs the steps of:
if the scene characteristic information indicates that the brightness of the shooting scene is less than or equal to a preset brightness threshold, determining that the target frame number is zero;
and if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold, determining the target frame number according to the movement information of the shot object.
Optionally, the computer program when executed by the processor 860 performs the steps of:
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is less than the preset speed threshold value, determining the number of the target frames as a first numerical value;
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is greater than or equal to the preset speed threshold value, determining the target frame number to be a second numerical value;
wherein the second value is smaller than the first value, and the first value and the second value are both positive integers.
Optionally, the computer program when executed by the processor 860 performs the steps of:
if the current photographing mode is a high dynamic illumination rendering HDR mode, acquiring an image frame to be synthesized;
generating a final output image according to the at least two target image frames and the image frame to be synthesized;
the image frame to be synthesized is at least one image frame collected by the mobile terminal after receiving a shooting instruction, and the exposure time of the image frame to be synthesized is less than that of the image frame stored in the mobile terminal.
Optionally, the scene characteristic information includes movement information of the object to be shot and brightness of the shooting scene;
wherein the movement information of the photographic subject includes speed information of the photographic subject.
The mobile terminal of the present invention may be a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), or a vehicle-mounted computer.
The mobile terminal 800 can implement each process implemented by the terminal in the foregoing embodiments, and details are not described here to avoid repetition.
In the mobile terminal 800 of the embodiment of the present invention, the processor 860 is configured to obtain scene characteristic information of a shooting scene during a process of acquiring a preview image by a camera; determining the frequency of storing image frames according to the scene characteristic information; storing each frame of image frame collected by the mobile terminal according to the frequency; if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction; generating a final output image based on the at least one target image frame. According to the embodiment of the invention, the storage frequency of the image frames is dynamically adjusted according to the scene characteristic information, so that the problem that a mobile terminal consumes a large amount of power because each frame of image needs to be stored when the existing zero-shutter delayed photographing is carried out is solved.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by controlling the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when executed, the program can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (6)

1. A shooting method is applied to a mobile terminal and is characterized by comprising the following steps:
acquiring scene characteristic information of a shooting scene in the process of acquiring a preview image by a camera;
determining the frequency of storing image frames according to the scene characteristic information;
storing each frame of image frame collected by the mobile terminal according to the frequency;
if a shooting instruction is received, selecting at least one target image frame from the stored image frames according to a shooting mode indicated by the shooting instruction;
generating a final output image based on the at least one target image frame;
the scene characteristic information comprises the movement information of the shot object and the brightness of the shot scene; wherein the movement information of the photographic subject comprises speed information of the photographic subject;
the step of determining a frequency of storing image frames according to the scene characteristic information includes:
determining the target frame number of the collected image frames in the time interval of executing two adjacent storage actions according to the scene characteristic information of the shooting scene;
the step of determining the target frame number of the collected image frame in the time interval of executing two adjacent storage actions according to the scene characteristic information of the shooting scene comprises the following steps:
if the scene characteristic information indicates that the brightness of the shooting scene is less than or equal to a preset brightness threshold, determining that the target frame number is zero;
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold, determining the target frame number according to the movement information of the shot object;
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold, determining the number of the target frames according to the movement information of the shot object, including:
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is less than the preset speed threshold value, determining the number of the target frames as a first numerical value;
if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold value and the moving speed of the shot object is greater than or equal to the preset speed threshold value, determining the target frame number to be a second numerical value;
wherein the second value is smaller than the first value, and the first value and the second value are both positive integers.
2. The photographing method according to claim 1, wherein the step of generating a final output image based on the at least one target image frame includes:
if the current photographing mode is a high dynamic illumination rendering HDR mode, acquiring an image frame to be synthesized;
generating a final output image according to the at least two target image frames and the image frame to be synthesized;
the image frame to be synthesized is at least one image frame collected by the mobile terminal after receiving a shooting instruction, and the exposure time of the image frame to be synthesized is less than that of the image frame stored in the mobile terminal.
3. A mobile terminal, comprising:
the acquisition module is used for acquiring scene characteristic information of a shooting scene in the process of acquiring the preview image by the camera;
the determining module is used for determining the frequency of the stored image frame according to the scene characteristic information;
the storage module is used for storing each frame of image frame collected by the mobile terminal according to the frequency;
the selection module is used for selecting at least one target image frame from the stored image frames according to the shooting mode indicated by the shooting instruction if the shooting instruction is received;
a generating module for generating a final output image based on the at least one target image frame;
the scene characteristic information comprises the movement information of the shot object and the brightness of the shot scene; wherein the movement information of the photographic subject comprises speed information of the photographic subject;
the determining module is used for determining the target frame number of the collected image frame in the time interval of executing two adjacent storage actions according to the scene characteristic information of the shooting scene;
the determining module comprises:
the first determining submodule is used for determining that the target frame number is zero if the scene characteristic information indicates that the brightness of the shooting scene is less than or equal to a preset brightness threshold;
the second determining submodule is used for determining the target frame number according to the movement information of the shot object if the scene characteristic information indicates that the brightness of the shot scene is greater than the preset brightness threshold;
the second determination submodule includes:
a first determining unit, configured to determine that the target frame number is a first numerical value if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold and the moving speed of the shot object is less than a preset speed threshold;
a second determining unit, configured to determine that the target frame number is a second numerical value if the scene characteristic information indicates that the brightness of the shooting scene is greater than the preset brightness threshold and the moving speed of the shot object is greater than or equal to the preset speed threshold;
wherein the second value is smaller than the first value, and the first value and the second value are both positive integers.
4. The mobile terminal of claim 3, wherein the generating module comprises:
the obtaining submodule is used for obtaining an image frame to be synthesized if the current photographing mode is a high dynamic illumination rendering HDR mode;
the generation submodule is used for generating a final output image according to at least two target image frames and the image frame to be synthesized;
the image frame to be synthesized is at least one image frame collected by the mobile terminal after receiving a shooting instruction, and the exposure time of the image frame to be synthesized is less than that of the image frame stored in the mobile terminal.
5. A mobile terminal, comprising: memory, processor and computer program stored on the memory and executable on the processor, which computer program, when being executed by the processor, carries out the steps of the shooting method according to one of claims 1 to 2.
6. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the photographing method according to any one of claims 1 to 2.
CN201710686756.XA 2017-08-11 2017-08-11 Shooting method and mobile terminal Active CN107302664B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710686756.XA CN107302664B (en) 2017-08-11 2017-08-11 Shooting method and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710686756.XA CN107302664B (en) 2017-08-11 2017-08-11 Shooting method and mobile terminal

Publications (2)

Publication Number Publication Date
CN107302664A CN107302664A (en) 2017-10-27
CN107302664B true CN107302664B (en) 2020-06-16

Family

ID=60131718

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710686756.XA Active CN107302664B (en) 2017-08-11 2017-08-11 Shooting method and mobile terminal

Country Status (1)

Country Link
CN (1) CN107302664B (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109726353B (en) * 2017-10-29 2023-08-29 上海寒武纪信息科技有限公司 Convolution operation device and method
CN110163036B (en) * 2018-03-06 2023-07-18 腾讯科技(深圳)有限公司 Image recognition method and device
CN108259777A (en) * 2018-04-13 2018-07-06 长沙全度影像科技有限公司 A kind of system and method automatically shot for the bullet time
CN109064555B (en) * 2018-08-06 2023-06-06 百度在线网络技术(北京)有限公司 Method, apparatus and storage medium for 3D modeling
CN109672819B (en) * 2018-12-10 2021-04-20 Oppo广东移动通信有限公司 Image processing method, image processing device, electronic equipment and computer readable storage medium
CN110766718B (en) * 2019-09-09 2024-04-16 北京美院帮网络科技有限公司 Picture acquisition method, device and system
KR102641738B1 (en) * 2019-09-30 2024-02-29 삼성전자주식회사 Image processing method and electronic device supporting the same
CN111464760A (en) * 2020-05-06 2020-07-28 Oppo(重庆)智能科技有限公司 Dynamic image generation method and device and terminal equipment
CN112261299B (en) * 2020-10-22 2022-06-28 苏州臻迪智能科技有限公司 Unmanned aerial vehicle time-delay shooting method and device, unmanned aerial vehicle and storage medium
CN112689090B (en) * 2020-12-22 2022-10-28 展讯通信(天津)有限公司 Photographing method and related equipment
CN112843691B (en) * 2020-12-31 2022-11-18 上海米哈游天命科技有限公司 Method and device for shooting image, electronic equipment and storage medium
CN115278042B (en) * 2021-04-30 2023-11-28 西门子股份公司 Method, apparatus and computer readable medium for setting frame rate in image processing
CN113329176A (en) * 2021-05-25 2021-08-31 海信电子科技(深圳)有限公司 Image processing method and related device applied to camera of intelligent terminal
CN113473014B (en) * 2021-06-30 2022-11-18 北京紫光展锐通信技术有限公司 Image data processing method and electronic equipment
CN113938602B (en) * 2021-09-08 2022-08-02 荣耀终端有限公司 Image processing method, electronic device, chip and readable storage medium
CN115225819A (en) * 2022-07-20 2022-10-21 哲库科技(上海)有限公司 Image shooting method, device, chip, terminal and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103369230A (en) * 2012-04-06 2013-10-23 联想移动通信科技有限公司 Shooting method and mobile terminal
EP2720451A1 (en) * 2012-10-12 2014-04-16 Samsung Electronics Co., Ltd Apparatus and method for processing image in camera device and portable terminal
CN104822015A (en) * 2014-01-30 2015-08-05 卡西欧计算机株式会社 Image processing apparatus and image processing method
CN105791679A (en) * 2016-02-29 2016-07-20 广东欧珀移动通信有限公司 Method and device for reducing camera power consumption, and mobile terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102527811B1 (en) * 2015-12-22 2023-05-03 삼성전자주식회사 Apparatus and method for generating time lapse image

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103369230A (en) * 2012-04-06 2013-10-23 联想移动通信科技有限公司 Shooting method and mobile terminal
EP2720451A1 (en) * 2012-10-12 2014-04-16 Samsung Electronics Co., Ltd Apparatus and method for processing image in camera device and portable terminal
CN104822015A (en) * 2014-01-30 2015-08-05 卡西欧计算机株式会社 Image processing apparatus and image processing method
CN105791679A (en) * 2016-02-29 2016-07-20 广东欧珀移动通信有限公司 Method and device for reducing camera power consumption, and mobile terminal

Also Published As

Publication number Publication date
CN107302664A (en) 2017-10-27

Similar Documents

Publication Publication Date Title
CN107302664B (en) Shooting method and mobile terminal
CN106060406B (en) Photographing method and mobile terminal
CN107197169B (en) high dynamic range image shooting method and mobile terminal
US11563897B2 (en) Image processing method and apparatus which determines an image processing mode based on status information of the terminal device and photographing scene information
US11228720B2 (en) Method for imaging controlling, electronic device, and non-transitory computer-readable storage medium
CN106161967B (en) Backlight scene panoramic shooting method and mobile terminal
CN107395898B (en) Shooting method and mobile terminal
WO2017215501A1 (en) Method and device for image noise reduction processing and computer storage medium
CN105827970B (en) A kind of image processing method and mobile terminal
KR20200019728A (en) Shooting mobile terminal
CN106060422B (en) A kind of image exposure method and mobile terminal
US20210160416A1 (en) Method for imaging controlling, electronic device, and non-transitory computer-readable storage medium
CN106454086B (en) Image processing method and mobile terminal
US9998720B2 (en) Image processing method for locally adjusting image data of real-time image
CN106331484B (en) Focusing method and mobile terminal
CN107277411B (en) Video recording method and mobile terminal
CN113852756B (en) Image acquisition method, device, equipment and storage medium
CN112437237B (en) Shooting method and device
CN113891018A (en) Shooting method and device and electronic equipment
CN106851099B (en) A kind of method and mobile terminal of shooting
CN107105158B (en) Photographing method and mobile terminal
US10791307B2 (en) Image details processing method, apparatus, terminal, and storage medium
CN114285978A (en) Video processing method, video processing device and electronic equipment
US11336802B2 (en) Imaging apparatus
CN112312024A (en) Photographing processing method and device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant