WO2023220957A1 - 图像处理方法、装置、移动终端及存储介质 - Google Patents

图像处理方法、装置、移动终端及存储介质 Download PDF

Info

Publication number
WO2023220957A1
WO2023220957A1 PCT/CN2022/093485 CN2022093485W WO2023220957A1 WO 2023220957 A1 WO2023220957 A1 WO 2023220957A1 CN 2022093485 W CN2022093485 W CN 2022093485W WO 2023220957 A1 WO2023220957 A1 WO 2023220957A1
Authority
WO
WIPO (PCT)
Prior art keywords
preview
image
thumbnail display
parameters
frame
Prior art date
Application number
PCT/CN2022/093485
Other languages
English (en)
French (fr)
Inventor
林择旭
Original Assignee
北京小米移动软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京小米移动软件有限公司 filed Critical 北京小米移动软件有限公司
Priority to PCT/CN2022/093485 priority Critical patent/WO2023220957A1/zh
Priority to CN202280004220.4A priority patent/CN117441341A/zh
Publication of WO2023220957A1 publication Critical patent/WO2023220957A1/zh

Links

Images

Definitions

  • the present disclosure relates to the technical field of electronic equipment, and specifically relates to an image processing method, device, mobile terminal and storage medium.
  • imaging systems have become the most important component of mobile terminals.
  • smartphones for extremely dark light scenes such as at night, the imaging system of smartphones is often set up with a night scene mode to ensure imaging quality.
  • the preview interface of smartphones can hardly present effective detailed information. Users cannot know the imaging effect in advance. They can only know the imaging effect through the final processed image after pressing the shutter. The experience is relatively slow. Difference.
  • embodiments of the present disclosure provide an image processing method, device, mobile terminal and storage medium.
  • an embodiment of the present disclosure provides an image processing method, applied to a mobile terminal, and the method includes:
  • preview image data where the preview image data includes preview frame data of at least one frame of preview image
  • the thumbnail display image is output and displayed in a thumbnail display window of a preview interface; the preview interface is a photo preview interface of the mobile terminal, and the thumbnail display window is displayed at a preset position of the preview interface partial window.
  • the image parameters of the preview image are adjusted according to the preview frame data to obtain a preset number of intermediate frame images, including:
  • the preset number of intermediate frame images is obtained according to the first number of intermediate frame images and the second number of intermediate frame images.
  • the image parameters include at least one of the following:
  • Brightness parameters, contrast parameters, gamma values are brightness parameters, contrast parameters, gamma values.
  • the method before adjusting the image parameters of the preview image according to the preview frame data for each frame of the preview image, the method further includes:
  • the preview image is subjected to resolution down-sampling processing according to the preview frame data.
  • the method further includes:
  • the step of adjusting the image parameters of the preview image according to the preview frame data for each frame of the preview image is performed.
  • the method described in the present disclosure further includes:
  • setting options for the thumbnail display window are output and displayed on the preview interface;
  • the target parameters of the thumbnail display window include at least one of the following:
  • the position parameters of the thumbnail display window on the preset interface the size parameters of the thumbnail display window, and the display effect parameters of the thumbnail display window.
  • inventions of the present disclosure provide an image processing device, which is applied to a mobile terminal.
  • the device includes:
  • a data acquisition module configured to acquire preview image data, where the preview image data includes preview frame data of at least one frame of preview image
  • An intermediate frame determination module configured to, for each frame of the preview image, adjust the image parameters of the preview image according to the preview frame data to obtain a preset number of intermediate frame images
  • a fusion processing module configured to perform fusion processing on the preset number of intermediate frame images to obtain a thumbnail display image
  • a display module is configured to output and display the thumbnail display image in a thumbnail display window of a preview interface; the preview interface is a photo preview interface of the mobile terminal, and the thumbnail display window is displayed on the A partial window at the preset position of the preview interface.
  • the intermediate frame determination module is configured as:
  • the preset number of intermediate frame images is obtained according to the first number of intermediate frame images and the second number of intermediate frame images.
  • the image parameters include at least one of the following:
  • Brightness parameters, contrast parameters, gamma values are brightness parameters, contrast parameters, gamma values.
  • the device further includes a downsampling module, and the downsampling module is configured to:
  • the preview image is subjected to resolution down-sampling processing according to the preview frame data.
  • the device further includes a mode determination module, and the mode determination module is configured to:
  • the step of adjusting the image parameters of the preview image according to the preview frame data for each frame of the preview image is performed.
  • the device further includes an adjustment module, and the adjustment module is configured to:
  • setting options for the thumbnail display window are output and displayed on the preview interface;
  • the target parameters of the thumbnail display window include at least one of the following:
  • the position parameters of the thumbnail display window on the preset interface the size parameters of the thumbnail display window, and the display effect parameters of the thumbnail display window.
  • an embodiment of the present disclosure provides a mobile terminal, including:
  • the memory stores computer instructions that can be read by the processor.
  • the processor executes the method according to any embodiment of the first aspect.
  • an embodiment of the present disclosure provides a storage medium for storing computer-readable instructions for causing a computer to execute the method according to any embodiment of the first aspect.
  • the image processing method in the embodiment of the present disclosure includes obtaining preview image data, for each frame of preview image, adjusting the image parameters of the preview image according to the preview frame data to obtain a preset number of intermediate frame images, and adjusting the preset number of intermediate frame images Perform fusion processing to obtain a thumbnail display image, and output the thumbnail display image to be displayed in the thumbnail display window of the preview interface.
  • thumbnail display images with detailed scene information are presented on the preview interface without sacrificing preview fluency, thereby providing users with effective information in dark light scenes. Photography assistance to improve user experience.
  • Figure 1 is a schematic diagram of a preview interface of a mobile terminal in a dark light scene in the related art.
  • Figure 2 is a structural block diagram of a mobile terminal according to some embodiments of the present disclosure.
  • Figure 3 is a schematic diagram of a preview interface of a mobile terminal according to some embodiments of the present disclosure.
  • Figure 4 is a flowchart of an image processing method according to some embodiments of the present disclosure.
  • Figure 5 is a schematic diagram of an image processing method according to some embodiments of the present disclosure.
  • Figure 6 is a schematic diagram of an image processing method according to some embodiments of the present disclosure.
  • Figure 7 is a flowchart of an image processing method according to some embodiments of the present disclosure.
  • Figure 8 is a flowchart of an image processing method according to some embodiments of the present disclosure.
  • Figure 9 is a schematic diagram of a preview interface of a mobile terminal according to some embodiments of the present disclosure.
  • Figure 10 is a structural block diagram of an image processing device according to some embodiments of the present disclosure.
  • FIG. 11 is a structural block diagram of an image processing device according to some embodiments of the present disclosure.
  • Figure 12 is a structural block diagram of a mobile terminal according to some embodiments of the present disclosure.
  • the night scene mode mainly uses bracketing exposure. After the user presses the shutter, multiple images with different exposure times are collected by extending the exposure time, and then the software fusion algorithm is used to fuse the multiple images into one. Images are output and displayed, resulting in high-quality images with rich details.
  • the inventor of this case found that for some extremely dark light scenes, although the imaging system can finally present a night scene image with better details.
  • the preview interface before taking pictures, due to the poor light environment, the preview interface can hardly present any effective detailed information of the current scene, so the user cannot expect the imaging effect. The imaging can only be perceived after pressing the shutter to get the final image. Effect.
  • the current scene seen by the human eye is close to that shown in (a) of Figure 1. That is, the human eye can observe a small amount of scene details.
  • the preview effect presented by the preview interface of the mobile terminal is as shown in (b) of Figure 1. It can be seen that there is almost no effective detailed information in the preview interface. Therefore, when users take pictures in extremely dark light environments, it is almost impossible to perceive the current expected imaging effect through the preview interface.
  • the inventor of this case found through research that this is because the preview interface of the mobile terminal needs to maintain the smoothness of the frame rate to avoid a stuck and unsmooth experience in the preview interface.
  • the display frame rate of the preview interface of mobile terminals is 30FPS, which limits the exposure time of each frame of the preview image to no more than 33ms. In extremely dark light scenes, such a short exposure time causes the image to be almost unable to display detailed information.
  • the exposure time of the preview image is extended, for example, the exposure time of the preview image is increased to 100ms, then the frame rate of the preview interface will be reduced to 10FPS, and the preview interface will show lags and unsmoothness that the user can clearly perceive, reducing user experience. experience.
  • the preview interface of the mobile terminal can hardly provide effective detailed information to assist the user in taking pictures, resulting in a poor night photography experience for the user.
  • embodiments of the present disclosure provide an image processing method, device, electronic device and storage medium, so as to realize the presentation of abbreviations with scene detail information on the preview interface without sacrificing the fluency of the preview.
  • the image is slightly displayed, thereby providing users with effective photography assistance in dark light scenes and improving user experience.
  • an embodiment of the present disclosure provides an image processing method, which can be applied to a mobile terminal.
  • the mobile terminal described in the embodiments of the present disclosure can be any device type suitable for having a camera function, such as a smart phone, a tablet computer, a wearable device, etc., and the present disclosure does not limit this.
  • FIG. 2 shows a structural block diagram of the imaging system of the mobile terminal in the embodiment of the present disclosure.
  • the display principle of the preview interface will be described below with reference to FIG. 2 .
  • the imaging system of the mobile terminal includes an image sensor 100 , an image processing unit 200 and a display unit 300 .
  • the image sensor 100 refers to the photosensitive device of the imaging system, such as a camera module, etc.
  • the image sensor 100 is configured to receive external light and output corresponding original image data (RAW data) according to the received light, that is, the preview image data described in this disclosure.
  • RAW data original image data
  • the image sensor 100 can be any sensor type suitable for implementation, such as a CMOS (Complementary Metal Oxide Semiconductor, Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge-coupled Device, Charge Coupled Element) sensor, etc., this invention
  • CMOS Complementary Metal Oxide Semiconductor, Complementary Metal Oxide Semiconductor
  • CCD Charge-coupled Device, Charge Coupled Element
  • the image processing unit 200 refers to a device that receives preview image data from the image sensor 100 and performs data processing on the preview image data.
  • the image processing unit 200 includes a preview image processing module 210 and a thumbnail image processing module 220 .
  • the preview image processing module 210 may process the received preview image data, and then send it to the preview interface of the display unit 300 for output display.
  • the thumbnail image processing module 220 may process the received preview image data, and then send it to the thumbnail display window of the display unit 300 for output display.
  • the preview image processing module 210 and the thumbnail image processing module 220 may be different modules integrated in the same processing chip, for example, integrated in the same ISP (Image Signal Processing, Image Signal Processing) chip.
  • the preview image processing module 210 and the thumbnail image processing module 220 may also be two independent processing chips, and the present disclosure does not limit this.
  • the display unit 300 refers to a device for displaying images, such as a display screen, a viewfinder, etc.
  • the display unit 300 can not only display the preview interface, but also display the thumbnail display window.
  • the display unit 300 is a mobile phone display screen.
  • the display screen not only the regular preview interface 310 can be displayed, but also the thumbnail display window 320 can be displayed.
  • the thumbnail display window 320 is used to display a thumbnail display image with certain scene detail information, thereby providing assistance to the user in taking photos in a dark light scene, and the user can perceive the current situation through the thumbnail display image. The shooting effect, and then determine whether the photo can be taken. For example, as shown in FIG. 3 , the user can hardly perceive any effective detailed information in the preview interface 310 , but in the thumbnail display window 320 , the user can view the general thumbnail information of the current scene, and thereby anticipate the imaging effect.
  • the image processing method of the present disclosure includes:
  • preview image data refers to RAW image data collected by, for example, the image sensor 100 shown in FIG. 2. After the preview image data is processed by the image processing unit 200, it is sent to the display unit 300 for output display, so that the user The preview image can be seen on the display unit 300.
  • the preview image data is processed by the image processing unit 200, it is sent to the display unit 300 frame by frame, so that the display unit 300 can display the preview image frame by frame.
  • the frame rate reaches a certain frequency, the human naked eye can view the coherent video stream preview interface.
  • the preview interface of most smartphones currently is 30FPS, and the preview interface viewed by the user is a continuous preview image display.
  • the preview image data may include preview frame data of one or more frames of preview images.
  • the image processing unit 200 may process the preview frame data frame by frame in a time sequence, and then send the preview frame data to the display unit 300 frame by frame for display.
  • the description will be continued in the following steps of this disclosure.
  • the preview image processing module 210 can process the preview frame data of each preview image frame by frame, and then send the processed imaging data to the display frame by frame.
  • the unit 300 and the display unit 300 can output and display the preview image frame by frame on the preview interface 310 . This process can be implemented with reference to the preview interface principle in related technologies, which will not be described in detail in this disclosure.
  • the preview frame data of each preview image is processed frame by frame through the thumbnail image processing module 220, and then the processed thumbnail display image is sent to the display unit 300 frame by frame.
  • the thumbnail display image can be output and displayed frame by frame on the thumbnail display window 320.
  • the following takes a frame of preview image as an example to explain the process of displaying a thumbnail display image.
  • the thumbnail image processing module 220 adjusts the image parameters of the preview image according to the preview frame data of the frame of preview image, thereby obtaining multiple intermediate frame images.
  • Image parameters refer to relevant parameters that can change the original imaging effect of the image.
  • commonly used image parameters can include brightness parameters, contrast parameters, gamma values, etc. By adjusting these parameters of the image, the brightness or contrast of the image can be changed. .
  • the image parameter takes the brightness parameter as an example.
  • the brightness parameters of the preview image can be adjusted to different parameter values, thereby obtaining intermediate frame images with different brightness.
  • the thumbnail image processing module 220 may adjust the image parameters based on the preview frame data of the preview image.
  • the intermediate frame images shown in Figure 5 (a) and Figure 5 (b) can be obtained by sequentially reducing the brightness parameters; in some examples, Figure 5 can be obtained by sequentially increasing the brightness parameters.
  • the method of adjusting the image parameters of the preview image in the embodiment of the present disclosure is not limited to adjusting the brightness parameter, and any other image parameter type suitable for implementation can also be used, such as contrast parameters, gamma value, etc., this disclosure does not limit this.
  • the number of intermediate frame images is not limited to 6 in the above example, and can also be any other preset number suitable for implementation, which will not be described again in this disclosure.
  • S430 Fusion process a preset number of intermediate frame images to obtain a thumbnail display image.
  • these intermediate frame images can be fused to fuse multiple intermediate frame images into one frame of thumbnail display image.
  • feature extraction can be performed on the middle frame image of each frame based on an image fusion algorithm, and then fusion processing is performed based on the extracted features to obtain a thumbnail display image.
  • the six intermediate frame images represent the renderings of the preview image under different brightness parameters, that is, these intermediate frame images cover the current scene in extremely dark light, dark light, bright light, and high bright light.
  • the resulting thumbnail display image can retain a large amount of light and dark detail information.
  • Figure 6 shows the thumbnail display image obtained after fusion processing of the intermediate frame image in Figure 5. It can be seen from Figure 6 that compared with the original preview image ((c) in Figure 5), the thumbnail display image is The displayed image ( Figure 6) already has very rich image details, and the user can clearly perceive the current shooting angle, range and other information.
  • the thumbnail display image can be sent to the display unit 300 , and then the display unit 300 can output and display the thumbnail display image in the thumbnail display window 320 .
  • the image parameters of the preview image are adjusted.
  • a very simple and efficient method that differs from extending the exposure time. Extending the exposure time requires adjusting the exposure time before capturing the preview image to control the amount of light entering the lens.
  • the image parameters are directly changed to adjust the image brightness without changing the exposure time. Therefore, the preview interface can still maintain a smoothness of 30FPS.
  • this method can quickly present the outline range of the object in the image, but its shortcomings are also obvious: raising the brightness will cause a lot of noise and color casts in the image, and the specific details of the object Characteristics will be lost. Therefore, the image quality of the thumbnail display image presented in this way is not high, and the display effect as a large image is poor.
  • an additional partial window that is, the thumbnail display window 320, is set up on the preview interface 310 to display the thumbnail display image on the preview interface 310. on the thumbnail display window 320.
  • thumbnail display image is not high, on the one hand, it is only used to assist the user in taking pictures. It only needs to ensure that the user can clearly see the outline of the object in a dark light scene and can predict the imaging range and angle. No need Has very high image quality.
  • displaying smaller-sized thumbnail display images through the thumbnail display window can also hide some defects, reduce the intuitive feeling of image defects to users, and improve user experience.
  • the image processing method of the present disclosure example the process of obtaining the intermediate frame image includes:
  • S730 Obtain a preset number of intermediate frame images based on the first number of intermediate frame images and the second number of intermediate frame images.
  • the preset number of intermediate frame images corresponding to the frame preview image includes both intermediate frame images with image parameters smaller than the current parameters, and also includes intermediate frame images with image parameters greater than the current parameters. frame image. Therefore, the thumbnail display image obtained by fusion can not only have better details of bright parts, but also have better details of dark parts.
  • the preview image is as shown in (c) of Figure 5.
  • the thumbnail image processing module 220 can sequentially reduce the brightness parameters of the preview image based on the preview frame data of the preview image, thereby obtaining Figure 5
  • the thumbnail image processing module 220 can also sequentially increase the brightness parameters of the preview image based on the preview frame data of the frame preview image, thereby obtaining the three middle images shown in (d), (e) and (f) in Figure 5 frame image. Therefore, by adjusting the brightness parameters of the preview image, a total of 6 intermediate frame images shown in Figure 5 are obtained.
  • the thumbnail display image can not only have better bright detail characteristics, but also have better dark detail characteristics.
  • the thumbnail image processing module 220 performs brightness processing and image fusion, so That's a lot of data to process. Therefore, in order to reduce the amount of calculation, the preview image can be downsampled in advance before adjusting the image parameters of the preview frame data.
  • the preview image obtained by the image sensor 100 is in the scale of 1920 pixels*1080 pixels.
  • the preview image can be down-sampled to scale the image to the scale of 640 pixels*480 pixels, thereby greatly reducing subsequent
  • the amount of calculation is reduced, the data processing speed is improved, and since the thumbnail display image is only displayed in the thumbnail display window 320 at a smaller scale, there is almost no significant decrease in the display effect.
  • not only downsampling processing can be performed on the preview image in advance, but also various image preprocessing such as cropping and completion can be performed, which is not limited by the present disclosure.
  • the preview image is down-sampled, thereby greatly reducing the amount of subsequent calculations, improving the data processing speed, and ensuring the smooth display of the thumbnail display window.
  • the preview image displayed by the preview interface 310 can directly provide the user with a photo preview, there is no need to additionally display the thumbnail display image through the thumbnail display window 320 . Therefore, the above image processing method can be executed only in dark light scenes.
  • the current photographing mode of the mobile terminal before executing the above image processing method, can be detected.
  • the above image processing method process is executed to achieve the user Photography assistance.
  • the camera application of the mobile terminal has multiple photographing modes.
  • the user selects "night scene”
  • the current ambient light intensity can be detected through the ambient light sensor of the mobile terminal. When it is detected that the current ambient light intensity is lower than a preset threshold, it is determined that the mobile terminal is currently in the night scene photography mode, and the above process is performed.
  • the above image processing method is executed to improve the user's photography experience.
  • the thumbnail display window 320 can be displayed in a hierarchical manner on the upper layer of the preview interface 310 , or can be displayed in an embedded manner in the preview interface 310 , as long as the user can ensure that the user can preview the window 320 . You can see the thumbnail display window 320 on the interface.
  • the relevant parameters of the thumbnail display window 320 can be freely set by the user, thereby improving the user's photographing experience, which will be described below with reference to the embodiment of FIG. 8 .
  • the image processing method of the present disclosure also includes:
  • S830 Obtain the user's setting instruction parameters for the setting options, and adjust the target parameters of the thumbnail display window according to the setting instruction parameters.
  • the user operation instruction may be the user's operation instruction on the display unit 300 of the mobile terminal, such as touch, slide, stand-alone, double-click, long press, etc., to which the present disclosure is not limited.
  • the preset operation instruction is a preset operation instruction to wake up the thumbnail window setting interface, which can be a double click, a long press, a preset gesture, etc., and the present disclosure does not limit this.
  • the user operation instruction is a preset operation instruction
  • the setting options may include size options, position options, border effect options, etc.
  • the user can adjust each setting option through input or gesture operation, so that the mobile terminal can obtain the corresponding setting instruction parameters and adjust accordingly according to the setting instruction parameters. Thumbnail display window of target parameters.
  • the setting instruction parameter is a parameter for adjusting the size option of the thumbnail display window, so that the mobile terminal can adjust the display size of the thumbnail display window on the preview interface according to the user's setting instruction parameter.
  • the setting instruction parameter is a parameter for adjusting the position option of the thumbnail display window, so that the mobile terminal can adjust the display position of the thumbnail display window on the preview interface according to the user's setting instruction parameter.
  • FIG. 9 shows the display effect after adjusting the position and size of the thumbnail display window 320 shown in FIG. 3 .
  • the setting instruction parameter is a parameter for adjusting the border effect option of the thumbnail display window, so that the mobile terminal can adjust the border effect of the thumbnail display window on the preview interface according to the user's setting instruction parameter.
  • the target parameters of the thumbnail display window can be adjusted based on user operation instructions to improve the photography experience.
  • embodiments of the present disclosure provide an image processing device, which can be applied to a mobile terminal.
  • the mobile terminal described in the embodiments of the present disclosure can be any type of device suitable for having a camera function, such as a smart phone, Tablet computers, wearable devices, etc., this disclosure does not limit this.
  • the image processing device of the present disclosure includes:
  • the data acquisition module 10 is configured to acquire preview image data, where the preview image data includes preview frame data of at least one frame of preview image;
  • the intermediate frame determination module 20 is configured to adjust the image parameters of the preview image according to the preview frame data for each frame of the preview image to obtain a preset number of intermediate frame images;
  • the fusion processing module 30 is configured to perform fusion processing on a preset number of intermediate frame images to obtain thumbnail display images;
  • the display module 40 is configured to output and display the thumbnail display image in the thumbnail display window of the preview interface; the preview interface is the photo preview interface of the mobile terminal, and the thumbnail display window is a partial window displayed at a preset position of the preview interface.
  • the intermediate frame determination module is configured as:
  • the preset number of intermediate frame images is obtained according to the first number of intermediate frame images and the second number of intermediate frame images.
  • the image parameters include at least one of the following:
  • Brightness parameters, contrast parameters, gamma values are brightness parameters, contrast parameters, gamma values.
  • the image processing device of the embodiment of the present disclosure further includes a downsampling module 50, and the downsampling module 50 is configured to:
  • the resolution of the preview image is downsampled based on the preview frame data.
  • the preview image is down-sampled, thereby greatly reducing the amount of subsequent calculations, improving the data processing speed, and ensuring the smooth display of the thumbnail display window.
  • the image processing device of the embodiment of the present disclosure further includes a mode determination module 60, and the mode determination module 60 is configured to:
  • the step of adjusting the image parameters of the preview image according to the preview frame data is performed.
  • the above image processing method is executed to improve the user's photography experience.
  • the image processing device of the embodiment of the present disclosure further includes an adjustment module 70, and the adjustment module 70 is configured to:
  • setting options for the thumbnail display window are output and displayed on the preview interface;
  • the target parameters of the thumbnail display window include at least one of the following:
  • the position parameters of the thumbnail display window on the preset interface the size parameters of the thumbnail display window, and the display effect parameters of the thumbnail display window.
  • the target parameters of the thumbnail display window can be adjusted based on user operation instructions to improve the photography experience.
  • an embodiment of the present disclosure provides a mobile terminal, including:
  • the memory stores computer instructions that can be read by the processor.
  • the processor executes the method according to any implementation of the first aspect.
  • an embodiment of the present disclosure provides a storage medium for storing computer-readable instructions, and the computer-readable instructions are used to cause a computer to execute the method according to any embodiment of the first aspect.
  • Figure 12 shows a structural block diagram of a mobile terminal in some embodiments of the present disclosure. The relevant principles of the mobile terminal and storage media in some embodiments of the present disclosure will be described below with reference to Figure 12.
  • the mobile terminal 1800 may include one or more of the following components: a processing component 1802, a memory 1804, a power component 1806, a multimedia component 1808, an audio component 1810, an input/output (I/O) interface 1812, a sensor component 1816, and communications component 1818.
  • a processing component 1802 a memory 1804, a power component 1806, a multimedia component 1808, an audio component 1810, an input/output (I/O) interface 1812, a sensor component 1816, and communications component 1818.
  • the processing component 1802 generally controls the overall operations of the mobile terminal 1800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
  • Processing component 1802 may include one or more processors 1820 to execute instructions.
  • processing component 1802 may include one or more modules that facilitate interaction between processing component 1802 and other components.
  • processing component 1802 may include a multimedia module to facilitate interaction between multimedia component 1808 and processing component 1802.
  • the processing component 1802 can read executable instructions from the memory to implement mobile terminal related functions.
  • the memory 1804 is configured to store various types of data to support operations at the mobile terminal 1800 . Examples of these data include instructions for any application or method operating on the mobile terminal 1800, contact data, phonebook data, messages, pictures, videos, etc.
  • Memory 1804 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EEPROM erasable programmable read-only memory
  • EPROM Programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory flash memory
  • flash memory magnetic or optical disk.
  • Power supply component 1806 provides power to various components of mobile terminal 1800.
  • Power component 1806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to mobile terminal 1800.
  • Multimedia component 1808 includes a display screen that provides an output interface between the mobile terminal 1800 and the user.
  • multimedia component 1808 includes a front-facing camera and/or a rear-facing camera.
  • the front camera and/or the rear camera may receive external multimedia data.
  • Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.
  • Audio component 1810 is configured to output and/or input audio signals.
  • the audio component 1810 includes a microphone (MIC) configured to receive external audio signals when the mobile terminal 1800 is in operating modes, such as call mode, recording mode, and voice recognition mode.
  • the received audio signals may be further stored in memory 1804 or sent via communications component 1818 .
  • audio component 1810 includes a speaker for outputting audio signals.
  • the I/O interface 1812 provides an interface between the processing component 1802 and a peripheral interface module.
  • the peripheral interface module may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.
  • Sensor component 1816 includes one or more sensors for providing various aspects of status assessment for mobile terminal 1800 .
  • the sensor component 1816 can detect the open/closed state of the mobile terminal 1800 and the relative positioning of components, such as the display and keypad of the mobile terminal 1800.
  • the sensor component 1816 can detect the mobile terminal 1800 or a component of the mobile terminal 1800.
  • the position changes, the presence or absence of user contact with the mobile terminal 1800, the orientation or acceleration/deceleration of the mobile terminal 1800 and the temperature change of the mobile terminal 1800.
  • Sensor component 1816 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor component 1816 may include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 1816 may include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 1818 is configured to facilitate wired or wireless communication between the mobile terminal 1800 and other devices.
  • the mobile terminal 1800 can access a wireless network based on communication standards, such as Wi-Fi, 2G, 3G, 4G, 5G or 6G, or a combination thereof.
  • communication component 1818 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel.
  • the communications component 1818 includes a near field communications (NFC) module to facilitate short-range communications.
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • the mobile terminal 1800 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable Programmed gate array
  • controller microcontroller, microprocessor or other electronic component implementation.

Landscapes

  • Studio Devices (AREA)

Abstract

本公开涉及电子设备技术领域,具体提供了一种图像处理方法、装置、移动终端及存储介质。一种图像处理方法,包括:获取预览图像数据,所述预览图像数据包括至少一帧预览图像的预览帧数据;对于每帧预览图像,根据所述预览帧数据对预览图像的图像参数进行调整;对所述预设数量的中间帧图像进行融合处理,得到缩略显示图像;将所述缩略显示图像输出显示在预览界面的缩略显示窗口中;所述预览界面为所述移动终端的拍照预览界面,所述缩略显示窗口为显示于所述预览界面预设位置的局部窗口。本公开实施方式,通过缩略显示图为用户提供拍照辅助,提高拍照体验。

Description

图像处理方法、装置、移动终端及存储介质 技术领域
本公开涉及电子设备技术领域,具体涉及一种图像处理方法、装置、移动终端及存储介质。
背景技术
随着电子设备的发展,影像系统已经成为移动终端最为重要的组成部分。以智能手机为例,针对夜晚等极暗光场景,智能手机的影像系统往往设置有夜景模式以保证成像质量。
但是,在极暗光场景下,智能手机的预览界面几乎无法呈现有效的细节信息,用户无法预先得知成像效果,只能在按下快门之后通过最终处理后的图像得知成像效果,体验较差。
发明内容
为提高移动终端拍照效果,本公开实施方式提供了一种图像处理方法、装置、移动终端以及存储介质。
第一方面,本公开实施方式提供了一种图像处理方法,应用于移动终端,所述方法包括:
获取预览图像数据,所述预览图像数据包括至少一帧预览图像的预览帧数据;
对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整,得到预设数量的中间帧图像;
对所述预设数量的中间帧图像进行融合处理,得到缩略显示图像;
将所述缩略显示图像输出显示在预览界面的缩略显示窗口中;所述预览界面为所述移动终端的拍照预览界面,所述缩略显示窗口为显示于所述预览界面预设位置的局部窗口。
在一些实施方式中,所述根据所述预览帧数据对所述预览图像的图像参数进行调整,得到预设数量的中间帧图像,包括:
根据所述预览帧数据,降低所述预览图像的图像参数的参数值,得到第一数量的中间帧图像;
根据所述预览帧数据,提高所述预览图像的图像参数的参数值,得到第二数量的中间帧图像;
根据所述第一数量的中间帧图像和所述第二数量的中间帧图像,得到所述预设数量的中间帧图像。
在一些实施方式中,所述图像参数包括以下至少之一:
亮度参数、对比度参数、伽马值。
在一些实施方式中,在所述对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整之前,所述方法还包括:
对于每帧预览图像,根据所述预览帧数据对所述预览图像进行分辨率下采样处理。
在一些实施方式中,
在所述对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整之前,所述方法还包括:
响应于所述移动终端当前处于夜景拍照模式,执行所述对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整的步骤。
在一些实施方式中,本公开所述的方法,还包括:
获取用户操作指令;
响应于所述用户操作指令为预设操作指令,在所述预览界面上输出显示针对所述缩略显示窗口的设置选项;
获取用户针对所述设置选项的设置指令参数,调整所述缩略显示窗口的目标参数。
在一些实施方式中,所述缩略显示窗口的目标参数包括以下至少之一:
所述缩略显示窗口在所述预设界面上的位置参数、所述缩略显示窗口的尺寸参数、所述缩略显示窗口的显示效果参数。
第二方面,本公开实施方式提供了一种图像处理装置,应用于移动终端,所述装置包括:
数据获取模块,被配置为获取预览图像数据,所述预览图像数据包括至少一帧预览图像的预览帧数据;
中间帧确定模块,被配置为对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整,得到预设数量的中间帧图像;
融合处理模块,被配置为对所述预设数量的中间帧图像进行融合处理,得到缩略显示图像;
显示模块,被配置为将所述缩略显示图像输出显示在预览界面的缩略显示窗口中;所述预览界面为所述移动终端的拍照预览界面,所述缩略显示窗口为显示于所述预览界面预设位置的局部窗口。
在一些实施方式中,所述中间帧确定模块,被配置为:
根据所述预览帧数据,降低所述预览图像的图像参数的参数值,得到第一数量的中间帧图像;
根据所述预览帧数据,提高所述预览图像的图像参数的参数值,得到第二数量的中间帧图像;
根据所述第一数量的中间帧图像和所述第二数量的中间帧图像,得到所述预设数量的中间帧图像。
在一些实施方式中,所述图像参数包括以下至少之一:
亮度参数、对比度参数、伽马值。
在一些实施方式中,所述的装置还包括下采样模块,所述下采样模块被配置为:
对于每帧预览图像,根据所述预览帧数据对所述预览图像进行分辨率下采样处理。
在一些实施方式中,所述的装置还包括模式确定模块,所述模式确定模块被配置为:
响应于所述移动终端当前处于夜景拍照模式,执行所述对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整的步骤。
在一些实施方式中,所述的装置还包括调整模块,所述调整模块被配置为:
获取用户操作指令;
响应于所述用户操作指令为预设操作指令,在所述预览界面上输出显示针对所述缩略显示窗口的设置选项;
获取用户针对所述设置选项的设置指令参数,调整所述缩略显示窗口 的目标参数。
在一些实施方式中,所述缩略显示窗口的目标参数包括以下至少之一:
所述缩略显示窗口在所述预设界面上的位置参数、所述缩略显示窗口的尺寸参数、所述缩略显示窗口的显示效果参数。
第三方面,本公开实施方式提供了一种移动终端,包括:
处理器;以及
存储器,存储有能够被所述处理器读取的计算机指令,当所述计算机指令被读取时,所述处理器执行根据第一方面任意实施方式所述的方法。
第四方面,本公开实施方式提供了一种存储介质,用于存储计算机可读指令,所述计算机可读指令用于使计算机执行根据第一方面任意实施方式所述的方法。
本公开实施方式的图像处理方法,包括获取预览图像数据,对于每帧预览图像,根据预览帧数据对预览图像的图像参数进行调整得到预设数量的中间帧图像,对预设数量的中间帧图像进行融合处理,得到缩略显示图像,将缩略显示图像输出显示在预览界面的缩略显示窗口中。本公开实施方式中,通过生成并显示缩略显示图像,实现在不牺牲预览流畅性的基础上,在预览界面呈现具有场景细节信息的缩略显示图像,从而为用户在暗光场景下提供有效的拍照辅助,提高用户体验。
附图说明
为了更清楚地说明本公开具体实施方式或现有技术中的技术方案,下面将对具体实施方式或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本公开的一些实施方式,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是相关技术中暗光场景下的移动终端的预览界面示意图。
图2是根据本公开一些实施方式中移动终端的结构框图。
图3是根据本公开一些实施方式中移动终端的预览界面示意图。
图4是根据本公开一些实施方式中图像处理方法的流程图。
图5是根据本公开一些实施方式中图像处理方法的原理图。
图6是根据本公开一些实施方式中图像处理方法的原理图。
图7是根据本公开一些实施方式中图像处理方法的流程图。
图8是根据本公开一些实施方式中图像处理方法的流程图。
图9是根据本公开一些实施方式中移动终端的预览界面示意图。
图10是根据本公开一些实施方式中图像处理装置的结构框图。
图11是根据本公开一些实施方式中图像处理装置的结构框图。
图12是根据本公开一些实施方式中移动终端的结构框图。
具体实施方式
下面将结合附图对本公开的技术方案进行清楚、完整地描述,显然,所描述的实施方式是本公开一部分实施方式,而不是全部的实施方式。基于本公开中的实施方式,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施方式,都属于本公开保护的范围。此外,下面所描述的本公开不同实施方式中所涉及的技术特征只要彼此之间未构成冲突就可以相互结合。
暗光场景下拍照是各大消费电子设备厂商对于影像系统的重点研究方向之一,例如,目前各大品牌的智能手机均具有夜景拍照模式,可以在夜晚等暗光场景下实现较好的成像效果。
相关技术中,夜景模式主要是采用包围曝光的方式,在用户按下快门之后,通过延长曝光时间的方式采集多张不同曝光时长的图像,然后利用软件融合算法,将这多张图像融合为一张图像输出显示,从而得到细节丰富的高质量图像。
在实际拍照场景中,本案发明人发现,对于部分极暗光场景,虽然影像系统最后可以呈现出细节较好的夜景图像。但是,在拍照前的预览界面中,由于光线环境恶劣,预览界面几乎无法呈现任何当前场景的有效细节信息,从而用户无法预期成像效果,只有在按下快门得到最终的图像之后,才能感知到成像效果。
例如图1所示的极暗光场景中,人体肉眼看到的当前场景接近于图1中(a)所示,也即,人体肉眼可以观察到少量的场景细节。但是,相关技术中, 移动终端的预览界面呈现的预览效果如图1中(b)所示,可以看到,在预览界面中几乎不存在任何有效细节信息。因此,用户在极暗光环境拍照时,几乎无法通过预览界面感知到当前的成像预期效果。
本案发明人通过研究发现,这是由于,对于移动终端的预览界面来说,其需要保持帧率的流畅性,避免预览界面出现卡顿、不流畅的体验。一般移动终端的预览界面的显示帧率为30FPS,这也就限制了每帧预览图像的曝光时长不能超过33ms,在极暗光场景下,如此短的曝光时间导致图像几乎无法显示细节信息。而若是延长预览图像的曝光时间,例如将预览图像的曝光时长提高至100ms,那么预览界面的帧率将降至10FPS,预览界面将呈现出用户能够明显感知到的卡顿、不流畅,降低用户体验。
由此可见,相关技术中,在暗光环境拍照场景中,移动终端的预览界面几乎无法提供有效细节信息来辅助用户拍照,导致用户夜间拍照体验很差。
基于上述相关技术中存在的缺陷,本公开实施方式提供了一种图像处理方法、装置、电子设备以及存储介质,实现在不牺牲预览流畅性的基础上,在预览界面呈现具有场景细节信息的缩略显示图像,从而为用户在暗光场景下提供有效的拍照辅助,提高用户体验。
第一方面,本公开实施方式提供了一种图像处理方法,该方法可应用于移动终端。本公开实施方式所述的移动终端,可以是任何适于具有摄像功能的设备类型,例如智能手机、平板电脑、可穿戴设备等,本公开对此不作限制。
图2示出了本公开实施方式中移动终端的影像系统的结构框图,下面结合图2对预览界面的显示原理进行说明。
如图2所示,移动终端的影像系统包括图像传感器100、图像处理单元200以及显示单元300。
图像传感器100指影像系统的感光器件,例如摄像头模组等。图像传感器100其用于接收外部光线,从而根据接收光线输出对应的原始图像数据(RAW数据),也即本公开所述的预览图像数据。
本公开实施方式中,图像传感器100可以是任何适于实施的传感器类型,例如CMOS(Complementary Metal Oxide Semiconductor,互补金属氧化物半导体)传感器、CCD(Charge-coupled Device,电荷耦合元件)传感器等,本 公开对此不作限制。
图像处理单元200指接收图像传感器100的预览图像数据,并且对预览图像数据进行数据处理的器件。
如图2中所示,本公开示例中,图像处理单元200包括预览图像处理模块210和缩略图像处理模块220。预览图像处理模块210可以对接收到的预览图像数据进行处理,然后发送至显示单元300的预览界面中进行输出显示。缩略图像处理模块220可以对接收到的预览图像数据进行处理,然后发送至显示单元300的缩略显示窗口中进行输出显示。
在一些实施方式中,预览图像处理模块210和缩略图像处理模块220可以是集成于同一个处理芯片中的不同模块,例如集成于同一ISP(Image Signal Processing,图像信号处理)芯片中。在另一些实施方式中,预览图像处理模块210和缩略图像处理模块220还可以是分别独立的两个处理芯片,本公开对此不作限制。
显示单元300指用于显示图像的器件,例如显示屏、取景器等。在本公开实施方式中,显示单元300不仅可以显示预览界面,同时还可以显示缩略显示窗口。例如图3中所示,显示单元300为手机显示屏,在显示屏中,不仅可以显示常规的预览界面310,同时还可以显示缩略显示窗口320。
本公开实施方式中,缩略显示窗口320用于显示具有一定场景细节信息的缩略显示图像,从而在暗光场景下,可以为用户拍照提供辅助,用户可以通过该缩略显示图像感知到当前拍摄效果,进而确定是否可以进行拍照。例如图3中所示,在预览界面310中用户几乎无法感知到任何有效细节信息,但是在缩略显示窗口320中,即可查看到当前场景大致的缩略信息,进而预期成像效果。
在上述移动终端的影像系统的基础上,下面对本公开实施方式的图像处理方法过程进行说明。
如图4所示,在一些实施方式中,本公开示例的图像处理方法,包括:
S410、获取预览图像数据。
本公开实施方式中,预览图像数据是指通过例如图2所示的图像传感器100采集得到的RAW图像数据,预览图像数据经过图像处理单元200处理之后,送入显示单元300进行输出显示,从而用户即可在显示单元300上看到 预览图像。
可以理解,预览图像数据经过图像处理单元200处理之后,是逐帧送入显示单元300的,从而显示单元300可以逐帧显示预览图像,在帧率达到一定频率时,人体肉眼即可观看到连贯的视频流预览界面。例如,目前大部分智能手机的预览界面为30FPS,用户观看到的预览界面即为连贯的预览图像显示。
因此,本公开实施方式中,预览图像数据可以包括一帧或者多帧预览图像的预览帧数据。例如,当预览图像数据包括多帧预览图像的预览帧数据时,图像处理单元200可以按照时序的先后,逐帧对预览帧数据进行处理,然后逐帧送入显示单元300进行显示。对于图像处理单元200的数据处理过程,本公开下文步骤中继续进行说明。
S420、对于每帧预览图像,根据预览帧数据对预览图像的图像参数进行调整,得到预设数量的中间帧图像。
结合图2所示,图像处理单元200在获取预览图像数据之后,预览图像处理模块210即可逐帧对每帧预览图像的预览帧数据进行处理,然后逐帧将处理后的成像数据发送至显示单元300,显示单元300即可在预览界面310上逐帧输出显示预览图像。本过程可参照相关技术中的预览界面原理实现,本公开对此不作赘述。
而本公开实施方式中,同时还通过缩略图像处理模块220,逐帧对每帧预览图像的预览帧数据进行处理,然后逐帧将处理后的缩略显示图像发送至显示单元300,显示单元300即可在缩略显示窗口320上逐帧输出显示缩略显示图像。下面以一帧预览图像为例,对显示缩略显示图像的过程进行说明。
以一帧预览图像为例,缩略图像处理模块220根据该帧预览图像的预览帧数据对预览图像的图像参数进行调整,从而得到多帧中间帧图像。图像参数是指可以改变图像原有成像效果的相关参数,例如,常用的图像参数可包括亮度参数、对比度参数、伽马值等,通过调整图像的这些参数,可以使得图像的亮度或对比度发生变化。
例如一些实施方式中,图像参数以亮度参数为例,可以分别调整预览图像的亮度参数为不同参数值,从而得到不同亮度的中间帧图像。
例如图5示例场景中,预览图像的实际效果如图5中(c)所示,在S420 中,缩略图像处理模块220可基于该帧预览图像的预览帧数据进行图像参数调整。在一些示例中,可以通过依次降低亮度参数的方式得到图5中(a)、图5中(b)所示的中间帧图像;在一些示例中,可以通过依次提高亮度参数的方式得到图5中(d)、图5中(e)以及图5中(f)所示的中间帧图像。也即,在本示例中,基于预览帧数据进行图像参数调整,共得到如图5所示的6张中间帧图像。
当然,本领域技术人员可以理解,本公开实施方式中对预览图像进行图像参数调整的方式并不局限于调整亮度参数,也可以采用其他任何适于实施的图像参数类型,例如对比度参数、伽马值等,本公开对此不作限制。另外,对于中间帧图像的数量也不局限于上述示例中的6张,还可以是其他任何适于实施的预设数量,本公开对此不再赘述。
S430、对预设数量的中间帧图像进行融合处理,得到缩略显示图像。
本公开实施方式中,在得到预设数量的中间帧图像之后,可以对这些中间帧图像进行融合处理,将多帧中间帧图像融合为一帧缩略显示图像。
在一些实施方式中,可以基于图像融合算法对每帧中间帧图像进行特征提取,然后根据提取特征进行融合处理,得到缩略显示图像。本领域技术人员参照相关技术中的图像融合算法,毫无疑问可以理解并充分实施,本公开对此不再赘述。
可以理解,例如图5所示,6张中间帧图像表示的是预览图像在不同亮度参数下的效果图,也即这些中间帧图像覆盖了当前场景在极暗光、暗光、亮光、高亮光下的图像细节,从而融合得到的缩略显示图像可以保留大量的明暗部细节信息。例如图6示出了对图5中的中间帧图像进行融合处理后得到的缩略显示图像,通过图6可以看到,相较于原本的预览图像(图5中(c)),缩略显示图像(图6)已经具有非常丰富的图像细节,用户可以明显感知到当前拍摄角度、范围等信息。
S440、将缩略显示图像输出显示在预览界面的缩略显示窗口中。
结合图3所示,在得到缩略显示图像之后,即可将缩略显示图像发送至显示单元300,然后显示单元300即可将缩略显示图像输出显示在缩略显示窗口320中。
值得特别说明的是,在本公开实施方式中,通过对预览图像进行图像参 数调整得到不同图像参数的中间帧图像,并融合得到缩略显示图像的过程中,对预览图像的图像参数进行调整是一种非常简单且高效的方式,其不同于延长曝光时间。延长曝光时间需要在采集预览图像之前对曝光时间进行调整,以控制镜头的进光量。而本公开实施方式,是在得到预览图像之后直接改变图像参数对图像亮度进行调整,无需改变曝光时间,因此预览界面依旧可以保持30FPS的流畅度。
通过图5和图6可以看到,这种方式可以快速呈现出图像中物体的轮廓范围,但是其缺点也很明显:拉高亮度会导致图像出现大量的噪点和色偏,且物体的具体细节特征会丢失。因此,这种方式呈现出的缩略显示图像的图像质量不高,作为大图展示效果较差。
因此,在本公开实施方式中,并非在预览界面310上直接呈现缩略显示图像,而是在预览界面310上额外设置一个局部窗口,也即缩略显示窗口320,将缩略显示图像显示在缩略显示窗口320上。
这样,虽然缩略显示图像的图像质量不高,但是,一方面其仅用于辅助用户拍照,只需要保证用户可以在暗光场景下看清物体轮廓,可以预期成像范围和角度即可,无需具有很高的图像质量。另一方面,通过缩略显示窗口显示较小尺寸的缩略显示图像,也可以隐藏部分缺陷,降低图像缺陷带给用户的直观感受,提高用户体验。
结合图3和图6所示,在暗光环境拍照时,用户虽然通过预览界面310无法得到有效的图像信息,但是通过缩略显示窗口320显示的缩略显示图像,可以明显感知物体的轮廓,知晓当前拍摄的角度和取景范围,进而可以大致预期成像效果,辅助拍照过程。
通过上述可知,本公开实施方式中,在暗光拍摄的场景中,通过生成并显示缩略显示图像,实现在不牺牲预览流畅性的基础上,在预览界面呈现具有场景细节信息的缩略显示图像,从而为用户在暗光场景下提供有效的拍照辅助,提高用户体验。
如图7所示,在一些实施方式中,本公开示例的图像处理方法,得到中间帧图像的过程,包括:
S710、根据预览帧数据,降低预览图像的图像参数的参数值,得到第一数量的中间帧图像。
S720、根据预览帧数据,提高预览图像的图像参数的参数值,得到第二数量的中间帧图像。
S730、根据第一数量的中间帧图像和第二数量的中间帧图像,得到预设数量的中间帧图像。
本公开实施方式中,以一帧预览图像为例,该帧预览图像对应的预设数量的中间帧图像,既包括图像参数小于当前参数的中间帧图像,同时也包括图像参数大于当前参数的中间帧图像。从而,融合得到的缩略显示图像不仅可以具有更好的亮部细节特征,也具有较好的暗部细节特征。
仍以图5所示为例,预览图像为图5中(c)所示,缩略图像处理模块220可基于该帧预览图像的预览帧数据,依次降低预览图像的亮度参数,从而得到图5中(a)和(b)所示的2张中间帧图像。同时,缩略图像处理模块220还可基于该帧预览图像的预览帧数据,依次提高预览图像的亮度参数,从而得到图5中(d)、(e)以及(f)所示的3张中间帧图像。从而,通过对预览图像的亮度参数进行调整,共得到图5所示的6张中间帧图像。
通过上述可知,本公开实施方式中,通过降低和提高图像参数的参数值,使得缩略显示图像不仅可以具有更好的亮部细节特征,也具有较好的暗部细节特征。
在一些实施方式中,考虑到用户在进行高清图像拍摄时,预览图像的分辨率很高,例如可以达到1920像素*1080像素大小,缩略图像处理模块220在进行亮度处理和图像融合时,所需要处理的数据很多。因此,为了减少计算量,可以在对预览帧数据进行图像参数调整之前,预先对预览图像进行下采样处理。
具体而言,例如一个示例中,通过图像传感器100得到的预览图像为1920像素*1080像素尺度,可以通过对预览图像进行下采样,将图像尺度缩放为640像素*480像素尺度,从而大大减少后续计算量,提高数据处理速度,并且由于缩略显示图像仅以较小尺度在缩略显示窗口320中显示,因此显示效果几乎不会存在明显下降。
另外,在一些实施方式中,不仅可以对预览图像预先进行下采样处理,还可以进行裁切、补全等多种图像预处理,本公开对此不作限制。
通过上述可知,本公开实施方式中,通过对预览图像进行下采样处理, 从而大大减少后续计算量,提高数据处理速度,保证缩略显示窗口的显示流畅性。
在一些实施方式中,考虑到在非暗光场景下,预览界面310显示的预览图像可以直接为用户提供拍照预览,因此无需额外通过缩略显示窗口320来显示缩略显示图像。因此,上述图像处理方法可以仅在暗光场景执行。
具体而言,在一些实施方式中,在执行上述图像处理方法之前,可以对移动终端当前拍照模式进行检测,当检测到移动终端当前处于夜景拍照模式时,执行上述图像处理方法过程,实现对用户拍照的辅助。
在一个示例中,如图3所示,移动终端的相机应用具有多种拍照模式,可以在用户选择“夜景”时,确定移动终端当前处于夜景拍照模式,执行上述过程。
在另一个示例中,可以通过移动终端的环境光传感器检测当前环境光强,当检测到当前环境光强度低于预设阈值时,确定移动终端当前处于夜景拍照模式,执行上述过程。
本领域技术人员可以理解,确定移动终端是否处于夜景拍照模式的过程并不局限于上述示例,本公开对此不再枚举。
通过上述可知,本公开实施方式中,在确定移动终端处于夜景拍照模式时,执行上述图像处理方法,提高用户拍照体验。
如图3所示,在一些实施方式中,缩略显示窗口320可以以分层的方式显示在预览界面310的上层,也可以以嵌入的方式显示在预览界面310中,只要保证用户能够在预览界面看到缩略显示窗口320即可。
在一些实施方式中,缩略显示窗口320的相关参数可以由用户自由设置,从而提高用户拍照体验,下面结合图8实施方式进行说明。
如图8所示,在一些实施方式中,本公开示例的图像处理方法,还包括:
S810、获取用户操作指令。
S820、响应于用户操作指令为预设操作指令,在预览界面上输出显示针对缩略显示窗口的设置选项。
S830、获取用户针对所述设置选项的设置指令参数,并根据所述设置指令参数调整所述缩略显示窗口的目标参数。
在一些实施方式中,用户操作指令可以是用户在移动终端的显示单元300 上的诸如触摸、滑动、单机、双击、长按等操作指令,本公开对此不作限制。
预设操作指令为预先设置的唤醒缩略窗口设置界面的操作指令,其可以为双击、长按、预设手势等,本公开对此不作限制。
当检测到用户操作指令为预设操作指令时,说明用户需要对缩略显示窗口进行设置,从而移动终端可以在预览界面上输出显示设置选项,设置选项用于对缩略显示窗口的各项参数进行设置。
例如,设置选项可以包括尺寸选项、位置选项、边框效果选项等,用户可通过输入或者手势操作对各个设置选项进行调整,从而移动终端可获取到相应的设置指令参数,并根据设置指令参数相应调整缩略显示窗口的目标参数。
例如一个示例中,设置指令参数为针对缩略显示窗口的尺寸选项进行调整的参数,从而移动终端可根据用户的设置指令参数调整缩略显示窗口在预览界面的显示大小。
例如另一个示例中,设置指令参数为针对缩略显示窗口的位置选项进行调整的参数,从而移动终端可根据用户的设置指令参数调整缩略显示窗口在预览界面的显示位置。图9中示出了对图3所示的缩略显示窗口320进行位置和尺寸调整之后的显示效果。
例如又一个示例中,设置指令参数为针对缩略显示窗口的边框效果选项进行调整的参数,从而移动终端可根据用户的设置指令参数调整缩略显示窗口在预览界面的边框效果。
通过上述可知,本公开实施方式中,基于用户操作指令可对缩略显示窗口目标参数进行调整,提高拍照体验。
第二方面,本公开实施方式提供了一种图像处理装置,该装置可应用于移动终端,本公开实施方式所述的移动终端,可以是任何适于具有摄像功能的设备类型,例如智能手机、平板电脑、可穿戴设备等,本公开对此不作限制。
如图10所示,在一些实施方式中,本公开示例的图像处理装置,包括:
数据获取模块10,被配置为获取预览图像数据,预览图像数据包括至少一帧预览图像的预览帧数据;
中间帧确定模块20,被配置为对于每帧预览图像,根据所述预览帧数 据对所述预览图像的图像参数进行调整,得到预设数量的中间帧图像;
融合处理模块30,被配置为对预设数量的中间帧图像进行融合处理,得到缩略显示图像;
显示模块40,被配置为将缩略显示图像输出显示在预览界面的缩略显示窗口中;预览界面为移动终端的拍照预览界面,缩略显示窗口为显示于预览界面预设位置的局部窗口。
通过上述可知,本公开实施方式中,在暗光拍摄的场景中,通过生成并显示缩略显示图像,实现在不牺牲预览流畅性的基础上,在预览界面呈现具有场景细节信息的缩略显示图像,从而为用户在暗光场景下提供有效的拍照辅助,提高用户体验。
在一些实施方式中,中间帧确定模块,被配置为:
根据所述预览帧数据,降低所述预览图像的图像参数的参数值,得到第一数量的中间帧图像;
根据所述预览帧数据,提高所述预览图像的图像参数的参数值,得到第二数量的中间帧图像;
根据所述第一数量的中间帧图像和所述第二数量的中间帧图像,得到所述预设数量的中间帧图像。
在一些实施方式中,所述图像参数包括以下至少之一:
亮度参数、对比度参数、伽马值。
如图11所示,在一些实施方式中,本公开实施方式的图像处理装置还包括下采样模块50,下采样模块50被配置为:
对于每帧预览图像,根据预览帧数据对预览图像进行分辨率下采样处理。
通过上述可知,本公开实施方式中,通过对预览图像进行下采样处理,从而大大减少后续计算量,提高数据处理速度,保证缩略显示窗口的显示流畅性。
如图11所示,在一些实施方式中,本公开实施方式的图像处理装置还包括模式确定模块60,模式确定模块60被配置为:
响应于移动终端当前处于夜景拍照模式,执行对于每帧预览图像,根据预览帧数据对预览图像的图像参数进行调整的步骤。
通过上述可知,本公开实施方式中,在确定移动终端处于夜景拍照模式时,执行上述图像处理方法,提高用户拍照体验。
如图11所示,在一些实施方式中,本公开实施方式的图像处理装置还包括调整模块70,调整模块70被配置为:
获取用户操作指令;
响应于所述用户操作指令为预设操作指令,在所述预览界面上输出显示针对所述缩略显示窗口的设置选项;
获取用户针对所述设置选项的设置指令参数,调整所述缩略显示窗口的目标参数。
在一些实施方式中,所述缩略显示窗口的目标参数包括以下至少之一:
所述缩略显示窗口在所述预设界面上的位置参数、所述缩略显示窗口的尺寸参数、所述缩略显示窗口的显示效果参数。
通过上述可知,本公开实施方式中,基于用户操作指令可对缩略显示窗口的目标参数进行调整,提高拍照体验。
第三方面,本公开实施方式提供了一种移动终端,包括:
处理器;以及
存储器,存储有能够被处理器读取的计算机指令,当计算机指令被读取时,处理器执行根据第一方面任意实施方式的方法。
第四方面,本公开实施方式提供了一种存储介质,用于存储计算机可读指令,计算机可读指令用于使计算机执行根据第一方面任意实施方式的方法。
图12中示出了本公开一些实施方式中的移动终端的结构框图,下面结合图12对本公开一些实施方式的移动终端及存储介质相关原理进行说明。
参照图12,移动终端1800可以包括以下一个或多个组件:处理组件1802,存储器1804,电源组件1806,多媒体组件1808,音频组件1810,输入/输出(I/O)接口1812,传感器组件1816,以及通信组件1818。
处理组件1802通常控制移动终端1800的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理组件1802可以包括一个或多个处理器1820来执行指令。此外,处理组件1802可以包括一个或多个模块,便于处理组件1802和其他组件之间的交互。例如,处理组件1802 可以包括多媒体模块,以方便多媒体组件1808和处理组件1802之间的交互。又如,处理组件1802可以从存储器读取可执行指令,以实现移动终端相关功能。
存储器1804被配置为存储各种类型的数据以支持在移动终端1800的操作。这些数据的示例包括用于在移动终端1800上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器1804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
电源组件1806为移动终端1800的各种组件提供电力。电源组件1806可以包括电源管理系统,一个或多个电源,及其他与为移动终端1800生成、管理和分配电力相关联的组件。
多媒体组件1808包括在所述移动终端1800和用户之间的提供一个输出接口的显示屏。在一些实施例中,多媒体组件1808包括一个前置摄像头和/或后置摄像头。当移动终端1800处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件1810被配置为输出和/或输入音频信号。例如,音频组件1810包括一个麦克风(MIC),当移动终端1800处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器1804或经由通信组件1818发送。在一些实施例中,音频组件1810包括一个扬声器,用于输出音频信号。
I/O接口1812为处理组件1802和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件1816包括一个或多个传感器,用于为移动终端1800提供各个方面的状态评估。例如,传感器组件1816可以检测到移动终端1800的打开/关闭状态,组件的相对定位,例如所述组件为移动终端1800的显示器和小键盘,传感器组件1816可以检测移动终端1800或移动终端1800一个组件的 位置改变,用户与移动终端1800接触的存在或不存在,移动终端1800方位或加速/减速和移动终端1800的温度变化。传感器组件1816可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件1816可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件1816可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器。
通信组件1818被配置为便于移动终端1800和其他设备之间有线或无线方式的通信。移动终端1800可以接入基于通信标准的无线网络,如Wi-Fi,2G,3G,4G,5G或6G,或它们的组合。在一个示例性实施例中,通信组件1818经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信组件1818包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。
在示例性实施例中,移动终端1800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现。
显然,上述实施方式仅仅是为清楚地说明所作的举例,而并非对实施方式的限定。对于所属领域的普通技术人员来说,在上述说明的基础上还可以做出其它不同形式的变化或变动。这里无需也无法对所有的实施方式予以穷举。而由此所引伸出的显而易见的变化或变动仍处于本公开创造的保护范围之中。

Claims (10)

  1. 一种图像处理方法,其特征在于,应用于移动终端,所述方法包括:
    获取预览图像数据,所述预览图像数据包括至少一帧预览图像的预览帧数据;
    对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整,得到预设数量的中间帧图像;
    对所述预设数量的中间帧图像进行融合处理,得到缩略显示图像;
    将所述缩略显示图像输出显示在预览界面的缩略显示窗口中;所述预览界面为所述移动终端的拍照预览界面,所述缩略显示窗口为显示于所述预览界面预设位置的局部窗口。
  2. 根据权利要求1所述的方法,其特征在于,所述根据所述预览帧数据对所述预览图像的图像参数进行调整,得到预设数量的中间帧图像,包括:
    根据所述预览帧数据,降低所述预览图像的图像参数的参数值,得到第一数量的中间帧图像;
    根据所述预览帧数据,提高所述预览图像的图像参数的参数值,得到第二数量的中间帧图像;
    根据所述第一数量的中间帧图像和所述第二数量的中间帧图像,得到所述预设数量的中间帧图像。
  3. 根据权利要求1所述的方法,其特征在于,所述图像参数包括以下至少之一:
    亮度参数、对比度参数、伽马值。
  4. 根据权利要求1至3任一项所述的方法,其特征在于,在所述对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整之前,所述方法还包括:
    对于每帧预览图像,根据所述预览帧数据对所述预览图像进行分辨率下采样处理。
  5. 根据权利要求1至3任一项所述的方法,其特征在于,在所述对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整之前,所述方法还包括:
    响应于所述移动终端当前处于夜景拍照模式,执行所述对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整的步骤。
  6. 根据权利要求1至3任一项所述的方法,其特征在于,还包括:
    获取用户操作指令;
    响应于所述用户操作指令为预设操作指令,在所述预览界面上输出显示针对所述缩略显示窗口的设置选项;
    获取用户针对所述设置选项的设置指令参数,并根据所述设置指令参数调整所述缩略显示窗口的目标参数。
  7. 根据权利要求6所述的方法,其特征在于,所述缩略显示窗口的目标参数包括以下至少之一:
    所述缩略显示窗口在所述预设界面上的位置参数、所述缩略显示窗口的尺寸参数、所述缩略显示窗口的显示效果参数。
  8. 一种图像处理装置,其特征在于,应用于移动终端,所述装置包括:
    数据获取模块,被配置为获取预览图像数据,所述预览图像数据包括至少一帧预览图像的预览帧数据;
    中间帧确定模块,被配置为对于每帧预览图像,根据所述预览帧数据对所述预览图像的图像参数进行调整,得到预设数量的中间帧图像;
    融合处理模块,被配置为对所述预设数量的中间帧图像进行融合处理,得到缩略显示图像;
    显示模块,被配置为将所述缩略显示图像输出显示在预览界面的缩略显示窗口中;所述预览界面为所述移动终端的拍照预览界面,所述缩略显示窗口为显示于所述预览界面预设位置的局部窗口。
  9. 一种移动终端,其特征在于,包括:
    处理器;以及
    存储器,存储有能够被所述处理器读取的计算机指令,当所述计算机指令被读取时,所述处理器执行根据权利要求1至7任一项所述的方法。
  10. 一种存储介质,其特征在于,用于存储计算机可读指令,所述计算机可读指令用于使计算机执行根据权利要求1至7任一项所述的方法。
PCT/CN2022/093485 2022-05-18 2022-05-18 图像处理方法、装置、移动终端及存储介质 WO2023220957A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2022/093485 WO2023220957A1 (zh) 2022-05-18 2022-05-18 图像处理方法、装置、移动终端及存储介质
CN202280004220.4A CN117441341A (zh) 2022-05-18 2022-05-18 图像处理方法、装置、移动终端及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/093485 WO2023220957A1 (zh) 2022-05-18 2022-05-18 图像处理方法、装置、移动终端及存储介质

Publications (1)

Publication Number Publication Date
WO2023220957A1 true WO2023220957A1 (zh) 2023-11-23

Family

ID=88834146

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/093485 WO2023220957A1 (zh) 2022-05-18 2022-05-18 图像处理方法、装置、移动终端及存储介质

Country Status (2)

Country Link
CN (1) CN117441341A (zh)
WO (1) WO2023220957A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117750190A (zh) * 2024-02-20 2024-03-22 荣耀终端有限公司 一种图像处理方法及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108307109A (zh) * 2018-01-16 2018-07-20 维沃移动通信有限公司 一种高动态范围图像预览方法及终端设备
CN110908558A (zh) * 2019-10-30 2020-03-24 维沃移动通信(杭州)有限公司 一种图像显示方法及电子设备
CN111372001A (zh) * 2020-03-17 2020-07-03 捷开通讯(深圳)有限公司 图像融合方法、装置、存储介质及移动终端
CN111432121A (zh) * 2020-03-30 2020-07-17 Oppo广东移动通信有限公司 生成方法、电子装置和存储介质
US20210250510A1 (en) * 2020-02-11 2021-08-12 Samsung Electronics Co., Ltd. Click-and-lock zoom camera user interface
CN113556461A (zh) * 2020-09-29 2021-10-26 华为技术有限公司 一种图像处理方法及相关装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108307109A (zh) * 2018-01-16 2018-07-20 维沃移动通信有限公司 一种高动态范围图像预览方法及终端设备
CN110908558A (zh) * 2019-10-30 2020-03-24 维沃移动通信(杭州)有限公司 一种图像显示方法及电子设备
US20210250510A1 (en) * 2020-02-11 2021-08-12 Samsung Electronics Co., Ltd. Click-and-lock zoom camera user interface
CN111372001A (zh) * 2020-03-17 2020-07-03 捷开通讯(深圳)有限公司 图像融合方法、装置、存储介质及移动终端
CN111432121A (zh) * 2020-03-30 2020-07-17 Oppo广东移动通信有限公司 生成方法、电子装置和存储介质
CN113556461A (zh) * 2020-09-29 2021-10-26 华为技术有限公司 一种图像处理方法及相关装置

Also Published As

Publication number Publication date
CN117441341A (zh) 2024-01-23

Similar Documents

Publication Publication Date Title
KR101772177B1 (ko) 사진을 획득하기 위한 방법 및 장치
CN108419016B (zh) 拍摄方法、装置及终端
US9661223B2 (en) Method and device for photographing including camera shake
WO2016138752A1 (zh) 拍摄参数调整方法和装置
US20100302393A1 (en) Self-portrait assistance in image capturing devices
CN106131441B (zh) 拍照方法及装置、电子设备
WO2019037781A1 (zh) 终端及其防抖拍照方法、存储装置
US20230188826A1 (en) Photographing Method, Graphical User Interface, and Electronic Device
WO2022089284A1 (zh) 拍摄处理方法、装置、电子设备和可读存储介质
US10127455B2 (en) Apparatus and method of providing thumbnail image of moving picture
US9177395B2 (en) Display device and display method for providing image display in first color mode and second color mode
WO2018053722A1 (zh) 全景照片拍摄方法及装置
WO2023220957A1 (zh) 图像处理方法、装置、移动终端及存储介质
CN111461950B (zh) 图像处理方法及装置
KR102512787B1 (ko) 촬영 프리뷰 이미지를 표시하는 방법, 장치 및 매체
CN111835977B (zh) 图像传感器、图像生成方法及装置、电子设备、存储介质
CN112188095B (zh) 拍照方法、拍照装置及存储介质
WO2023236209A1 (zh) 图像处理方法、装置、电子设备和存储介质
WO2023231009A1 (zh) 一种对焦方法、装置及存储介质
WO2023240624A1 (zh) 亮度调整方法及装置、存储介质
WO2023160220A1 (zh) 一种图像处理方法和电子设备
CN111225158B (zh) 图像生成方法及装置、电子设备、计算机可读存储介质
JP7321187B2 (ja) 画像処理方法及び装置、カメラアセンブリ、電子機器、記憶媒体
JP7150053B2 (ja) 撮像装置、撮像方法、及びプログラム
EP4304188A1 (en) Photographing method and apparatus, medium and chip

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 202280004220.4

Country of ref document: CN