CN117441341A - Image processing method, device, mobile terminal and storage medium - Google Patents
Image processing method, device, mobile terminal and storage medium Download PDFInfo
- Publication number
- CN117441341A CN117441341A CN202280004220.4A CN202280004220A CN117441341A CN 117441341 A CN117441341 A CN 117441341A CN 202280004220 A CN202280004220 A CN 202280004220A CN 117441341 A CN117441341 A CN 117441341A
- Authority
- CN
- China
- Prior art keywords
- preview
- image
- thumbnail display
- frame
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 60
- 238000007499 fusion processing Methods 0.000 claims abstract description 14
- 238000000034 method Methods 0.000 claims description 37
- 230000000694 effects Effects 0.000 claims description 23
- 230000008569 process Effects 0.000 description 17
- 238000003384 imaging method Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 10
- 235000019557 luminance Nutrition 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 230000004927 fusion Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003631 expected effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- Studio Devices (AREA)
Abstract
The disclosure relates to the technical field of electronic equipment, and particularly provides an image processing method, an image processing device, a mobile terminal and a storage medium. An image processing method, comprising: acquiring preview image data, wherein the preview image data comprises preview frame data of at least one frame of preview image; for each frame of preview image, adjusting image parameters of the preview image according to the preview frame data; carrying out fusion processing on the preset number of intermediate frame images to obtain thumbnail display images; outputting and displaying the thumbnail display image in a thumbnail display window of a preview interface; the preview interface is a photographing preview interface of the mobile terminal, and the thumbnail display window is a local window displayed at a preset position of the preview interface. According to the embodiment of the disclosure, photographing assistance is provided for a user through the thumbnail display, and photographing experience is improved.
Description
The disclosure relates to the technical field of electronic equipment, and in particular relates to an image processing method, an image processing device, a mobile terminal and a storage medium.
With the development of electronic devices, an imaging system has become the most important component of a mobile terminal. Taking a smart phone as an example, aiming at extremely dim light scenes such as night, an imaging system of the smart phone is often provided with a night scene mode so as to ensure imaging quality.
However, in an extremely dim light scene, the preview interface of the smart phone can hardly present effective detailed information, and the user can not know the imaging effect in advance, but can only know the imaging effect through the finally processed image after pressing the shutter, so that the experience is poor.
Disclosure of Invention
In order to improve photographing effects of a mobile terminal, embodiments of the present disclosure provide an image processing method, an image processing device, a mobile terminal, and a storage medium.
In a first aspect, an embodiment of the present disclosure provides an image processing method, which is applied to a mobile terminal, and includes:
acquiring preview image data, wherein the preview image data comprises preview frame data of at least one frame of preview image;
for each frame of preview image, adjusting image parameters of the preview image according to the preview frame data to obtain a preset number of intermediate frame images;
carrying out fusion processing on the preset number of intermediate frame images to obtain thumbnail display images;
Outputting and displaying the thumbnail display image in a thumbnail display window of a preview interface; the preview interface is a photographing preview interface of the mobile terminal, and the thumbnail display window is a local window displayed at a preset position of the preview interface.
In some embodiments, the adjusting the image parameters of the preview image according to the preview frame data to obtain a preset number of intermediate frame images includes:
reducing parameter values of image parameters of the preview image according to the preview frame data to obtain a first number of intermediate frame images;
according to the preview frame data, improving the parameter values of the image parameters of the preview image to obtain a second number of intermediate frame images;
and obtaining the preset number of intermediate frame images according to the first number of intermediate frame images and the second number of intermediate frame images.
In some embodiments, the image parameters include at least one of:
brightness parameter, contrast parameter, gamma value.
In some embodiments, before said adjusting the image parameters of the preview image according to the preview frame data for each frame of the preview image, the method further comprises:
And for each frame of preview image, performing resolution downsampling processing on the preview image according to the preview frame data.
In some embodiments of the present invention, in some embodiments,
before said adjusting the image parameters of the preview image according to the preview frame data for each frame of preview image, the method further comprises:
and responding to the mobile terminal currently in a night scene shooting mode, executing the step of adjusting the image parameters of the preview image according to the preview frame data for each frame of preview image.
In some embodiments, the methods described in the present disclosure further comprise:
acquiring a user operation instruction;
responding to the user operation instruction as a preset operation instruction, and outputting and displaying setting options aiming at the thumbnail display window on the preview interface;
and acquiring setting instruction parameters of a user aiming at the setting options, and adjusting target parameters of the thumbnail display window.
In some embodiments, the target parameters of the thumbnail display window include at least one of:
the position parameter of the thumbnail display window on the preset interface, the size parameter of the thumbnail display window and the display effect parameter of the thumbnail display window.
In a second aspect, an embodiment of the present disclosure provides an image processing apparatus applied to a mobile terminal, the apparatus including:
a data acquisition module configured to acquire preview image data including preview frame data of at least one frame of a preview image;
the intermediate frame determining module is configured to adjust image parameters of the preview images according to the preview frame data for each frame of preview images to obtain a preset number of intermediate frame images;
the fusion processing module is configured to perform fusion processing on the preset number of intermediate frame images to obtain thumbnail display images;
a display module configured to display the thumbnail display image output in a thumbnail display window of a preview interface; the preview interface is a photographing preview interface of the mobile terminal, and the thumbnail display window is a local window displayed at a preset position of the preview interface.
In some embodiments, the intermediate frame determination module is configured to:
reducing parameter values of image parameters of the preview image according to the preview frame data to obtain a first number of intermediate frame images;
according to the preview frame data, improving the parameter values of the image parameters of the preview image to obtain a second number of intermediate frame images;
And obtaining the preset number of intermediate frame images according to the first number of intermediate frame images and the second number of intermediate frame images.
In some embodiments, the image parameters include at least one of:
brightness parameter, contrast parameter, gamma value.
In some embodiments, the apparatus further comprises a downsampling module configured to:
and for each frame of preview image, performing resolution downsampling processing on the preview image according to the preview frame data.
In some embodiments, the apparatus further comprises a mode determination module configured to:
and responding to the mobile terminal currently in a night scene shooting mode, executing the step of adjusting the image parameters of the preview image according to the preview frame data for each frame of preview image.
In some embodiments, the apparatus further comprises an adjustment module configured to:
acquiring a user operation instruction;
responding to the user operation instruction as a preset operation instruction, and outputting and displaying setting options aiming at the thumbnail display window on the preview interface;
And acquiring setting instruction parameters of a user aiming at the setting options, and adjusting target parameters of the thumbnail display window.
In some embodiments, the target parameters of the thumbnail display window include at least one of:
the position parameter of the thumbnail display window on the preset interface, the size parameter of the thumbnail display window and the display effect parameter of the thumbnail display window.
In a third aspect, an embodiment of the present disclosure provides a mobile terminal, including:
a processor; and
a memory storing computer instructions readable by the processor, which when read, performs the method according to any implementation of the first aspect.
In a fourth aspect, the disclosed embodiments provide a storage medium storing computer readable instructions for causing a computer to perform the method according to any of the embodiments of the first aspect.
The image processing method of the embodiment of the disclosure comprises the steps of obtaining preview image data, adjusting image parameters of preview images according to the preview frame data to obtain a preset number of intermediate frame images for each frame of preview image, carrying out fusion processing on the preset number of intermediate frame images to obtain a thumbnail display image, and outputting and displaying the thumbnail display image in a thumbnail display window of a preview interface. In the embodiment of the disclosure, by generating and displaying the thumbnail display image, the thumbnail display image with scene detail information is presented on the preview interface on the basis of not sacrificing the smoothness of the preview, so that effective photographing assistance is provided for a user in a dim light scene, and the user experience is improved.
In order to more clearly illustrate the embodiments of the present disclosure or the prior art, the drawings that are required in the detailed description or the prior art will be briefly described, it will be apparent that the drawings in the following description are some embodiments of the present disclosure, and other drawings may be obtained according to the drawings without inventive effort for a person of ordinary skill in the art.
Fig. 1 is a schematic diagram of a preview interface of a mobile terminal in a dim light scene in the related art.
Fig. 2 is a block diagram of a mobile terminal according to some embodiments of the present disclosure.
Fig. 3 is a schematic diagram of a preview interface of a mobile terminal in accordance with some embodiments of the present disclosure.
Fig. 4 is a flow chart of an image processing method according to some embodiments of the present disclosure.
Fig. 5 is a schematic diagram of an image processing method according to some embodiments of the present disclosure.
Fig. 6 is a schematic diagram of an image processing method according to some embodiments of the present disclosure.
Fig. 7 is a flow chart of an image processing method according to some embodiments of the present disclosure.
Fig. 8 is a flow chart of an image processing method according to some embodiments of the present disclosure.
Fig. 9 is a schematic diagram of a preview interface of a mobile terminal in accordance with some embodiments of the present disclosure.
Fig. 10 is a block diagram of an image processing apparatus according to some embodiments of the present disclosure.
Fig. 11 is a block diagram of an image processing apparatus according to some embodiments of the present disclosure.
Fig. 12 is a block diagram of a mobile terminal according to some embodiments of the present disclosure.
The following description of the embodiments of the present disclosure will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the described embodiments are some, but not all, of the embodiments of the present disclosure. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure. In addition, technical features related to different embodiments of the present disclosure described below may be combined with each other as long as they do not make a conflict with each other.
Photographing in a dim light scene is one of the key research directions of various large consumer electronic equipment manufacturers on an image system, for example, at present, all large-brand smart phones have night scene photographing modes, and a good imaging effect can be achieved in the dim light scene at night and the like.
In the related art, a night scene mode mainly adopts a mode of surrounding exposure, after a user presses a shutter, a plurality of images with different exposure time periods are collected in a mode of extending the exposure time, and then the images are fused into one image by utilizing a software fusion algorithm to be output and displayed, so that a high-quality image with rich details is obtained.
In an actual photographing scene, the inventor discovers that for a part of the extremely dim light scene, although the image system can finally present a night scene image with better detail. However, in the preview interface before photographing, the preview interface can hardly present effective detail information of any current scene due to the severe light environment, so that the user can not expect the imaging effect, and the imaging effect can be perceived only after the shutter is pressed to obtain the final image.
For example, in the extremely dim light scene shown in fig. 1, the current scene seen by the human naked eye is close to that shown in fig. 1 (a), that is, a small amount of scene details can be seen by the human naked eye. However, in the related art, the preview effect presented by the preview interface of the mobile terminal is as shown in fig. 1 (b), and it can be seen that there is hardly any effective detail information in the preview interface. Therefore, when a user photographs in an extremely dark environment, the current imaging expected effect can hardly be perceived through the preview interface.
The inventor finds out through research that the reason is that for the preview interface of the mobile terminal, the smoothness of the frame rate needs to be maintained, so that the experience of blocking and unsmooth of the preview interface is avoided. The display frame rate of the preview interface of the mobile terminal is generally 30FPS, which limits the exposure time of each frame of preview image not to exceed 33ms, and in extremely dim light scenes, such a short exposure time results in that the image can hardly display detailed information. If the exposure time of the preview image is prolonged, for example, the exposure time of the preview image is increased to 100ms, the frame rate of the preview interface is reduced to 10FPS, and the preview interface presents a jam and a disfluency which can be obviously perceived by the user, so that the user experience is reduced.
Therefore, in the related art, in a photographing scene in a dark environment, the preview interface of the mobile terminal can hardly provide effective detailed information to assist the user in photographing, so that the photographing experience of the user at night is poor.
Based on the defects in the related art, the embodiment of the disclosure provides an image processing method, an image processing device, an electronic device and a storage medium, which realize that a thumbnail display image with scene detail information is presented on a preview interface on the basis of not sacrificing preview smoothness, thereby providing effective photographing assistance for a user in a dim light scene and improving user experience.
In a first aspect, embodiments of the present disclosure provide an image processing method, which is applicable to a mobile terminal. The mobile terminal according to the embodiments of the present disclosure may be any device type suitable for having a camera function, such as a smart phone, a tablet computer, a wearable device, etc., which is not limited in this disclosure.
Fig. 2 is a block diagram illustrating a structure of an image system of a mobile terminal according to an embodiment of the present disclosure, and a display principle of a preview interface will be described with reference to fig. 2.
As shown in fig. 2, the image system of the mobile terminal includes an image sensor 100, an image processing unit 200, and a display unit 300.
The image sensor 100 refers to a photosensitive device of an imaging system, such as a camera module. The image sensor 100 is for receiving external light so as to output corresponding RAW image data (RAW data), that is, preview image data according to the received light.
In the embodiment of the present disclosure, the image sensor 100 may be any sensor type suitable for implementation, such as a CMOS (Complementary Metal Oxide Semiconductor ) sensor, a CCD (Charge-coupled Device) sensor, etc., which is not limited by the present disclosure.
The image processing unit 200 refers to a device that receives preview image data of the image sensor 100 and performs data processing on the preview image data.
As shown in fig. 2, in the example of the present disclosure, the image processing unit 200 includes a preview image processing module 210 and a thumbnail image processing module 220. The preview image processing module 210 may process the received preview image data and then send the processed preview image data to the preview interface of the display unit 300 for output display. The thumbnail image processing module 220 may process the received preview image data and then transmit to the thumbnail display window of the display unit 300 for output display.
In some embodiments, the preview image processing module 210 and the thumbnail image processing module 220 may be different modules integrated in the same processing chip, for example, integrated in the same ISP (Image Signal Processing ) chip. In other embodiments, the preview image processing module 210 and the thumbnail image processing module 220 may also be two processing chips that are independent, respectively, which the present disclosure is not limited to.
The display unit 300 refers to a device for displaying an image, such as a display screen, a viewfinder, or the like. In the embodiment of the present disclosure, the display unit 300 may display not only the preview interface but also a thumbnail display window. For example, as shown in fig. 3, the display unit 300 is a mobile phone display screen in which not only a conventional preview interface 310 but also a thumbnail display window 320 can be displayed.
In the embodiment of the present disclosure, the thumbnail display window 320 is configured to display a thumbnail display image with a certain scene detail information, so that in a dim light scene, assistance can be provided for a user to take a photograph, and the user can perceive the current shooting effect through the thumbnail display image, so as to determine whether the user can take the photograph. For example, as shown in fig. 3, the user can hardly perceive any effective detail information in the preview interface 310, but can see the rough thumbnail information of the current scene in the thumbnail display window 320, thereby expecting the imaging effect.
On the basis of the image system of the mobile terminal, the procedure of the image processing method according to the embodiment of the present disclosure is described below.
As shown in fig. 4, in some embodiments, an image processing method of an example of the present disclosure includes:
s410, acquiring preview image data.
In the embodiment of the present disclosure, the preview image data refers to RAW image data acquired by the image sensor 100 shown in fig. 2, for example, and after the preview image data is processed by the image processing unit 200, the preview image data is sent to the display unit 300 to be output and displayed, so that a user can see the preview image on the display unit 300.
It will be appreciated that the preview image data is processed by the image processing unit 200 and then sent to the display unit 300 frame by frame, so that the display unit 300 can display the preview image frame by frame, and when the frame rate reaches a certain frequency, the human naked eyes can view the continuous video stream preview interface. For example, currently, most smart phones have a preview interface of 30FPS, and the preview interface viewed by the user is a coherent preview image display.
Thus, in the disclosed embodiments, the preview image data may include preview frame data of one or more frames of preview images. For example, when the preview image data includes preview frame data of a plurality of frames of preview images, the image processing unit 200 may process the preview frame data frame by frame in chronological order and then send the processed preview frame data frame by frame to the display unit 300 for display. For the data processing procedure of the image processing unit 200, the following steps of the present disclosure will be continued.
And S420, for each frame of preview image, adjusting image parameters of the preview image according to preview frame data to obtain a preset number of intermediate frame images.
Referring to fig. 2, after the image processing unit 200 acquires the preview image data, the preview image processing module 210 may process the preview frame data of each frame of the preview image frame by frame, and then send the processed imaging data to the display unit 300 frame by frame, and the display unit 300 may output and display the preview image frame by frame on the preview interface 310. The present process may be implemented with reference to the preview interface principle in the related art, which will not be described in detail in this disclosure.
In the embodiment of the disclosure, the thumbnail image processing module 220 processes the preview frame data of each frame of the preview image frame by frame, and then sends the processed thumbnail display image frame by frame to the display unit 300, so that the display unit 300 can output and display the thumbnail display image frame by frame on the thumbnail display window 320. A process of displaying a thumbnail display image will be described below by taking a one-frame preview image as an example.
Taking a frame of preview image as an example, the thumbnail image processing module 220 adjusts the image parameters of the preview image according to the preview frame data of the frame of preview image, so as to obtain a multi-frame intermediate frame image. The image parameters refer to related parameters that can change the original imaging effect of the image, for example, common image parameters may include brightness parameters, contrast parameters, gamma values, and the like, and by adjusting these parameters of the image, the brightness or contrast of the image can be changed.
For example, in some embodiments, the image parameters are taken as luminance parameters, and the luminance parameters of the preview image may be adjusted to different parameter values, so as to obtain intermediate frame images with different luminances.
For example, in the example scenario of fig. 5, the actual effect of the preview image is as shown in fig. 5 (c), and in S420, the thumbnail image processing module 220 may perform image parameter adjustment based on the preview frame data of the frame preview image. In some examples, the intermediate frame images shown in (a) in fig. 5 and (b) in fig. 5 may be obtained by sequentially reducing the luminance parameter; in some examples, the intermediate frame images shown in fig. 5 (d), 5 (e), and 5 (f) may be obtained by sequentially increasing the luminance parameter. That is, in this example, image parameter adjustment is performed based on preview frame data, and 6 intermediate frame images as shown in fig. 5 are obtained in total.
Of course, it will be understood by those skilled in the art that the manner of adjusting the image parameters of the preview image in the embodiments of the present disclosure is not limited to adjusting the brightness parameter, and any other suitable type of image parameters, such as contrast parameters, gamma values, etc., may be used, which is not limited in this disclosure. In addition, the number of intermediate frame images is not limited to 6 in the above example, but may be any other preset number suitable for implementation, which is not described in detail in this disclosure.
S430, fusion processing is carried out on the intermediate frame images with the preset quantity, and the thumbnail display images are obtained.
In the embodiment of the disclosure, after a preset number of intermediate frame images are obtained, fusion processing may be performed on the intermediate frame images, and multiple frames of intermediate frame images are fused into one frame of thumbnail display image.
In some embodiments, feature extraction may be performed on each frame of intermediate frame image based on an image fusion algorithm, and then fusion processing may be performed according to the extracted features, so as to obtain a thumbnail display image. Those skilled in the art will certainly understand and fully implement the image fusion algorithm in the related art, and this disclosure will not be repeated here.
It will be appreciated that, for example, as shown in fig. 5, 6 intermediate frame images represent effect diagrams of the preview image under different brightness parameters, that is, these intermediate frame images cover image details of the current scene under extremely dark light, bright light and high bright light, so that a great deal of bright and dark detail information can be reserved in the thumbnail display image obtained by fusion. For example, fig. 6 shows a thumbnail display image obtained by performing fusion processing on the intermediate frame image in fig. 5, and as can be seen from fig. 6, the thumbnail display image (fig. 6) has a very rich image detail compared with the original preview image (fig. 5 (c)), so that the user can obviously perceive the current shooting angle, range and other information.
S440, outputting and displaying the thumbnail display image in a thumbnail display window of the preview interface.
As shown in fig. 3, after the thumbnail display image is obtained, the thumbnail display image may be transmitted to the display unit 300, and then the display unit 300 may output and display the thumbnail display image in the thumbnail display window 320.
It should be noted that, in the embodiment of the present disclosure, in the process of obtaining the intermediate frame image with different image parameters by performing image parameter adjustment on the preview image and fusing to obtain the thumbnail display image, the image parameter adjustment on the preview image is a very simple and efficient manner, which is different from extending the exposure time. Extending the exposure time requires adjusting the exposure time to control the amount of light entering the lens before capturing the preview image. In the embodiment of the disclosure, the image parameters are directly changed to adjust the brightness of the image after obtaining the preview image, and the exposure time is not required to be changed, so that the smoothness of the preview interface can still be kept at 30 FPS.
As can be seen from fig. 5 and 6, this way the extent of the outline of the object in the image can be quickly presented, but the disadvantages are also apparent: pulling high brightness can cause the image to appear as a large amount of noise and color cast, and the specific detail features of the object can be lost. Therefore, the thumbnail display image presented in this way is not high in image quality and poor in display effect as a large image.
Thus, in the embodiment of the present disclosure, instead of directly presenting the thumbnail display image on the preview interface 310, a partial window, that is, the thumbnail display window 320 is additionally provided on the preview interface 310, and the thumbnail display image is displayed on the thumbnail display window 320.
In this way, although the image quality of the thumbnail display image is not high, on the one hand, the thumbnail display image is only used for assisting a user to take a picture, only the user needs to be ensured to see the outline of the object clearly in a dim light scene, the imaging range and angle can be expected, and the high image quality is not required. On the other hand, the thumbnail display window is used for displaying the thumbnail display image with smaller size, so that part of defects can be hidden, visual feeling of the image defects to a user is reduced, and user experience is improved.
Referring to fig. 3 and 6, when photographing in a dark environment, a user cannot obtain effective image information through the preview interface 310, but the user can obviously perceive the outline of the object through the thumbnail display image displayed by the thumbnail display window 320, know the angle and the view finding range of the current photographing, and further can approximately expect the imaging effect to assist the photographing process.
As can be seen from the foregoing, in the embodiment of the present disclosure, in a scene photographed by a dim light, by generating and displaying a thumbnail display image, a thumbnail display image with scene detail information is presented on a preview interface without sacrificing the smoothness of the preview, so that an effective photographing assistance is provided for a user in the dim light scene, and user experience is improved.
As shown in fig. 7, in some embodiments, the image processing method of the present disclosure includes a process of obtaining an intermediate frame image, including:
and S710, reducing parameter values of image parameters of the preview images according to the preview frame data to obtain a first number of intermediate frame images.
And S720, according to the preview frame data, improving the parameter values of the image parameters of the preview image to obtain a second number of intermediate frame images.
And S730, obtaining the preset number of intermediate frame images according to the first number of intermediate frame images and the second number of intermediate frame images.
In the embodiment of the disclosure, taking a frame of preview image as an example, the preset number of intermediate frame images corresponding to the frame of preview image includes not only intermediate frame images with image parameters smaller than the current parameters, but also intermediate frame images with image parameters larger than the current parameters. Therefore, the fused thumbnail display image not only has better bright part detail characteristics, but also has better dark part detail characteristics.
Still referring to fig. 5, the preview image is shown in fig. 5 (c), and the thumbnail image processing module 220 may sequentially decrease the luminance parameters of the preview image based on the preview frame data of the frame preview image, so as to obtain 2 intermediate frame images shown in fig. 5 (a) and (b). Meanwhile, the thumbnail image processing module 220 may further sequentially increase the brightness parameters of the preview image based on the preview frame data of the frame preview image, thereby obtaining 3 intermediate frame images shown in (d), (e) and (f) of fig. 5. Thus, by adjusting the luminance parameter of the preview image, 6 intermediate frame images shown in fig. 5 are obtained in total.
As can be seen from the above, in the embodiments of the present disclosure, by reducing and increasing the parameter values of the image parameters, the thumbnail display image not only has better bright portion detail features, but also has better dark portion detail features.
In some embodiments, the thumbnail image processing module 220 processes a lot of data when performing brightness processing and image fusion, considering that the resolution of the preview image is high, for example, 1920 pixels×1080 pixels can be reached when the user performs high-definition image capturing. Therefore, in order to reduce the amount of calculation, the preview image may be subjected to downsampling processing in advance before the image parameter adjustment is performed on the preview frame data.
Specifically, for example, in one example, the preview image obtained by the image sensor 100 is 1920 pixels×1080 pixels, the image scale can be scaled to 640 pixels×480 pixels by downsampling the preview image, so that the subsequent calculation amount is greatly reduced, the data processing speed is improved, and since the thumbnail display image is displayed in the thumbnail display window 320 only in a smaller scale, there is little significant drop in the display effect.
In addition, in some embodiments, not only the downsampling process may be performed in advance on the preview image, but also various image preprocessing such as cropping, complementing, and the like may be performed, which is not limited by the present disclosure.
As can be seen from the above, in the embodiment of the present disclosure, the downsampling process is performed on the preview image, so that the subsequent calculation amount is greatly reduced, the data processing speed is improved, and the display smoothness of the thumbnail display window is ensured.
In some embodiments, it is contemplated that the preview image displayed by the preview interface 310 may provide a photographing preview directly to the user in a non-dim light scene, and thus the thumbnail display image need not be displayed additionally through the thumbnail display window 320. Therefore, the above-described image processing method can be performed only in a dark scene.
Specifically, in some embodiments, before the image processing method is executed, the current photographing mode of the mobile terminal may be detected, and when the mobile terminal is detected to be in the night scene photographing mode, the image processing method is executed, so as to realize the assistance of photographing for the user.
In one example, as shown in fig. 3, the camera application of the mobile terminal has a plurality of photographing modes, and when the user selects "night scene", it may be determined that the mobile terminal is currently in the night scene photographing mode, and the above-described process is performed.
In another example, the current ambient light intensity may be detected by an ambient light sensor of the mobile terminal, and when the current ambient light intensity is detected to be lower than a preset threshold value, it is determined that the mobile terminal is currently in a night scene photographing mode, and the above-described process is performed.
Those skilled in the art will appreciate that the process of determining whether the mobile terminal is in night scene photographing mode is not limited to the above examples, which are not enumerated by the present disclosure.
As can be seen from the foregoing, in the embodiment of the present disclosure, when it is determined that the mobile terminal is in the night scene photographing mode, the image processing method is executed, so that the photographing experience of the user is improved.
As shown in fig. 3, in some embodiments, the thumbnail display window 320 may be displayed in a layered manner on the upper layer of the preview interface 310, or may be displayed in an embedded manner in the preview interface 310, so long as it is ensured that the user can see the thumbnail display window 320 in the preview interface.
In some embodiments, the relevant parameters of the thumbnail display window 320 may be freely set by the user, thereby improving the user's photographing experience, as will be described below in connection with the embodiment of fig. 8.
As shown in fig. 8, in some embodiments, the image processing method of the examples of the present disclosure further includes:
s810, acquiring a user operation instruction.
S820, responding to the user operation instruction as a preset operation instruction, and outputting and displaying setting options aiming at the thumbnail display window on the preview interface.
S830, obtaining setting instruction parameters of a user aiming at the setting options, and adjusting target parameters of the thumbnail display window according to the setting instruction parameters.
In some embodiments, the user operation instruction may be an operation instruction such as a touch, a slide, a stand-alone, a double click, a long press, etc. by the user on the display unit 300 of the mobile terminal, which is not limited by the present disclosure.
The preset operation instruction is an operation instruction of a preset wake-up thumbnail window setting interface, which may be a double click, a long press, a preset gesture, etc., which is not limited in the present disclosure.
When the user operation instruction is detected to be a preset operation instruction, the user is required to set the thumbnail display window, so that the mobile terminal can output and display setting options on the preview interface, wherein the setting options are used for setting various parameters of the thumbnail display window.
For example, the setting options may include a size option, a position option, a frame effect option, and the like, and the user may adjust each setting option through input or gesture operation, so that the mobile terminal may obtain a corresponding setting instruction parameter, and adjust a target parameter of the thumbnail display window according to the setting instruction parameter.
For example, in one example, the setting instruction parameter is a parameter that is adjusted for a size option of the thumbnail display window, so that the mobile terminal can adjust the display size of the thumbnail display window on the preview interface according to the setting instruction parameter of the user.
For example, in another example, the setting instruction parameter is a parameter that is adjusted for a position option of the thumbnail display window, so that the mobile terminal can adjust a display position of the thumbnail display window on the preview interface according to the setting instruction parameter of the user. The display effect after the thumbnail display window 320 shown in fig. 3 is subjected to position and size adjustment is shown in fig. 9.
For example, in another embodiment, the setting instruction parameter is a parameter that is adjusted for a frame effect option of the thumbnail display window, so that the mobile terminal can adjust the frame effect of the thumbnail display window on the preview interface according to the setting instruction parameter of the user.
As can be seen from the foregoing, in the embodiment of the present disclosure, the target parameter of the thumbnail display window may be adjusted based on the user operation instruction, so as to improve the photographing experience.
In a second aspect, the embodiment of the present disclosure provides an image processing apparatus, which may be applied to a mobile terminal, where the mobile terminal is a device type suitable for having a camera function, such as a smart phone, a tablet computer, a wearable device, and the like, and the present disclosure is not limited thereto.
As shown in fig. 10, in some embodiments, an image processing apparatus of an example of the present disclosure includes:
A data acquisition module 10 configured to acquire preview image data including preview frame data of at least one frame of a preview image;
the intermediate frame determining module 20 is configured to adjust image parameters of the preview images according to the preview frame data for each frame of preview images to obtain a preset number of intermediate frame images;
the fusion processing module 30 is configured to perform fusion processing on a preset number of intermediate frame images to obtain thumbnail display images;
a display module 40 configured to display the thumbnail display image output in a thumbnail display window of the preview interface; the preview interface is a photographing preview interface of the mobile terminal, and the thumbnail display window is a local window displayed at a preset position of the preview interface.
As can be seen from the foregoing, in the embodiment of the present disclosure, in a scene photographed by a dim light, by generating and displaying a thumbnail display image, a thumbnail display image with scene detail information is presented on a preview interface without sacrificing the smoothness of the preview, so that an effective photographing assistance is provided for a user in the dim light scene, and user experience is improved.
In some implementations, the intermediate frame determination module is configured to:
Reducing parameter values of image parameters of the preview image according to the preview frame data to obtain a first number of intermediate frame images;
according to the preview frame data, improving the parameter values of the image parameters of the preview image to obtain a second number of intermediate frame images;
and obtaining the preset number of intermediate frame images according to the first number of intermediate frame images and the second number of intermediate frame images.
In some embodiments, the image parameters include at least one of:
brightness parameter, contrast parameter, gamma value.
As shown in fig. 11, in some embodiments, the image processing apparatus of the embodiments of the present disclosure further includes a downsampling module 50, the downsampling module 50 being configured to:
for each frame of preview image, the preview image is subjected to resolution downsampling processing according to the preview frame data.
As can be seen from the above, in the embodiment of the present disclosure, the downsampling process is performed on the preview image, so that the subsequent calculation amount is greatly reduced, the data processing speed is improved, and the display smoothness of the thumbnail display window is ensured.
As shown in fig. 11, in some embodiments, the image processing apparatus of the embodiments of the present disclosure further includes a mode determining module 60, the mode determining module 60 being configured to:
And executing the step of adjusting the image parameters of the preview image according to the preview frame data for each frame of the preview image in response to the mobile terminal being currently in the night scene photographing mode.
As can be seen from the foregoing, in the embodiment of the present disclosure, when it is determined that the mobile terminal is in the night scene photographing mode, the image processing method is executed, so that the photographing experience of the user is improved.
As shown in fig. 11, in some embodiments, the image processing apparatus of the embodiments of the present disclosure further includes an adjustment module 70, the adjustment module 70 being configured to:
acquiring a user operation instruction;
responding to the user operation instruction as a preset operation instruction, and outputting and displaying setting options aiming at the thumbnail display window on the preview interface;
and acquiring setting instruction parameters of a user aiming at the setting options, and adjusting target parameters of the thumbnail display window.
In some embodiments, the target parameters of the thumbnail display window include at least one of:
the position parameter of the thumbnail display window on the preset interface, the size parameter of the thumbnail display window and the display effect parameter of the thumbnail display window.
As can be seen from the foregoing, in the embodiment of the present disclosure, the target parameter of the thumbnail display window may be adjusted based on the user operation instruction, so as to improve the photographing experience.
In a third aspect, an embodiment of the present disclosure provides a mobile terminal, including:
a processor; and
a memory storing computer instructions readable by a processor, the processor performing a method according to any of the embodiments of the first aspect when the computer instructions are read.
In a fourth aspect, the disclosed embodiments provide a storage medium storing computer readable instructions for causing a computer to perform the method according to any of the embodiments of the first aspect.
A block diagram of a mobile terminal according to some embodiments of the present disclosure is shown in fig. 12, and a description will be given below of the mobile terminal and storage medium related principles according to some embodiments of the present disclosure with reference to fig. 12.
Referring to fig. 12, the mobile terminal 1800 may include one or more of the following components: a processing component 1802, a memory 1804, a power component 1806, a multimedia component 1808, an audio component 1810, an input/output (I/O) interface 1812, a sensor component 1816, and a communication component 1818.
The processing component 1802 generally controls overall operation of the mobile terminal 1800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1802 may include one or more processors 1820 to execute instructions. Further, the processing component 1802 may include one or more modules that facilitate interactions between the processing component 1802 and other components. For example, the processing component 1802 may include a multimedia module to facilitate interaction between the multimedia component 1808 and the processing component 1802. As another example, the processing component 1802 may read executable instructions from a memory to implement mobile terminal related functions.
The memory 1804 is configured to store various types of data to support operation at the mobile terminal 1800. Examples of such data include instructions for any application or method operating on the mobile terminal 1800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply assembly 1806 provides power to the various components of the mobile terminal 1800. The power components 1806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the mobile terminal 1800.
The multimedia component 1808 includes a display screen between the mobile terminal 1800 and the user that provides an output interface. In some embodiments, the multimedia component 1808 includes a front-facing camera and/or a rear-facing camera. The front camera and/or the rear camera may receive external multimedia data when the mobile terminal 1800 is in an operational mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 1810 is configured to output and/or input audio signals. For example, the audio component 1810 includes a Microphone (MIC) configured to receive external audio signals when the mobile terminal 1800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 1804 or transmitted via the communication component 1818. In some embodiments, audio component 1810 includes a speaker for outputting audio signals.
The I/O interface 1812 provides an interface between the processing component 1802 and a peripheral interface module, which may be a keyboard, click wheel, button, or the like. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 1816 includes one or more sensors for providing status assessment of various aspects of the mobile terminal 1800. For example, the sensor assembly 1816 may detect the on/off state of the mobile terminal 1800, the relative positioning of the components, such as the display and keypad of the mobile terminal 1800, the sensor assembly 1816 may detect the change in position of the mobile terminal 1800 or a component of the mobile terminal 1800, the presence or absence of user contact with the mobile terminal 1800, the orientation or acceleration/deceleration of the mobile terminal 1800, and the change in temperature of the mobile terminal 1800. The sensor assembly 1816 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1816 may include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1816 may include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1818 is configured to facilitate communication between the mobile terminal 1800 and other devices, either by wire or wirelessly. The mobile terminal 1800 may access a wireless network, such as Wi-Fi,2G,3G,4G,5G, or 6G, or a combination thereof, based on a communication standard. In one exemplary embodiment, the communication component 1818 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 1818 includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the mobile terminal 1800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements.
It should be apparent that the above embodiments are merely examples for clarity of illustration and are not limiting of the embodiments. Other variations or modifications of the above teachings will be apparent to those of ordinary skill in the art. It is not necessary here nor is it exhaustive of all embodiments. While still being apparent from variations or modifications that may be made by those skilled in the art are within the scope of the present disclosure.
Claims (10)
- An image processing method, applied to a mobile terminal, comprising:acquiring preview image data, wherein the preview image data comprises preview frame data of at least one frame of preview image;for each frame of preview image, adjusting image parameters of the preview image according to the preview frame data to obtain a preset number of intermediate frame images;carrying out fusion processing on the preset number of intermediate frame images to obtain thumbnail display images;outputting and displaying the thumbnail display image in a thumbnail display window of a preview interface; the preview interface is a photographing preview interface of the mobile terminal, and the thumbnail display window is a local window displayed at a preset position of the preview interface.
- The method according to claim 1, wherein the adjusting the image parameters of the preview image according to the preview frame data to obtain a preset number of intermediate frame images includes:reducing parameter values of image parameters of the preview image according to the preview frame data to obtain a first number of intermediate frame images;according to the preview frame data, improving the parameter values of the image parameters of the preview image to obtain a second number of intermediate frame images;And obtaining the preset number of intermediate frame images according to the first number of intermediate frame images and the second number of intermediate frame images.
- The method of claim 1, wherein the image parameters include at least one of:brightness parameter, contrast parameter, gamma value.
- A method according to any one of claims 1 to 3, wherein, before said adjusting the image parameters of the preview image in accordance with the preview frame data for each frame of preview image, the method further comprises:and for each frame of preview image, performing resolution downsampling processing on the preview image according to the preview frame data.
- A method according to any one of claims 1 to 3, wherein, before said adjusting the image parameters of the preview image in accordance with the preview frame data for each frame of preview image, the method further comprises:and responding to the mobile terminal currently in a night scene shooting mode, executing the step of adjusting the image parameters of the preview image according to the preview frame data for each frame of preview image.
- A method according to any one of claims 1 to 3, further comprising:Acquiring a user operation instruction;responding to the user operation instruction as a preset operation instruction, and outputting and displaying setting options aiming at the thumbnail display window on the preview interface;and acquiring setting instruction parameters of a user aiming at the setting options, and adjusting target parameters of the thumbnail display window according to the setting instruction parameters.
- The method of claim 6, wherein the target parameters of the thumbnail display window include at least one of:the position parameter of the thumbnail display window on the preset interface, the size parameter of the thumbnail display window and the display effect parameter of the thumbnail display window.
- An image processing apparatus, characterized by being applied to a mobile terminal, comprising:a data acquisition module configured to acquire preview image data including preview frame data of at least one frame of a preview image;the intermediate frame determining module is configured to adjust image parameters of the preview images according to the preview frame data for each frame of preview images to obtain a preset number of intermediate frame images;the fusion processing module is configured to perform fusion processing on the preset number of intermediate frame images to obtain thumbnail display images;A display module configured to display the thumbnail display image output in a thumbnail display window of a preview interface; the preview interface is a photographing preview interface of the mobile terminal, and the thumbnail display window is a local window displayed at a preset position of the preview interface.
- A mobile terminal, comprising:a processor; anda memory storing computer instructions readable by the processor, which when read, performs the method of any one of claims 1 to 7.
- A storage medium storing computer readable instructions for causing a computer to perform the method of any one of claims 1 to 7.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2022/093485 WO2023220957A1 (en) | 2022-05-18 | 2022-05-18 | Image processing method and apparatus, and mobile terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117441341A true CN117441341A (en) | 2024-01-23 |
Family
ID=88834146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202280004220.4A Pending CN117441341A (en) | 2022-05-18 | 2022-05-18 | Image processing method, device, mobile terminal and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117441341A (en) |
| WO (1) | WO2023220957A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117750190A (en) * | 2024-02-20 | 2024-03-22 | 荣耀终端有限公司 | Image processing method and electronic equipment |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118678010A (en) * | 2024-08-19 | 2024-09-20 | 杭州海康威视数字技术股份有限公司 | Video recorder and video processing method |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108307109B (en) * | 2018-01-16 | 2020-04-17 | 维沃移动通信有限公司 | High dynamic range image preview method and terminal equipment |
| CN110908558B (en) * | 2019-10-30 | 2022-10-18 | 维沃移动通信（杭州）有限公司 | Image display method and electronic equipment |
| US11297244B2 (en) * | 2020-02-11 | 2022-04-05 | Samsung Electronics Co., Ltd. | Click-and-lock zoom camera user interface |
| CN111372001B (en) * | 2020-03-17 | 2021-09-03 | 捷开通讯(深圳)有限公司 | Image fusion method and device, storage medium and mobile terminal |
| CN111432121A (en) * | 2020-03-30 | 2020-07-17 | Oppo广东移动通信有限公司 | Generation method, electronic device, and storage medium |
| CN113556461B (en) * | 2020-09-29 | 2022-07-26 | 华为技术有限公司 | Image processing method, electronic equipment and computer readable storage medium |
-
2022
- 2022-05-18 WO PCT/CN2022/093485 patent/WO2023220957A1/en active Application Filing
- 2022-05-18 CN CN202280004220.4A patent/CN117441341A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117750190A (en) * | 2024-02-20 | 2024-03-22 | 荣耀终端有限公司 | Image processing method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023220957A1 (en) | 2023-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108419016B (en) | Shooting method and device and terminal | |
| CN106131441B (en) | Photographing method and device and electronic equipment | |
| CN106484257A (en) | Camera control method, device and electronic equipment | |
| US8526685B2 (en) | Method and apparatus for selectively supporting raw format in digital image processor | |
| CN117441341A (en) | Image processing method, device, mobile terminal and storage medium | |
| CN111953904B (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN113810590A (en) | Image processing method, electronic device, medium, and system | |
| US11032483B2 (en) | Imaging apparatus, imaging method, and program | |
| CN111953903A (en) | Shooting method, shooting device, electronic equipment and storage medium | |
| CN115205172A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN111355879B (en) | Image acquisition method and device containing special effect pattern and electronic equipment | |
| CN115426449B (en) | Photographing method and terminal | |
| CN116416323A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN114079724B (en) | Taking-off snapshot method, device and storage medium | |
| CN117499794A (en) | Photographing method, photographing device and storage medium | |
| CN111866373B (en) | Method, device and medium for displaying shooting preview image | |
| CN112087570B (en) | Image shooting method and device, electronic equipment and readable storage medium | |
| CN113315903A (en) | Image acquisition method and device, electronic equipment and storage medium | |
| JP7150053B2 (en) | IMAGING DEVICE, IMAGING METHOD, AND PROGRAM | |
| CN111225158B (en) | Image generation method and device, electronic equipment and computer readable storage medium | |
| JP7321187B2 (en) | Image processing method and apparatus, camera assembly, electronic device, storage medium | |
| CN116051368B (en) | Image processing method and related device | |
| CN116980767A (en) | Shooting method, shooting device and medium | |
| CN118509706A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN116263946A (en) | Image processing method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |