CN111263079B

CN111263079B - Image processing method, image processing device, storage medium and electronic equipment

Info

Publication number: CN111263079B
Application number: CN202010099603.7A
Authority: CN
Inventors: 贾玉虎
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-02-18
Filing date: 2020-02-18
Publication date: 2021-06-15
Anticipated expiration: 2040-02-18
Also published as: CN111263079A

Abstract

The application discloses an image processing method, an image processing device, a storage medium and an electronic device. The method comprises the following steps: when a video is recorded, determining images corresponding to a video recording scene acquired at different moments as reference images according to a preset strategy; every time a reference image is acquired, detecting whether a video recording scene needs to use an HDR video recording mode or not according to the reference image; when the HDR video recording mode is detected to be needed, recording a video segment with HDR effect through the HDR video recording mode; when detecting that the HDR video recording mode is not needed, recording the video segment through the non-HDR video recording mode; and generating corresponding videos according to the video clips obtained by recording. The power consumption of the electronic equipment can be reduced.

Description

Image processing method, image processing device, storage medium and electronic equipment

Technical Field

The present application belongs to the field of image technologies, and in particular, to an image processing method, an image processing apparatus, a storage medium, and an electronic device.

Background

Compared with a common image, a High-Dynamic Range (HDR) image can provide more Dynamic Range and image details, so as to provide a better image visual experience for a user. The electronic equipment can utilize the module of making a video recording to shoot a plurality of images that have different exposure values, then fuse these a plurality of images that have different exposure values to obtain the image that has high dynamic range. However, in the related art, in order to obtain an image with a high dynamic range, power consumption of the electronic device is high.

Disclosure of Invention

The embodiment of the application provides an image processing method, an image processing device, a storage medium and an electronic device, which can save the power consumption of the electronic device.

In a first aspect, an embodiment of the present application provides an image processing method, including:

when a video is recorded, determining images corresponding to a video recording scene acquired at different moments as reference images according to a preset strategy;

every time a reference image is acquired, detecting whether a video recording scene needs to use an HDR video recording mode or not according to the reference image;

when the HDR video recording mode is detected to be needed, recording a video segment with HDR effect through the HDR video recording mode;

when detecting that the HDR video recording mode is not needed, recording the video segment through the non-HDR video recording mode;

and generating corresponding videos according to the video clips obtained by recording.

In a second aspect, an embodiment of the present application provides an image processing apparatus, including:

the determining module is used for determining images corresponding to video recording scenes acquired at different moments as reference images according to a preset strategy when a video is recorded;

the detection module is used for detecting whether a video recording scene needs to use an HDR video recording mode according to a reference image every time the reference image is acquired;

the video recording system comprises a first recording module, a second recording module and a third recording module, wherein the first recording module is used for recording a video segment with HDR effect through an HDR video recording mode when the HDR video recording mode is detected to be used;

the second recording module is used for recording the video segments in the non-HDR video recording mode when the HDR video recording mode is not required to be used;

and the generating module is used for generating corresponding videos according to the video segments obtained by recording.

In a third aspect, an embodiment of the present application provides a storage medium, on which a computer program is stored, which, when executed on a computer, causes the computer to execute a flow in an image processing method provided by an embodiment of the present application.

In a fourth aspect, an embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the processor is configured to execute the flow in the image processing method provided in the embodiment of the present application by calling a computer program stored in the memory.

In the embodiment of the application, in the process of recording the video, the electronic device may determine, as the reference image, the image corresponding to the video recording scene, which is acquired at each different time, according to a preset policy. Each time a reference image is acquired, the electronic device may detect from the reference image whether the video recording scene requires the HDR video recording mode to be used. If the HDR video recording mode is required, the electronic device may record the video segment with HDR effect through the HDR video recording mode. If the HDR video recording mode is not required, the electronic device may record the video segment using a normal video recording mode (i.e., a non-HDR video recording mode). And then, the electronic equipment can generate corresponding videos according to the recorded video segments. That is, in the embodiment of the present application, the electronic device may record a video segment with HDR effect using the HDR video recording mode or record a video segment using the normal video recording mode as needed at different times. Because more power consumption is needed for recording videos by using the HDR video recording mode, compared with a mode of recording video segments by using the HDR video recording mode all the time, the embodiment of the application can save power consumption for electronic equipment.

Drawings

The technical solutions and advantages of the present application will become apparent from the following detailed description of specific embodiments of the present application when taken in conjunction with the accompanying drawings.

Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application.

Fig. 2 is another schematic flow chart of an image processing method according to an embodiment of the present application.

Fig. 3 is a scene schematic diagram of an image processing method according to an embodiment of the present application.

Fig. 4 to fig. 5 are schematic views of another scene of an image processing method according to an embodiment of the present application.

Fig. 6 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.

Fig. 7 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

Fig. 8 is another schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the application and should not be taken as limiting the application with respect to other embodiments that are not detailed herein.

It is understood that the execution subject of the embodiment of the present application may be an electronic device such as a smart phone or a tablet computer.

Referring to fig. 1, fig. 1 is a schematic flow chart of an image processing method according to an embodiment of the present application, where the flow chart may include:

101. when a video is recorded, determining images corresponding to a video recording scene acquired at different moments as reference images according to a preset strategy.

In this embodiment of the application, for example, when recording a video, the electronic device may determine, as the reference image, images corresponding to a video recording scene acquired at different times at intervals according to a preset policy.

For example, during recording a video, the electronic device may determine, as a reference image at the time, an image P1 corresponding to a video recording scene, which is obtained at time T1. Thereafter, the electronic device may determine the image P2 corresponding to the video recording scene, which is one frame acquired at time T2, as a reference image at this time. Thereafter, the electronic device may determine the image P3 corresponding to the video recording scene, which is one frame acquired at time T3, as a reference image at this time, and so on. Among them, T1 is earlier than T2, T2 is earlier than T3, and so on.

102. Whenever a reference image is acquired, whether the HDR video recording mode is needed in a video recording scene or not is detected according to the reference image.

For example, each time a frame of reference image is acquired, the electronic device may detect whether the video recording scene needs to use the HDR video recording mode according to the reference image. That is, the electronic device may detect whether a video image with HDR effect needs to be recorded in a video recording scene at this time according to the reference image.

For example, after acquiring the reference image P1, the electronic device may detect whether the video recording scene needs to use the HDR video recording mode according to the reference image P1. If it is detected that the video recording scenario requires the HDR video recording mode to be used, then it may be entered in 103. If it is detected that the video recording scenario does not require the HDR video recording mode to be used, then 104 may be entered.

After acquiring the reference image P2, the electronic device may detect whether the video recording scene needs to use the HDR video recording mode according to the reference image P2. If it is detected that the HDR video recording mode is required for the video recording scenario, then it may be entered in 103. If it is detected that the video recording scenario does not require the HDR video recording mode to be used, then it may proceed to 104, and so on.

103. When it is detected that the HDR video recording mode is needed, a video segment with HDR effect is recorded through the HDR video recording mode.

For example, according to the reference image, the electronic device detects that the HDR video recording mode is required to be used, and then the electronic device can record the video segment with the HDR effect through the HDR video recording mode.

For example, according to the reference image P2, if the electronic device detects that the HDR video recording mode needs to be used at this time, the electronic device may record a video segment with a high dynamic range effect through the HDR video recording mode until the time T3 arrives, and then the electronic device acquires a new reference image and re-detects whether the video segment needs to be recorded using the HDR video recording mode.

104. When it is detected that the HDR video recording mode is not required to be used, the video segments are recorded by the non-HDR video recording mode.

For example, according to the reference image, when the electronic device detects that the HDR video recording mode is not required, the electronic device may record the video segment in the non-HDR video recording mode, that is, the electronic device may record the video segment in the normal video recording mode.

For example, according to the reference image P1, if the electronic device detects that the HDR video recording mode is not needed at this time, the electronic device may record the video segment in the non-HDR video recording mode (i.e., the normal video recording mode) until the time T2 arrives, and then the electronic device acquires a new reference image and re-detects whether the video segment needs to be recorded in the HDR video recording mode.

105. And generating corresponding videos according to the video clips obtained by recording.

For example, after recording video segments with or without HDR effect, the electronic device may generate corresponding video according to the recorded video segments.

For example, between time T1 and time T2, the electronic device records a video clip V1 with no HDR effect. Between time T2 and time T3, the electronic device records video clip V2 with HDR effect. Between time T3 and time T4, the electronic device records video clip V3 with HDR effect. Then, between time T1 and time T4, the electronic device records the video as a combination of three video segments, V1, V2 and V3.

It can be understood that, in the embodiment of the present application, in the process of recording a video, the electronic device may determine, as the reference image, the image corresponding to the video recording scene acquired at each different time at intervals according to a preset policy. Each time a reference image is acquired, the electronic device may detect from the reference image whether the video recording scene requires the HDR video recording mode to be used. If the HDR video recording mode is required, the electronic device may record the video segment with HDR effect through the HDR video recording mode. If the HDR video recording mode is not required, the electronic device may record the video segment using a normal video recording mode (i.e., a non-HDR video recording mode). And then, the electronic equipment can generate corresponding videos according to the recorded video segments. That is, in the embodiment of the present application, the electronic device may record a video segment with HDR effect using the HDR video recording mode or record a video segment using the normal video recording mode as needed at different times. Because more power consumption is needed for recording videos by using the HDR video recording mode, compared with a mode of recording video segments by using the HDR video recording mode all the time, the embodiment of the application can save power consumption for electronic equipment.

Referring to fig. 2, fig. 2 is another schematic flow chart of an image processing method according to an embodiment of the present application, where the flow chart may include:

201. when recording a video, the electronic equipment determines images corresponding to a video recording scene acquired at different moments as reference images according to a preset strategy.

202. Every time a reference image is acquired, the electronic equipment detects whether the video recording scene needs to use the HDR video recording mode according to the reference image.

For example, 201 and 202 may include:

when recording a video, the electronic device may determine, according to a preset policy, images corresponding to a video recording scene acquired at different times as reference images.

For example, during recording a video, the electronic device may determine, as a reference image at the time, an image P1 corresponding to a video recording scene, which is obtained at time T1. After a period of time has elapsed, the electronic device may determine, as a reference image at this time, a frame of image P2 corresponding to the video recording scene acquired at time T2. After a certain period of time has elapsed, the electronic device may determine the image P3 corresponding to the video recording scene, which was acquired at time T3, as the reference image at that time, and so on. Among them, T1 is earlier than T2, T2 is earlier than T3, and so on.

Each time a frame of reference image is acquired, the electronic device can detect whether the video recording scene needs to use the HDR video recording mode according to the reference image. That is, the electronic device may detect whether a video image with HDR effect needs to be recorded in a video recording scene at this time according to the reference image.

For example, after acquiring the reference image P1, the electronic device may detect whether the video recording scene needs to use the HDR video recording mode according to the reference image P1. If it is detected that the video recording scenario does not require the HDR video recording mode to be used, 203 may be entered. If it is detected that the video recording scenario requires the HDR video recording mode to be used, 205 may be entered.

After acquiring the reference image P2, the electronic device may detect whether the video recording scene needs to use the HDR video recording mode according to the reference image P2. If it is detected that the video recording scenario does not require the HDR video recording mode to be used, then 203 may be entered, and so on. If it is detected that the video recording scenario requires the HDR video recording mode to be used, then 205 may be entered.

203. When detecting that the HDR video recording mode is not required to be used, the electronic equipment acquires a first exposure value corresponding to the non-HDR video recording mode.

204. According to the first exposure value, the electronic equipment records the video segment in the non-HDR video recording mode.

For example, 203 and 204 may include:

the electronic equipment detects that the HDR video recording mode is not needed at the moment according to the newly acquired reference image, and then the electronic equipment can acquire a first exposure value corresponding to the non-HDR video recording mode and record a video segment through the non-HDR video recording mode according to the first exposure value. That is, the electronic device may record a video clip through a normal video recording mode according to the first exposure value.

For example, the first exposure value corresponding to the non-HDR video recording mode may be denoted as EV 0. The exposure parameter corresponding to the EV0 may be a set of exposure parameters preset in the electronic device and suitable for capturing images in a normal scene (i.e., a scene that does not need to start the HDR video recording mode). Then, when the electronic device detects that the HDR video recording mode is not needed at this time according to the newly acquired reference image, the electronic device may acquire the exposure value EV0, capture an image according to the exposure value EV0, determine the image captured using the exposure value EV0 as a video frame, and combine the captured video frames to obtain a corresponding video segment.

For example, as shown in fig. 3, on the time axis, T1 is earlier than T2, T2 is earlier than T3, T3 is earlier than T4, T4 is earlier than T5, and T5 is earlier than T6. The reference image acquired at time Tn is Pn, n being greater than or equal to 1.

The electronic device detects that the HDR video recording mode is not needed at this time according to the newly acquired reference image P1 (corresponding to the time T1), and then the electronic device may acquire the first exposure value corresponding to the non-HDR video recording mode and record the video segment in the non-HDR video recording mode according to the first exposure value. For example, between the time T1 and the time T2, the electronic device may capture video frames each having no HDR effect according to the first exposure value, and the video frames are combined to obtain a video clip corresponding to the time T1 to the time T2.

205. When the HDR video recording mode is detected to be needed, the electronic equipment acquires the information whether the HDR video recording mode is needed or not, which is detected last time.

For example, the electronic device detects that the HDR video recording mode needs to be used at this time according to the newly acquired reference image, and then the electronic device may acquire information that is obtained last time by detection whether the HDR video recording mode needs to be used.

For example, referring to the time axis shown in fig. 3, the electronic device determines an image P2 acquired at time T2 as a reference image. The electronic device detects that the HDR video recording mode needs to be used at this time according to the reference image P2, and then the electronic device may obtain information of whether the HDR video recording mode needs to be used, which is obtained by the last detection, that is, the electronic device may obtain detection result information of whether the HDR video recording mode needs to be used, which is detected according to the reference image P1 (corresponding to the time T1).

If the last detected information about whether the HDR video recording mode needs to be used is that the HDR video recording mode does not need to be used last time (i.e., the non-HDR video recording mode was used last time), then the process proceeds to 206. For example, the electronic device detects from reference image P1 that the HDR video recording mode is not required to be used, and proceeds to 206. That is, at this time, it is necessary to switch from the non-HDR video recording mode to the HDR video recording mode.

If the last detected information about whether the HDR video recording mode needs to be used is that the HDR video recording mode needs to be used last time (i.e., the HDR video recording mode was used last time), then the process proceeds to 209. For example, assuming that the electronic device detects from reference image P1 that the HDR video recording mode needs to be used, then proceed to 209. I.e. the HDR video recording mode still needs to be used at this time.

206. If the non-HDR video recording mode is used last time, the electronic equipment obtains a first HDR score of the reference image determined this time, wherein the HDR score of the image is used for representing the dynamic range of the image, and the higher the HDR score is, the larger the dynamic range of the image is.

207. The electronic device obtains a fourth exposure value for the long exposure and a fifth exposure value for the short exposure corresponding to the first HDR score.

208. According to the fourth exposure value and the fifth exposure value, the electronic equipment records the video segment with HDR effect through the HDR video recording mode.

For example, 206, 207, 208 may include:

at the present moment, the electronic device detects that the video recording scene needs to use the HDR video recording mode according to the reference image P2, and in the last detection, the electronic device detects that the video recording scene does not need to use the HDR video recording mode according to the reference image P1. This indicates that a switch from non-HDR video recording mode to HDR video recording mode is required. At this time, the electronic device may obtain a first HDR score of the reference image determined this time. That is, the electronic device may obtain a first HDR score corresponding to reference image P2. The HDR score of an image can be used to represent the dynamic range of the image, and the higher the HDR score is, the larger the dynamic range of the image is, the larger the dynamic range of a shooting scene at the time of shooting the image is.

After the first HDR score of the reference image determined this time is obtained, the electronic device may obtain a fourth exposure value for long exposure and a fifth exposure value for short exposure, which correspond to the first HDR score. For example, the electronic device may acquire a fourth exposure value for the long exposure and a fifth exposure value for the short exposure corresponding to the HDR score of the reference image P2. Then, the electronic device may record the video segment with HDR effect through the HDR video recording mode according to the fourth exposure value and the fifth exposure value.

In one embodiment, the electronic device may implement the process of recording the video segment with HDR effect according to the fourth exposure value and the fifth exposure value in the HDR video recording mode by: for example, after acquiring the fourth exposure value for long exposure and the fifth exposure value for short exposure, the electronic device may capture an image with a larger exposure using the fourth exposure value and capture an image with a smaller exposure using the fifth exposure value, and then the electronic device may perform HDR fusion on the captured images with different exposures, thereby obtaining an image with an HDR effect, and determine the image with the HDR effect as one frame of video frame. And combining the video frames with the HDR effect to obtain the corresponding video clip. For example, between the time T2 and the time T3, the electronic device may capture video frames each having HDR effects according to the fourth exposure value and the fifth exposure value, and the video frames are combined to obtain a video clip corresponding to the time T2 to the time T3.

209. If the HDR video recording mode is used last time, the electronic equipment obtains a first HDR score of the reference image determined this time and a second HDR score of the reference image determined last time.

For example, at the current time, the electronic device detects that the HDR video recording mode is required for the video recording scene according to the reference image P3 (corresponding to the time T3). In the last detection, the electronic device detects that the video recording scene is also required to use the HDR video recording mode according to the reference image P2. This means that the electronic device still needs to use the HDR video recording mode. At this time, the electronic device may obtain a first HDR score of the reference image P3 determined this time and a second HDR score corresponding to the reference image P2 determined last time.

Thereafter, the electronic device may detect whether a difference between the first HDR score and the second HDR score is greater than a preset score difference.

If the difference between the first HDR score and the second HDR score is greater than the predetermined score difference, then proceed to 210.

If the difference between the first HDR score and the second HDR score is not greater than the predetermined score difference, then 212 is entered.

210. If the difference value of the first HDR score and the second HDR score is larger than the preset score difference value, the electronic equipment acquires a sixth exposure value and a seventh exposure value corresponding to the first HDR score, wherein the sixth exposure value is an exposure value used for long exposure, and the seventh exposure value is an exposure value used for short exposure.

211. According to the sixth exposure value and the seventh exposure value, the electronic equipment records the video segment with HDR effect through the HDR video recording mode.

For example, 210, 211 may include:

the electronic device detects that the difference between the first HDR score and the second HDR score is greater than the preset score difference, then it may be assumed that the dynamic range of the video recording scene becomes greater than before (e.g., the corresponding time period between time T2 and time T3). The electronic device needs to adjust the exposure values used in the HDR video recording mode for long exposure and for short exposure. At this time, the electronic apparatus may acquire the sixth exposure value for the long exposure and the seventh exposure value for the short exposure corresponding to the first HDR score of the reference image P3. After that, the electronic device may record the video segment with HDR effect through the HDR video recording mode according to the sixth exposure value and the seventh exposure value.

For example, after acquiring the sixth exposure value for long exposure and the seventh exposure value for short exposure, the electronic device may capture an image with a larger exposure using the sixth exposure value and capture an image with a smaller exposure using the seventh exposure value, and then the electronic device may perform HDR fusion on the captured images with different exposures, thereby obtaining an image with an HDR effect, and determine the image with the HDR effect as one frame of video frame. And combining the video frames with the HDR effect to obtain the corresponding video clip. For example, between the time T3 and the time T4, the electronic device may capture video frames each having HDR effects according to the sixth exposure value and the seventh exposure value, and the video frames are combined to obtain a video clip corresponding to the time T3 to the time T4.

212. If the difference value of the first HDR score and the second HDR score is smaller than or equal to the preset score difference value, the electronic equipment records the video segment with the HDR effect through the HDR video recording mode according to the exposure value currently used for long exposure and the exposure value currently used for short exposure.

For example, after acquiring the first HDR score of the reference image P3 determined this time and the second HDR score corresponding to the reference image P2 determined last time, the electronic device detects that the difference between the first HDR score and the second HDR score is smaller than or equal to the preset score difference, and then it may be considered that the dynamic range of the video recording scene does not change much compared to the previous dynamic range (for example, the corresponding time period between T2 and T3). In this case, the electronic device may continue to record the video segment with the HDR effect through the HDR video recording mode according to the exposure value currently used for the long exposure and the exposure value currently used for the short exposure. For example, the exposure value for the long exposure corresponding to the HDR score of the reference image P2 is exposure value a, and the exposure value for the short exposure is exposure value B. That is, between time T2 and time T3, the electronic device's exposure value for the long exposure is exposure value A and the exposure value for the short exposure is exposure value B. Then, between time T3 and time T4, the electronic device may continue to record the video segment with HDR effect through the HDR video recording mode using the exposure value a and the exposure value B.

It should be noted that when the difference between the first HDR score and the second HDR score is less than or equal to the preset score difference, the dynamic range of the video recording scene may be considered to be less changed than before. In this case, the electronic device can continue to record the video segment with HDR effect according to the exposure value currently used for the long exposure and the exposure value currently used for the short exposure, thereby avoiding the processing burden on the electronic device caused by frequently adjusting the exposure values and improving the flexibility of video recording.

213. And according to each video clip obtained by recording, the electronic equipment generates a corresponding video.

For example, after each video segment is obtained by recording, the electronic device may generate a corresponding video according to each video segment obtained by recording.

In another embodiment, when switching from an HDR video recording mode to a non-HDR video recording mode, the electronic device may switch relatively slowly. When switching from the non-HDR video recording mode to the HDR video recording mode, the electronic device may also switch relatively slowly. When the dynamic range of the video recording scene changes greatly and the exposure value needs to be adjusted, the electronic device can adjust the exposure value relatively slowly, that is, the electronic device can adjust the exposure value relatively smoothly.

In the case that it is detected that the HDR video recording mode is not required to be used, the process of recording, by the electronic device, the video segment in the non-HDR video recording mode according to the first exposure value in 204 may include:

the electronic equipment acquires information whether the HDR video recording mode needs to be used or not, wherein the information is obtained by last detection;

if the HDR video recording mode is used last time, the electronic equipment acquires a second exposure value and a third exposure value corresponding to the HDR video recording mode used last time, wherein the second exposure value is an exposure value used for long exposure, and the third exposure value is an exposure value used for short exposure;

the electronic apparatus sets an initial value of an exposure value for the long exposure as a second exposure value and sets an initial value of an exposure value for the short exposure as a third exposure value;

the electronic equipment adjusts the exposure value for the long exposure and the exposure value for the short exposure from an initial value one by one, and records the video clip with HDR effect according to the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure, wherein the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure gradually approach to a first exposure value until the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure both become the first exposure value;

and when the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure are changed into the first exposure value, the electronic equipment records the video segment in the non-HDR video recording mode.

For example, as shown in fig. 3, the electronic device detects that the video recording scene at the time does not need to use the HDR video recording mode according to the reference image P5 corresponding to the time T5. In this case, the electronic device may acquire information of whether the HDR video recording mode needs to be used, which is detected last time. For example, in the last detection, the electronic device detects that the HDR video recording mode needs to be used according to the reference image P4 corresponding to the time T4, and then the electronic device may obtain the second exposure value for the long exposure and the third exposure value for the short exposure corresponding to the last used HDR video recording mode. That is, the electronic apparatus may acquire the second exposure value for the long exposure and the third exposure value for the short exposure in the period of T4 to T5. For example, the second exposure value is EV2 and the third exposure value is EV-2.

Thereafter, the electronic apparatus may set an initial value of the exposure value for the long exposure to a second exposure value and set an initial value of the exposure value for the short exposure to a third exposure value, and then sequentially adjust the exposure value for the long exposure and the exposure value for the short exposure from the initial values by a preset first magnitude, and record a video clip having an HDR effect according to the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure, wherein the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure gradually approach the first exposure value until both the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure become the first exposure value; when the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure both become the first exposure value, the electronic device can record the video segment in the non-HDR video recording mode.

For example, the initial value of the exposure value for the long exposure is set to EV2, and the initial value of the exposure value for the short exposure is set to EV-2, and then the electronic apparatus may adjust the exposure value for the long exposure and the exposure value for the short exposure from the initial values by a preset first magnitude. For example, in the first adjustment, the electronic device adjusts the exposure value for the long exposure from EV2 to EV1 and the exposure value for the short exposure from EV-2 to EV-1. After each adjustment, the electronic device may record a video segment with HDR effect according to the adjusted exposure value for long exposure and exposure value for short exposure. For example, after a first adjustment, the electronic device may record a video clip with HDR effects according to EV1 and EV-1.

In the second adjustment, the electronic device adjusts the exposure value for the long exposure from EV1 to EV0 and the exposure value for the short exposure from EV-1 to EV 0. Since the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure are already EV0, the third adjustment is not necessary. For example, after the second adjustment, the electronic device may record a normal video segment without HDR effects according to EV 0.

That is, when switching from the HDR video recording mode to the non-HDR video recording mode, the exposure value is switched from EV2 and EV-2 to EV1 and EV-1, and video recording is performed based on EV1 and EV-1, and then switched from EV1 and EV-1 to EV0, and video recording is performed based on EV 0. Through the smooth and slow exposure value switching, the video pictures recorded by the electronic equipment do not have sudden changes, the HDR video pictures can be smoothly transited to the ordinary video pictures, and the user experience is good.

As another example, in the case of switching from the non-HDR video recording mode to the HDR video recording mode, the process of recording the video segment with the HDR effect in the HDR video recording mode according to the fourth exposure value and the fifth exposure value in 208 may include:

the electronic equipment acquires a first exposure value, wherein the first exposure value is an exposure value corresponding to a non-HDR video recording mode;

the electronic device sets an exposure value for the long exposure and an initial value of the exposure value for the short exposure to a first exposure value;

the electronic equipment adjusts the exposure value for the long exposure and the exposure value for the short exposure from an initial value one by one, and records the video clip with the HDR effect according to the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure, wherein the adjusted exposure value for the long exposure gradually approaches a fourth exposure value, the adjusted exposure value for the short exposure gradually approaches a fifth exposure value until the adjusted exposure value for the long exposure reaches the fourth exposure value, and the adjusted exposure value for the short exposure reaches the fifth exposure value.

For example, as shown in fig. 3, the electronic device detects that the video recording scene at the time needs to use the HDR video recording mode according to the reference image P2 corresponding to the time T2. In this case, the electronic device may acquire information of whether the HDR video recording mode needs to be used, which is detected last time. For example, in the last detection, the electronic device detects that the HDR video recording mode is not required to be used according to the reference image P1 corresponding to the time T1, and then the electronic device may acquire the first exposure value corresponding to the non-HDR video recording mode, for example, EV 0. That is, the electronic apparatus may acquire the first exposure value EV0 for exposure in the period of T1 to T2.

Thereafter, the electronic apparatus may set an initial value of the exposure value for the long exposure to a first exposure value and also set an initial value of the exposure value for the short exposure to the first exposure value, then sequentially adjust the exposure value for the long exposure and the exposure value for the short exposure from the initial values, and record a video clip having an HDR effect according to the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure, wherein the adjusted exposure value for the long exposure gradually approaches a fourth exposure value and the adjusted exposure value for the short exposure gradually approaches a fifth exposure value until the adjusted exposure value for the long exposure reaches the fourth exposure value and the adjusted exposure value for the short exposure reaches the fifth exposure value. It will be appreciated that in this process, the electronic device records a video segment in the HDR video recording mode.

For example, the fourth exposure value is EV2, the fifth exposure value is EV-2, the initial value of the exposure value for long exposure is set to EV0, the initial value of the exposure value for short exposure is set to EV0, and then the electronic apparatus may adjust the exposure value for long exposure and the exposure value for short exposure from the initial values by a preset second margin. For example, in the first adjustment, the electronic device adjusts the exposure value for the long exposure from EV0 to EV1 and the exposure value for the short exposure from EV0 to EV-1. After each adjustment, the electronic device may record a video segment with HDR effect according to the adjusted exposure value for long exposure and exposure value for short exposure. For example, after a first adjustment, the electronic device may record a video clip with HDR effects according to EV1 and EV-1.

In the second adjustment, the electronic device adjusts the exposure value for the long exposure from EV1 to EV2 and the exposure value for the short exposure from EV-1 to EV-2. Since the adjusted exposure value for the long exposure has reached EV2 and the exposure value for the short exposure has been EV-2, no third adjustment is necessary. For example, after the second adjustment, the electronic device may record a normal video segment with HDR effects according to EV2 and EV-2.

That is, when switching from the non-HDR video recording mode to the HDR video recording mode, the exposure value is switched from EV0 to EV1 and EV-1, and video recording is performed based on EV1 and EV-1, and then from EV1 and EV-1 to EV2 and EV-2, and video recording is performed based on EV2 and EV-2. Through the smooth and slow exposure value switching, the video pictures recorded by the electronic equipment do not have sudden changes, the ordinary video pictures can be smoothly transited to HDR video pictures, and the user experience is good.

As another example, in 211, according to the sixth exposure value and the seventh exposure value, the process of the electronic device recording the video segment with HDR effect in the HDR video recording mode may include:

the electronic device determines the exposure value currently used for the long exposure as an eighth exposure value and determines the exposure value currently used for the short exposure as a ninth exposure value;

the electronic apparatus sets an initial value of an exposure value for long exposure to the eighth exposure value and an initial value of an exposure value for short exposure to the ninth exposure value;

the electronic equipment adjusts the exposure value for long exposure and the exposure value for short exposure from an initial value, and records the video segment with HDR effect according to the adjusted exposure value for long exposure and the adjusted exposure value for short exposure, wherein the adjusted exposure value for long exposure gradually approaches the sixth exposure value, the adjusted exposure value for short exposure gradually approaches the seventh exposure value until the adjusted exposure value for long exposure reaches the sixth exposure value, and the adjusted exposure value for short exposure reaches the seventh exposure value.

For example, as shown in fig. 3, the electronic device detects that the video recording scene at the time needs to use the HDR video recording mode according to the reference image P3 corresponding to the time T3. In this case, the electronic device may acquire information of whether the HDR video recording mode needs to be used, which is detected last time. For example, in the last detection, the electronic device detects that the HDR video recording mode needs to be used according to the reference image P2 corresponding to the time T2, and the difference value between the first HDR score corresponding to the reference image P3 and the second HDR score corresponding to the reference image P2 is greater than the preset score difference value. In this case, the electronic device may obtain a sixth exposure value and a seventh exposure value corresponding to the first HDR score, for example, the sixth exposure value is EV4 and the seventh exposure value is EV-4. While the exposure value currently used for the long exposure, i.e., the eighth exposure value, is EV2, the exposure value currently used for the short exposure, i.e., the ninth exposure value, is EV-2. It is understood that, since the period from T2 to T3 also uses the HDR video recording mode, the exposure value currently used for the long exposure is the exposure value used for the long exposure in the period from T2 to T3, and the exposure value currently used for the short exposure is the exposure value used for the short exposure in the period from T2 to T3.

Thereafter, the electronic apparatus may set an initial value of the exposure value for the long exposure to an eighth exposure value and an initial value of the exposure value for the short exposure to the ninth exposure value, then sequentially adjust the exposure value for the long exposure and the exposure value for the short exposure from the initial values, and record the video clip having the HDR effect according to the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure, wherein the adjusted exposure value for the long exposure gradually approaches the sixth exposure value and the adjusted exposure value for the short exposure gradually approaches the seventh exposure value until the adjusted exposure value for the long exposure reaches the sixth exposure value and the adjusted exposure value for the short exposure reaches the seventh exposure value. It will be appreciated that in this process, the electronic device records a video segment in the HDR video recording mode.

For example, the eighth exposure value is EV2, the ninth exposure value is EV-2, the initial value of the exposure value for the long exposure is EV2, and the initial value of the exposure value for the short exposure is EV-2, and then the electronic apparatus may successively adjust the exposure value for the long exposure and the exposure value for the short exposure from the initial values by a preset third margin. For example, in the first adjustment, the electronic device adjusts the exposure value for the long exposure from EV2 to EV3 and the exposure value for the short exposure from EV-2 to EV-3. After each adjustment, the electronic device may record a video segment with HDR effect according to the adjusted exposure value for long exposure and exposure value for short exposure. For example, after a first adjustment, the electronic device may record a video clip with HDR effects according to EV3 and EV-3.

In the second adjustment, the electronic device adjusts the exposure value for the long exposure from EV3 to EV4 and the exposure value for the short exposure from EV-3 to EV-4. Since the adjusted exposure value for the long exposure has reached EV4 and the exposure value for the short exposure has been EV-4, no third adjustment is necessary. For example, after the second adjustment, the electronic device may record a normal video segment with HDR effects according to EV4 and EV-4.

That is, when switching from the non-HDR video recording mode to the HDR video recording mode, the exposure value is switched from EV2 and EV-2 to EV3 and EV-3 and video recording is performed based on EV3 and EV-3, and then switched from EV3 and EV-3 to EV4 and EV-4 and video recording is performed based on EV4 and EV-4. Through smooth and slow exposure value switching, the video pictures recorded by the electronic equipment do not have sudden changes, the HDR video pictures can be smoothly transited from the HDR video pictures, and the user experience is good.

It should be noted that, in the present embodiment, the long exposure and the short exposure are relative. That is, the exposure level of an image photographed according to the exposure value of the long exposure is greater than that of an image photographed according to the exposure value of the short exposure.

For example, in the present embodiment, the exposure value for the long exposure may be recorded as EV +, and for example, the exposure value for the long exposure may be EV1, EV2, EV3, or the like, where the exposure value of EV3 is greater than the exposure value of EV2 and the exposure value of EV2 is greater than the exposure value of EV 1. The exposure value for the short exposure may be described as EV-, e.g., the exposure value for the short exposure may be EV-1, EV-2, EV-3, etc., where the exposure value of EV-3 is less than that of EV-2 and the exposure value of EV-2 is less than that of EV-1.

In some embodiments, the process of detecting whether the HDR video recording mode is required to be used in the video recording scene according to the reference image each time the reference image is acquired in 202 may include:

every time a reference image is acquired, the electronic equipment acquires a first pixel number of which the brightness value is greater than or equal to a preset first brightness threshold value, a second pixel number of which the brightness value is less than or equal to a preset second brightness threshold value, and brightness median values and brightness mean values of all pixels in the reference image, wherein the preset first brightness threshold value is greater than the second brightness threshold value;

if the number of the first pixels is larger than or equal to a preset first value, the electronic equipment determines that the HDR video recording mode is needed to be used in a video recording scene;

or if the number of the second pixels is greater than or equal to a preset second value, the electronic device determines that the HDR video recording mode is required to be used in the video recording scene;

or if the difference value between the brightness median value and the brightness mean value is greater than the preset brightness difference value, determining that the HDR video recording mode is required to be used in the video recording scene.

For example, each time a reference image is acquired, the electronic device may acquire the number of pixels in the reference image having a luminance value greater than or equal to a preset first luminance threshold, that is, the first number of pixels, the number of pixels in the reference image having a luminance value less than or equal to a preset second luminance threshold, that is, the second number of pixels, and the luminance median and the luminance mean of all pixels in the reference image, where the preset first luminance threshold is greater than the second luminance threshold.

If it is detected that the first number of pixels is greater than or equal to the preset first value, the reference image may be considered to have more overexposed pixels, and in this case, the electronic device may determine that the HDR video recording mode needs to be used for the video recording scene.

Alternatively, if it is detected that the second number of pixels is greater than or equal to the preset second value, the reference image may be considered to have more under-exposed pixels, in which case the electronic device may determine that the HDR video recording mode needs to be used for the video recording scene.

Or, if the difference between the median luminance values and the mean luminance values of all pixels in the reference image is greater than the preset luminance difference, it may be determined that the video recording scene needs to use the HDR video recording mode. It should be noted that the median luminance value of all pixels refers to a luminance value located at the middle of the luminance values of all pixels, and for example, the median of the values 1.5, 2, 3.5, 4.5, 5 is 3.5. The average luminance value is an average value of luminance values of all pixels, for example, the average value of values 1.5, 2, 3.5, 4.5, 5 is 3.3.

In some embodiments, the determining, by the electronic device in 201, images corresponding to the video recording scene acquired at different times as the reference image according to a preset policy may include: the electronic device acquires an image corresponding to the video recording scene every preset time, for example, the electronic device acquires a frame of image corresponding to the video recording scene every 1 second or 1.5 seconds, and determines the acquired image as a reference image.

Alternatively, the electronic device may acquire the image corresponding to the video recording scene every preset number of frames, for example, the electronic device acquires the image corresponding to the video recording scene every 5 frames or 8 frames. For example, since the electronic device is recording a video, the electronic device may continuously acquire video frames, and the electronic device may acquire an image corresponding to a video recording scene every preset number of frames and determine the image as a reference image. For example, the electronic device determines the first frame of the acquired image as the reference image, the electronic device acquires the reference image every 5 frames, the electronic device may determine the seventh frame of the acquired image as the latest reference image, and so on.

In this embodiment, the electronic device may calculate the HDR score of the image by: for example, the electronic device may first calculate a first number of pixels in the image having a brightness value greater than or equal to a preset first brightness threshold, and a second number of pixels in the image having a brightness value less than or equal to a preset second brightness threshold. Then, the HDR score of the image may be a ratio of a sum of the first and second numbers of pixels to a total number of pixels of the image, i.e., (the first number of pixels + the second number of pixels)/the total number of pixels of the image.

Referring to fig. 4 to 5, fig. 4 to 5 are schematic scene diagrams of an image processing method according to an embodiment of the present application.

For example, as shown in fig. 4, a user records a video using a camera application, and during the process of recording the video, the electronic device may determine an image of a captured video recording scene as a reference image every 5 frames. For example, the electronic device may determine the image of the shot 1 st frame of video recording scene as a reference image, and then the electronic device may determine the image of the shot 7 th frame of video recording scene as a new reference image, determine the image of the shot 13 th frame of video recording scene as a new reference image, and so on.

Every time the latest reference image is acquired, the electronic device can detect whether the video recording scene needs to use the HDR video recording mode according to the reference image, and record the video using the corresponding video recording mode.

For example, as shown in fig. 5, the electronic device may determine a first frame image F1 captured during video recording as a reference image, and detect that the video recording scene at this time does not need to use the HDR video recording mode according to the image F1, and then the electronic device may obtain an exposure value EV0 corresponding to the non-HDR video recording mode, and capture a video frame according to the exposure value EV0 to obtain a corresponding video segment.

Then, the electronic device may determine the seventh frame image F2 captured during video recording as a reference image, and detect that the video recording scene at this time needs to use the HDR video recording mode according to the image F2, and then the electronic device may obtain the HDR score of the image F2, and obtain an exposure value for long exposure and an exposure value for short exposure corresponding to the HDR score of the image F2. For example, the exposure value for the long exposure corresponding to the HDR score of the image F2 is EV2, and the exposure value for the short exposure is EV-2. Then, the electronic device may first capture a video frame with HDR effect using exposure values EV1 and EV-1, where EV1 is the exposure value for long exposure and EV-1 is the exposure value for short exposure. And then transitions to capturing a video frame with HDR effect using exposure values EV2 and EV-2.

Then, the electronic device may determine a thirteenth frame image F3 captured during video recording as a reference image, and detect that the video recording scene at this time needs to use the HDR video recording mode according to the image F3, then the electronic device may obtain an HDR score of the image F3 and an HDR score of the image F2, and detect whether a difference between the HDR score of the image F3 and the HDR score of the image F2 is greater than a preset score difference.

For example, the electronic device detects that the difference between the HDR score of the image F3 and the HDR score of the image F2 is greater than a preset score difference, the electronic device may acquire an exposure value for long exposure and an exposure value for short exposure corresponding to the HDR score of the image F3. For example, the exposure value for the long exposure corresponding to the HDR score of the image F3 is EV4 and the exposure value for the short exposure is EV-4. Then, the electronic device may first capture a video frame with HDR effect using exposure values EV3 and EV-3, where EV3 is the exposure value for long exposure and EV-3 is the exposure value for short exposure. And then transitions to capturing a video frame with HDR effect using exposure values EV4 and EV-4.

Then, the electronic device may determine a nineteenth frame image F4 captured during video recording as a reference image, and detect that the video recording scene at that time needs to use the HDR video recording mode according to the image F4, then the electronic device may obtain an HDR score of the image F4 and an HDR score of the image F3, and detect whether a difference value between the HDR score of the image F4 and the HDR score of the image F3 is greater than a preset score difference value.

For example, the electronic device detects that the difference between the HDR score of image F4 and the HDR score of image F3 is less than the preset score difference, the electronic device may continue to capture video frames using the exposure value currently used for long exposure and the exposure value currently used for short exposure. For example, the exposure value for the long exposure corresponding to the HDR score of the image F3 is EV4 and the exposure value for the short exposure is EV-4. Then the electronic device may continue to use exposure values EV3 and EV-3 to capture video frames with HDR effects.

Then, the electronic device may determine a twenty-fifth frame image F5 captured during video recording as a reference image, and detect that the video recording scene at this time does not need to use the HDR video recording mode according to the image F5, and then the electronic device may capture video frames with HDR effect using exposure values EV3 and EV-3. And then transitions to capturing a video frame with HDR effect using exposure values EV2 and EV-2. And then transitions to capturing a video frame with HDR effect using exposure values EV1 and EV-1. Finally, the transition is made to the capture of a normal video frame using the exposure value EV 0.

That is, during the recording of the video, during the period from the capturing of the image F1 to the capturing of the image F2, the electronic device captures ordinary video frames using the exposure value of EV0, and these video frames are combined into the video segment V1.

During the period between the shot of the image F2 to the shot of the image F3, the electronic apparatus may first use the exposure values EV1 and EV-1 to shoot a video frame having the HDR effect. And then transitions to capturing a video frame with HDR effect using exposure values EV2 and EV-2. These video frames are combined into a video clip V2.

During the period between the shot of the image F3 to the shot of the image F4, the electronic apparatus may first use the exposure values EV3 and EV-3 to capture a video frame having an HDR effect. And then transitions to capturing a video frame with HDR effect using exposure values EV4 and EV-4. These video frames are combined into a video clip V3.

During the period between the shot of the image F4 to the shot of the image F5, the electronic apparatus may continue to shoot video frames having the HDR effect using the exposure values EV4 and EV-4. These video frames are combined into a video clip V4.

During the period between the shot of the image F5 to the shot of the image F6, the electronic apparatus may first use the exposure values EV3 and EV-3 to capture a video frame having an HDR effect. And then transitions to capturing a video frame with HDR effect using exposure values EV2 and EV-2. And then transitions to capturing a video frame with HDR effect using exposure values EV1 and EV-1. And then transitions to capturing a normal video frame using exposure value EV 0. These video frames are combined into a video clip V5.

It is understood that the video segments V1, V2, V3, V4 and V5 are combined to obtain the video corresponding to the time.

Referring to fig. 6, fig. 6 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure. The image processing apparatus 300 may include: the recording system comprises a determining module 301, a detecting module 302, a first recording module 303, a second recording module 304 and a generating module 305.

The determining module 301 is configured to determine, as a reference image, images corresponding to a video recording scene acquired at different times according to a preset policy when a video is recorded;

a detection module 302, configured to detect whether a video recording scene needs to use an HDR video recording mode according to a reference image every time the reference image is obtained;

a first recording module 303, configured to record, when it is detected that the HDR video recording mode needs to be used, a video segment with HDR effect through the HDR video recording mode;

a second recording module 304, configured to record the video segment in the non-HDR video recording mode when detecting that the HDR video recording mode is not required to be used;

a generating module 305, configured to generate a corresponding video according to each video segment obtained by recording.

In one embodiment, the detection module 302 may be configured to:

every time a reference image is acquired, acquiring a first pixel number of which the brightness value is greater than or equal to a preset first brightness threshold value, a second pixel number of which the brightness value is less than or equal to a preset second brightness threshold value, and brightness median values and brightness mean values of all pixels in the reference image, wherein the preset first brightness threshold value is greater than the second brightness threshold value;

if the first pixel quantity is larger than or equal to a preset first value, determining that the HDR video recording mode is required to be used in a video recording scene;

or if the second pixel number is greater than or equal to a preset second value, determining that the HDR video recording mode is required to be used in the video recording scene;

or if the difference value between the brightness median value and the brightness mean value is greater than a preset brightness difference value, determining that the HDR video recording mode is required to be used in a video recording scene.

In one embodiment, the second recording module 304 may be configured to:

when detecting that the HDR video recording mode is not needed, acquiring a first exposure value corresponding to the non-HDR video recording mode;

and recording the video segment through a non-HDR video recording mode according to the first exposure value.

In one embodiment, the second recording module 304 may be configured to:

acquiring information whether the HDR video recording mode needs to be used or not, which is obtained by the last detection;

if the HDR video recording mode is used last time, acquiring a second exposure value and a third exposure value corresponding to the HDR video recording mode used last time, wherein the second exposure value is an exposure value used for long exposure, and the third exposure value is an exposure value used for short exposure;

setting an initial value of an exposure value for long exposure as the second exposure value and setting an initial value of an exposure value for short exposure as the third exposure value;

adjusting the exposure value for long exposure and the exposure value for short exposure from an initial value one by one, and recording a video clip with HDR effect according to the adjusted exposure value for long exposure and the adjusted exposure value for short exposure, wherein the adjusted exposure value for long exposure and the adjusted exposure value for short exposure gradually approach to a first exposure value until the adjusted exposure value for long exposure and the adjusted exposure value for short exposure both become the first exposure value;

and recording the video segments in the non-HDR video recording mode after the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure are changed into the first exposure value.

In one embodiment, the first recording module 303 may be configured to:

when the HDR video recording mode is detected to be needed, acquiring information whether the HDR video recording mode is needed or not, which is obtained by last detection;

if the non-HDR video recording mode is used last time, obtaining a first HDR score of the reference image determined this time, wherein the HDR score of the image is used for representing the dynamic range of the image, and the higher the HDR score is, the larger the dynamic range of the image is;

obtaining a fourth exposure value for a long exposure and a fifth exposure value for a short exposure corresponding to the first HDR score;

and recording the video segment with HDR effect by the HDR video recording mode according to the fourth exposure value and the fifth exposure value.

In one embodiment, the first recording module 303 may be configured to:

acquiring a first exposure value, wherein the first exposure value is an exposure value corresponding to a non-HDR video recording mode;

setting an initial value of each of an exposure value for long exposure and an exposure value for short exposure to the first exposure value;

and adjusting the exposure value for long exposure and the exposure value for short exposure from an initial value one by one, and recording a video clip with HDR effect according to the adjusted exposure value for long exposure and the adjusted exposure value for short exposure, wherein the adjusted exposure value for long exposure gradually approaches the fourth exposure value, the adjusted exposure value for short exposure gradually approaches the fifth exposure value until the adjusted exposure value for long exposure reaches the fourth exposure value, and the adjusted exposure value for short exposure reaches the fifth exposure value.

In an embodiment, the first recording module 303 may be further configured to:

if the HDR video recording mode is used last time, acquiring a first HDR score of the reference image determined this time and a second HDR score of the reference image determined last time;

if the difference value of the first HDR score and the second HDR score is larger than a preset score difference value, acquiring a sixth exposure value and a seventh exposure value corresponding to the first HDR score, wherein the sixth exposure value is an exposure value for long exposure, and the seventh exposure value is an exposure value for short exposure;

recording a video segment with HDR effect by the HDR video recording mode according to the sixth exposure value and the seventh exposure value.

In one embodiment, the first recording module 303 may be configured to:

determining the exposure value currently used for the long exposure as an eighth exposure value and determining the exposure value currently used for the short exposure as a ninth exposure value;

setting an initial value of an exposure value for long exposure as the eighth exposure value, and setting an initial value of an exposure value for short exposure as the ninth exposure value;

and adjusting the exposure value for long exposure and the exposure value for short exposure from an initial value one by one, and recording a video clip with HDR effect according to the adjusted exposure value for long exposure and the adjusted exposure value for short exposure, wherein the adjusted exposure value for long exposure gradually approaches the sixth exposure value, the adjusted exposure value for short exposure gradually approaches the seventh exposure value until the adjusted exposure value for long exposure reaches the sixth exposure value, and the adjusted exposure value for short exposure reaches the seventh exposure value.

In one embodiment, the first recording module 303 may be configured to:

if the difference value of the first HDR score and the second HDR score is smaller than or equal to a preset score difference value, recording a video segment with HDR effect through the HDR video recording mode according to the exposure value currently used for long exposure and the exposure value currently used for short exposure.

The present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed on a computer, the computer is caused to execute the procedures in the method provided by the present embodiment.

The embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the processor is configured to execute the flow in the image processing method provided in this embodiment by calling the computer program stored in the memory.

For example, the electronic device may be a mobile terminal such as a tablet computer or a smart phone. Referring to fig. 7, fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

The electronic device 400 may include a camera module 401, a memory 402, a processor 403, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 7 does not constitute a limitation of the electronic device and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

The camera module 401 can be used to capture images, such as previewing or taking pictures or recording videos.

The memory 402 may be used to store applications and data. The memory 402 stores applications containing executable code. The application programs may constitute various functional modules. The processor 403 executes various functional applications and data processing by running an application program stored in the memory 402.

The processor 403 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing an application program stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device.

In this embodiment, the processor 403 in the electronic device loads the executable code corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 403 runs the application programs stored in the memory 402, so as to execute:

Referring to fig. 8, the electronic device 400 may include a camera module 401, a memory 402, a processor 403, an input unit 404, an output unit 405, a speaker 406, and other components.

The input unit 404 may be used to receive input numbers, character information, or user characteristic information, such as a fingerprint, and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

The output unit 405 may be used to display information input by or provided to a user and various graphical user interfaces of the electronic device, which may be made up of graphics, text, icons, video, and any combination thereof. The output unit may include a display panel.

The speaker 406 may be used to play sound signals.

Furthermore, the electronic device may also include components such as a battery, a microphone, and the like. The battery is used to supply power to the various modules of the electronic device and the microphone may be used to pick up sound signals in the surrounding environment.

In one embodiment, the processor 403 may perform, each time a reference image is acquired and whether the HDR video recording mode is required to be used in a video recording scene is detected according to the reference image, the following steps: every time a reference image is acquired, acquiring a first pixel number of which the brightness value is greater than or equal to a preset first brightness threshold value, a second pixel number of which the brightness value is less than or equal to a preset second brightness threshold value, and brightness median values and brightness mean values of all pixels in the reference image, wherein the preset first brightness threshold value is greater than the second brightness threshold value; if the first pixel quantity is larger than or equal to a preset first value, determining that the HDR video recording mode is required to be used in a video recording scene; or if the second pixel number is greater than or equal to a preset second value, determining that the HDR video recording mode is required to be used in the video recording scene; or if the difference value between the brightness median value and the brightness mean value is greater than a preset brightness difference value, determining that the HDR video recording mode is required to be used in a video recording scene.

In one embodiment, the processor 403 may execute the following steps when recording the video segment in the non-HDR video recording mode when detecting that the HDR video recording mode is not required to be used: when detecting that the HDR video recording mode is not needed, acquiring a first exposure value corresponding to the non-HDR video recording mode; and recording the video segment through a non-HDR video recording mode according to the first exposure value.

In one embodiment, the processor 403 may execute, when recording the video segment in the non-HDR video recording mode according to the first exposure value, the following steps: acquiring information whether the HDR video recording mode needs to be used or not, which is obtained by the last detection; if the HDR video recording mode is used last time, acquiring a second exposure value and a third exposure value corresponding to the HDR video recording mode used last time, wherein the second exposure value is an exposure value used for long exposure, and the third exposure value is an exposure value used for short exposure; setting an initial value of an exposure value for long exposure as the second exposure value and setting an initial value of an exposure value for short exposure as the third exposure value; adjusting the exposure value for long exposure and the exposure value for short exposure from an initial value one by one, and recording a video clip with HDR effect according to the adjusted exposure value for long exposure and the adjusted exposure value for short exposure, wherein the adjusted exposure value for long exposure and the adjusted exposure value for short exposure gradually approach to a first exposure value until the adjusted exposure value for long exposure and the adjusted exposure value for short exposure both become the first exposure value; and recording the video segments in the non-HDR video recording mode after the adjusted exposure value for the long exposure and the adjusted exposure value for the short exposure are changed into the first exposure value.

In one embodiment, the processor 403 may execute, when detecting that the HDR video recording mode is required to be used, recording a video segment with HDR effect by using the HDR video recording mode, to: when the HDR video recording mode is detected to be needed, acquiring information whether the HDR video recording mode is needed or not, which is obtained by last detection; if the non-HDR video recording mode is used last time, obtaining a first HDR score of the reference image determined this time, wherein the HDR score of the image is used for representing the dynamic range of the image, and the higher the HDR score is, the larger the dynamic range of the image is; obtaining a fourth exposure value for a long exposure and a fifth exposure value for a short exposure corresponding to the first HDR score; and recording the video segment with HDR effect by the HDR video recording mode according to the fourth exposure value and the fifth exposure value.

In an embodiment, when the processor 403 executes the recording of the video segment with HDR effect by the HDR video recording mode according to the fourth exposure value and the fifth exposure value, it may execute: acquiring a first exposure value, wherein the first exposure value is an exposure value corresponding to a non-HDR video recording mode; setting an initial value of each of an exposure value for long exposure and an exposure value for short exposure to the first exposure value; and adjusting the exposure value for long exposure and the exposure value for short exposure from an initial value one by one, and recording a video clip with HDR effect according to the adjusted exposure value for long exposure and the adjusted exposure value for short exposure, wherein the adjusted exposure value for long exposure gradually approaches the fourth exposure value, the adjusted exposure value for short exposure gradually approaches the fifth exposure value until the adjusted exposure value for long exposure reaches the fourth exposure value, and the adjusted exposure value for short exposure reaches the fifth exposure value.

In an embodiment, after obtaining the information of whether the HDR video recording mode is required to be used, which is obtained last time when the HDR video recording mode is detected to be required to be used, the processor 403 may further perform: if the HDR video recording mode is used last time, acquiring a first HDR score of the reference image determined this time and a second HDR score of the reference image determined last time; if the difference value of the first HDR score and the second HDR score is larger than a preset score difference value, acquiring a sixth exposure value and a seventh exposure value corresponding to the first HDR score, wherein the sixth exposure value is an exposure value for long exposure, and the seventh exposure value is an exposure value for short exposure; recording a video segment with HDR effect by the HDR video recording mode according to the sixth exposure value and the seventh exposure value.

In one embodiment, the processor 403 may execute, when recording the video segment with HDR effect in the HDR video recording mode according to the sixth exposure value and the seventh exposure value, the following steps: determining the exposure value currently used for the long exposure as an eighth exposure value and determining the exposure value currently used for the short exposure as a ninth exposure value; setting an initial value of an exposure value for long exposure as the eighth exposure value, and setting an initial value of an exposure value for short exposure as the ninth exposure value; and adjusting the exposure value for long exposure and the exposure value for short exposure from an initial value one by one, and recording a video clip with HDR effect according to the adjusted exposure value for long exposure and the adjusted exposure value for short exposure, wherein the adjusted exposure value for long exposure gradually approaches the sixth exposure value, the adjusted exposure value for short exposure gradually approaches the seventh exposure value until the adjusted exposure value for long exposure reaches the sixth exposure value, and the adjusted exposure value for short exposure reaches the seventh exposure value.

In one embodiment, processor 403 may further perform: if the difference value of the first HDR score and the second HDR score is smaller than or equal to a preset score difference value, recording a video segment with HDR effect through the HDR video recording mode according to the exposure value currently used for long exposure and the exposure value currently used for short exposure.

In the above embodiments, the descriptions of the embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed description of the image processing method, and are not described herein again.

The image processing apparatus provided in the embodiment of the present application and the image processing method in the above embodiment belong to the same concept, and any method provided in the embodiment of the image processing method may be run on the image processing apparatus, and a specific implementation process thereof is described in the embodiment of the image processing method in detail, and is not described herein again.

It should be noted that, for the image processing method described in the embodiment of the present application, it can be understood by those skilled in the art that all or part of the process of implementing the image processing method described in the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, where the computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor, and during the execution, the process of the embodiment of the image processing method can be included. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.

In the image processing apparatus according to the embodiment of the present application, each functional module may be integrated into one processing chip, each module may exist alone physically, or two or more modules may be integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.

The foregoing detailed description has provided an image processing method, an image processing apparatus, a storage medium, and an electronic device according to embodiments of the present application, and specific examples are applied herein to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An image processing method, comprising:

when the HDR video recording mode is detected to be needed, acquiring information whether the HDR video recording mode is needed or not, which is obtained by last detection; if the non-HDR video recording mode is used last time, obtaining a first HDR score of the reference image determined this time, wherein the HDR score of the image is used for representing the dynamic range of the image, and the higher the HDR score is, the larger the dynamic range of the image is; obtaining a fourth exposure value for a long exposure and a fifth exposure value for a short exposure corresponding to the first HDR score; recording a video segment with HDR effect by the HDR video recording mode according to the fourth exposure value and the fifth exposure value;

2. The image processing method according to claim 1, wherein the detecting whether the video recording scene needs to use the HDR video recording mode according to the reference image each time the reference image is acquired comprises:

3. The image processing method of claim 1, wherein when it is detected that the HDR video recording mode is not required, recording the video segment in the non-HDR video recording mode comprises:

4. The image processing method according to claim 3, wherein said recording a video segment in a non-HDR video recording mode according to the first exposure value comprises:

5. The image processing method according to claim 1, wherein said recording a video segment with HDR effect by the HDR video recording mode according to the fourth exposure value and the fifth exposure value comprises:

6. The image processing method according to claim 1, wherein after the obtaining information of whether the HDR video recording mode is required or not detected last time when the HDR video recording mode is detected to be required, the method further comprises:

7. The image processing method according to claim 6, wherein said recording a video segment with HDR effect by the HDR video recording mode according to the sixth exposure value and the seventh exposure value comprises:

8. The image processing method according to claim 6, characterized in that the method further comprises:

9. An image processing apparatus characterized by comprising:

the first recording module is used for acquiring information whether the HDR video recording mode needs to be used or not, wherein the information is acquired by last detection when the HDR video recording mode needs to be used; if the non-HDR video recording mode is used last time, obtaining a first HDR score of the reference image determined this time, wherein the HDR score of the image is used for representing the dynamic range of the image, and the higher the HDR score is, the larger the dynamic range of the image is; obtaining a fourth exposure value for a long exposure and a fifth exposure value for a short exposure corresponding to the first HDR score; recording a video segment with HDR effect by the HDR video recording mode according to the fourth exposure value and the fifth exposure value;

10. A computer-readable storage medium, on which a computer program is stored, which, when executed on a computer, causes the computer to carry out the method according to any one of claims 1 to 8.

11. An electronic device comprising a memory, a processor, wherein the processor is configured to perform the method of any one of claims 1 to 8 by invoking a computer program stored in the memory.