WO2016044983A1

WO2016044983A1 - Image processing method and apparatus and electronic device

Info

Publication number: WO2016044983A1
Application number: PCT/CN2014/087131
Authority: WO
Inventors: 朱聪超; 罗巍
Original assignee: 华为技术有限公司
Priority date: 2014-09-22
Filing date: 2014-09-22
Publication date: 2016-03-31

Abstract

Disclosed are an image processing method and apparatus and an electronic device, which are used to solve the technical problem of poor display quality of a region of interest image of a user. The image processing method comprises: determining a region of interest (ROI) image of a user from a displayed image; processing the dynamic range of the ROI image so that the display quality of the obtained processed image is better than the display quality of the ROI image; and displaying the processed image.

Description

Image processing method, device and electronic device

Technical field

The present invention relates to the field of image processing, and in particular, to an image processing method, apparatus, and electronic device.

Background technique

The ratio of the maximum value to the minimum value of the brightness of the visible area of the image is the dynamic range of the image (Dynamic Range). If the dynamic range of the image is too small, the details of the dark or bright areas of the image will be lost, resulting in poorer image quality.

In the prior art, when an electronic device displays an image, the dynamic range of the image is fixed without artificial editing of the image, and the difference between the pixels in the image is fixed. In the actual situation, the user often only views the image of one area in the whole image. We can think that the area is the area of interest to the user, and define the area image as the Region Of Interest (ROI) image of the user. The user can enlarge the image to display only the ROI image. In this case, although the ROI image is enlarged, the brightness value of each pixel in the ROI image is constant, and the relative brightness between the pixels is not As a result, the dynamic range of the ROI image has not been improved and the display quality is poor.

Summary of the invention

The embodiment of the present application provides an image processing method, device, and electronic device for solving the problem of poor display quality of a ROI image of a user's region of interest.

In a first aspect, an embodiment of the present application provides an image processing method, where the method includes:

Determining an ROI image of a region of interest of the user from the display image;

Performing dynamic range processing on the ROI image, and obtaining a display quality of the processed image is better than a display quality of the ROI image;

The processed image is displayed.

With reference to the first aspect, in a first possible implementation manner of the first aspect, the display image is a low dynamic range image LDRI compressed by a high dynamic range image HDRI, and the dynamic range of the ROI image is performed Processing, including:

Determining an area image corresponding to the ROI image position in the HDRI;

And performing dynamic range compression on the determined area image, and the obtained compressed image is used as the processed image, and the dynamic range of the compressed image is greater than or equal to a dynamic range of the ROI image.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, determining, by the user, the area of interest ROI image from the display image includes:

A user operation is detected, and the ROI image is determined from the display image according to the user operation.

In conjunction with the second possible implementation of the first aspect, in a third possible implementation of the first aspect, detecting a user operation, determining the ROI image from the display image according to the user operation, including :

Detecting the user operation, determining that an image portion corresponding to the user operation in the display image is the ROI image, and the user operation includes any one of a zoom operation, a drag operation, and a selection operation.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, determining, by the user, the area of interest ROI image from the display image includes:

Determining that the image portion of the display image including the preset feature image is the ROI image.

In a second aspect, an embodiment of the present application provides an image processing method, where the method includes:

Determining a user region ROI image on each of the at least two frames of images when displaying the first frame image of the at least two frames of images for the same scene;

Determining whether there is a second frame image in the at least two frames of images, and the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image;

If present, switching from displaying the first frame image to displaying the ROI image in the second frame image.

In conjunction with the second aspect, in a first possible implementation of the second aspect, an exposure time of any two of the at least two frames of images is different.

With reference to the second aspect, in a second possible implementation manner of the second aspect, determining a ROI image of the user region of interest on each of the at least two frames of images includes:

Detecting a user operation, determining an ROI image on each of the at least two frames of images according to the user operation; or

Determining, in each of the at least two frames of images, an image portion including a preset feature image as an ROI image.

With reference to the second possible implementation of the second aspect, in a third possible implementation manner of the second aspect, detecting a user operation, determining, according to the user operation, each frame image of the at least two frames of images ROI images, including:

Detecting the user operation, determining that an image portion corresponding to the user operation in the first frame image is an ROI image of the first frame image; and the user operation includes a zoom operation, a drag operation, and a selection operation Any kind of operation;

Determining, in each frame other than the first frame image, the area image corresponding to the ROI image position in the first frame image in the at least two frames of images is an ROI image.

In a third aspect, an embodiment of the present application provides an image processing apparatus, including:

a determining module, configured to determine a ROI image of the user's region of interest from the display image;

An image processing module, configured to perform dynamic range processing on the ROI image, and obtain a display quality of the processed image that is better than a display quality of the ROI image;

a display module for displaying the processed image.

With reference to the third aspect, in a first possible implementation manner of the third aspect, the display image is a low dynamic range image LDRI compressed by a high dynamic range image HDRI, and the image processing module is specifically configured to: determine And outputting an area image corresponding to the location of the ROI image in the HDRI; and performing dynamic range compression on the determined area image, and obtaining a compressed image as the processed image, where a dynamic range of the compressed image is greater than Or equal to the dynamic range of the ROI image.

With reference to the third aspect, or the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the determining module is specifically configured to: detect a user operation, according to the user operation The ROI image is determined on the display image.

In conjunction with the second possible implementation of the third aspect, in a third possible implementation manner of the third aspect, the determining module is specifically configured to: detect the user operation, determine a location in the display image The image portion corresponding to the user operation is the ROI image, and the user operation includes any one of a zoom operation, a drag operation, and a selected operation.

With the third aspect or the first possible implementation manner of the third aspect, in a fourth possible implementation manner of the third aspect, the determining module is specifically configured to: determine that the display image includes a preset feature image The image portion is the ROI image.

In a fourth aspect, an embodiment of the present application provides an image processing apparatus, including:

a determining module, configured to determine a ROI image of a user region of interest on each of the at least two frames of images when displaying the first frame image of the at least two frames of images for the same scene;

a determining module, configured to determine whether there is a second frame image in the at least two frames of images, where the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image;

And a display module, configured to switch from displaying the first frame image to displaying an ROI image in the second frame image when the second frame image is present.

In conjunction with the fourth aspect, in a first possible implementation manner of the fourth aspect, an exposure time of any two of the at least two frames of images is different.

With reference to the fourth aspect, in a second possible implementation manner of the fourth aspect, the determining module is specifically configured to: detect a user operation, and determine, according to the user operation, each frame image of the at least two frames of images The ROI image; or determining that the image portion of the at least two frames of the image including the preset feature image is an ROI image.

With reference to the second possible implementation manner of the fourth aspect, in a third possible implementation manner of the fourth aspect, the determining module is specifically configured to: detect the user operation, determine that the first frame image is The image portion corresponding to the user operation is an ROI image of the first frame image; The user operation includes any one of a zoom operation, a drag operation, and a selected operation; and is configured to determine an image of the first frame in each frame except the first frame image in the at least two frames of images The area image corresponding to the ROI image position in the middle is an ROI image.

In a fifth aspect, an embodiment of the present application provides an electronic device, including:

a memory for storing instructions;

a processor, configured to execute the instruction, determine a ROI image of a region of interest of the user from the display image; perform dynamic range processing on the ROI image, and obtain a display quality of the processed image that is better than display of the ROI image Quality; display the processed image;

An output device for displaying an image according to an indication of the processor.

With reference to the fifth aspect, in a first possible implementation manner of the fifth aspect, the display image is a low dynamic range image LDRI compressed by a high dynamic range image HDRI, and the processor is configured to use the ROI image Performing dynamic range processing, specifically: determining an area image corresponding to the ROI image position in the HDRI; performing dynamic range compression on the determined area image, and obtaining the compressed image as the processed image, The dynamic range of the compressed image is greater than or equal to the dynamic range of the ROI image.

With reference to the fifth aspect, or the first possible implementation manner of the fifth aspect, in a second possible implementation manner of the fifth aspect, the processor is configured to determine, by using a display image, a ROI image of a user's region of interest, specifically To: detect a user operation, and determine the ROI image from the display image according to the user operation.

With reference to the second possible implementation manner of the fifth aspect, in a third possible implementation manner of the fifth aspect, the processor is configured to detect a user operation, and determine, according to the user operation, the display image The ROI image is specifically configured to: detect the user operation, determine that an image portion corresponding to the user operation in the display image is the ROI image, and the user operation includes a zoom operation, a drag operation, and a selection operation. Any kind of operation.

With reference to the fifth aspect, or the first possible implementation manner of the fifth aspect, in a fourth possible implementation manner of the fifth aspect, the processor is configured to determine, by using a display image, a ROI image of a user's region of interest, specifically a method for determining that an image portion of the display image that includes a preset feature image is The ROI image is described.

In a sixth aspect, an embodiment of the present application provides an electronic device, including:

a memory for storing instructions;

a processor, configured to execute, when displaying the first frame image of the at least two frames of images for the same scene, determining a ROI image of the user region of interest on each of the at least two frames of images; Determining whether there is a second frame image in the at least two frames of images, wherein the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image; if present, Displaying that the first frame image is switched to display an ROI image in the second frame image;

In conjunction with the sixth aspect, in a first possible implementation manner of the sixth aspect, an exposure time of any two of the at least two frames of images is different.

With reference to the sixth aspect, in a second possible implementation manner of the sixth aspect, the processor is configured to determine a ROI image of a user region of interest on each of the at least two frames of images, specifically: detecting a user operation, determining, according to the user operation, an ROI image on each of the at least two frames of images; or determining that an image portion of each of the at least two frames of images that includes the preset feature image is ROI image.

With reference to the second possible implementation manner of the sixth aspect, in a third possible implementation manner of the sixth aspect, the processor is specifically configured to detect a user operation, and determine the at least two frames of images according to the user operation The ROI image on each frame of the image is specifically: detecting the user operation, determining that the image portion corresponding to the user operation in the first frame image is an ROI image of the first frame image; The user operation includes any one of a zoom operation, a drag operation, and a selected operation; determining an ROI in each frame other than the first frame image and the first frame image in the at least two frames of images The area image corresponding to the image position is an ROI image.

One or more technical solutions provided in the application embodiments have at least the following technical effects or advantages:

In the embodiment of the present application, the electronic device can determine the ROI image in the display image and compare the ROI The image is subjected to dynamic range processing. Since the obtained dynamic range of the processed image is larger, or the brightness value of the pixel in the processed image is more reasonable, the display quality of the processed image is superior to the ROI image in the LDRI. The user can view an image of a region of interest that displays better quality.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention, Those skilled in the art can also obtain other drawings based on these drawings without paying for inventive labor.

1 is a schematic diagram of main processes of an image processing method in Embodiment 1 of the present application;

2 is a schematic diagram of a refinement process of an image processing method in Embodiment 1 of the present application;

3 is a schematic flowchart of another refinement of an image processing method in Embodiment 1 of the present application;

4 is a schematic flowchart of application example 1 in an embodiment of the present application;

5 is a schematic flowchart of an image processing method in Embodiment 2 of the present application;

FIG. 6 is a schematic flowchart of application example 2 in an embodiment of the present application;

7 is a schematic block diagram showing the structure of an image processing apparatus in Embodiment 3 of the present application;

8 is a schematic block diagram showing the structure of an image processing apparatus according to Embodiment 4 of the present application;

9 is a schematic block diagram showing the main structure of an electronic device in Embodiment 5 of the present application;

10 is a schematic block diagram showing a detailed structure of an electronic device in Embodiment 5 of the present application;

11 is a schematic block diagram showing the main structure of an electronic device in Embodiment 6 of the present application;

FIG. 12 is a schematic block diagram showing the detailed structure of an electronic device in Embodiment 6 of the present application.

detailed description

Before the technical solutions in the embodiments of the present application are specifically described, in order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the related technologies will be described below.

At present, the dynamic range of display devices is very small, generally around 100:1, even so-called high dynamics The range display device has a dynamic range of only 500:1, while the High Dynamic Range Imaging (HDRI) has a dynamic range of 216:1. Therefore, to display the HDRI on the display device, dynamic range compression of the HDRI is required to obtain a Low Dynamic Range Imaging (LDRI) that the display device can display.

The hHDR mapping technique is usually used to compress the HDRI into LDRI. The gradation mapping technology specifically includes a global mapping algorithm and a local mapping algorithm. Among them, the global mapping algorithm treats the entire HDRI image as a whole, and uses the same luminance mapping for each pixel, and can be divided into a linear mapping algorithm and a nonlinear mapping algorithm. The local mapping algorithm should take into account the positional features of the pixels and the influence between the pixels, and take different treatments for the pixels in different regions.

When using hue mapping technology to compress HDRI into LDRI, the display quality of the whole image is considered. Therefore, the gradation mapping algorithm used is for the whole image, and there is no image specifically for the user's region of interest in the image. Therefore, the image of the user's region of interest in the HDRI has a low display quality of the compressed image obtained under the gradation mapping algorithm.

Moreover, when the user only views the ROI image in the LDRI by enlarging the image operation, although the ROI image is enlarged, the luminance value of each pixel in the ROI image is constant, and the relative brightness between the pixels is also unchanged. The dynamic range of the ROI image has not been improved, and the display quality of the ROI image is not good.

For example, when the display device displays the brightness of an image with 8-bit data, the brightness value of the pixel having the highest brightness in the displayed LDRI is 255, and the brightness value of the pixel having the smallest brightness is 0. The luminance value of the pixel with the highest brightness in the ROI image of the user in the LDRI is 200, and the brightness value of the pixel with the smallest brightness is 50, and the dynamic range of the ROI image is only 200:50. When the user enlarges the display area of the ROI image, the brightness value of the pixel in the ROI image remains unchanged, and the dynamic range of the ROI image remains unchanged, at a small level, less than the dynamic range that the display device can display, and the ROI image. The display quality is not high.

An embodiment of the present application provides an image processing method, after determining an ROI image that is of interest to a user from a display image, performing dynamic range processing on the ROI image, so that the dynamic range of the processed image is improved, or The brightness value of the image is more reasonable, and the ROI image is improved. Quality is displayed to meet the needs of users to view ROI images with high display quality.

The technical solutions of the present invention are described in detail below with reference to the accompanying drawings and specific embodiments. It is understood that the specific features of the embodiments and the embodiments of the present invention are a detailed description of the technical solutions of the present invention, and are not limited to the technical solutions of the present invention. In the case of no conflict, the technical features in the embodiments of the present application and the embodiments may be combined with each other.

Example 1

FIG. 1 is a schematic flowchart diagram of an image processing method according to Embodiment 1 of the present application, where the process includes the following steps:

Step 101: Determine a ROI image of a region of interest of the user from the display image.

Step 102: Perform dynamic range processing on the ROI image, and obtain a display quality of the processed image that is better than a display quality of the ROI image.

Step 103: Display the processed image.

Specifically, the image processing method in the embodiment of the present application is applicable to an electronic device having a display unit and capable of displaying an image, such as a digital camera, a smart phone, a tablet computer, a notebook computer, a smart watch, a smart TV, and the like.

In step 101, the electronic device may determine the ROI image from the displayed image in various manners, including but not limited to the following manners:

Mode 1, detecting a user operation, and determining an ROI image from the display image according to a user operation.

When the electronic device displays an image, the user can operate on the image, and after detecting the user operation, the electronic device determines that the image portion corresponding to the user operation in the display image is an ROI image, wherein the user operation may include a zoom operation, Drag operation, select any one of the operations.

The corresponding situations for the above several user operations are described below.

(1) The scaling operation and the corresponding situation of the drag operation.

When the electronic device displays an image, the user can perform an enlargement operation on the image, and the electronic device, in response to the zooming operation, displays an image of a partial region in the currently displayed image, which is a local region to be displayed in response to the zoom-in operation. The image corresponds to the user's zoom operation ROI image.

Similarly, when the electronic device displays the first partial area image of an image, the user may perform an enlargement operation on the image, and the electronic device displays an image of a partial area in the first partial area image in response to the zooming operation. The image of the local area to be displayed in response to the enlargement operation is the ROI image corresponding to the user's enlargement operation.

Correspondingly, when the electronic device displays the first partial area image of an image, the user may perform a zoom-out operation on the image, and the electronic device, in response to the zoom-out operation, displays the second image in the electronic device including the first partial area image. Partial area image or whole image (when the reduction operation is sufficiently large, the electronic device will display the entire image in response to the reduction operation), the second partial area image or the entire image to be displayed in response to the reduction operation This is the ROI image corresponding to the user's zoom out operation.

When the electronic device displays an image that is enlarged to a certain ratio, the display screen only displays the first partial region image of the entire image, and the user can perform a drag operation on the image, and the electronic device responds to the drag operation. The current zoom ratio is maintained, and the first partial area image is switched to display the second partial area image. The second partial area to be displayed in response to the drag operation is the ROI image corresponding to the user drag operation.

In summary, when an electronic device displays an image, if the user performs a zoom operation or a drag operation on the image, the electronic device displays an area image in the entire image on the display screen in response to the user operation (wherein When the user performs a reduction operation with a sufficiently large reduction, the electronic device will display the entire image), and the ROI image is the image of the area to be displayed.

In the embodiment of the present application, the zoom operation and the drag operation are specifically limited by the user, which may be a method of touching a touch screen or a touch panel, or an external input device such as a mouse or a somatosensory device. the way. For example, for the zoom operation, it can be realized by scrolling the mouse wheel, or by changing the distance between the touch points when the touch screen is touched at two points; for the drag operation, by moving the mouse when the left button is pressed, It can be realized by moving the touch point when single-touching.

(2) Select the corresponding situation of the operation.

When the electronic device displays an image, the user can perform a selection operation to make a partial region image in the image in a selected state, and the image portion in the selected state is an ROI image corresponding to the selected state.

In the embodiment of the present application, the manner in which the user specifically performs the selection operation is not limited, and the method may be a manner in which the user touches the touch screen or the touch panel, or may be an external input device such as a mouse or a somatosensory device.

For example, the user can use a mouse movement or a finger to slide on the touch screen to form a closed trajectory, and the electronic device causes the image portion within the closed trajectory to be in a selected state.

Alternatively, when the user draws a closed trajectory or a semi-closed trajectory on the image, the electronic device can combine the image analysis technology to determine the image body of the enclosed trajectory or the area enclosed by the semi-closed trajectory, so that the image body is in the selected state. For example, an image includes a person and a cat, and the user draws a semi-closed circular trajectory in the image of the cat, and the graphic analysis module of the electronic device determines that the image body included in the trajectory is a cat corresponding The image portion, therefore, even if a part of the cat's image is outside the trajectory, and the trajectory may include an image of an object other than the cat image, the electronic device can still determine that the image subject for the user operation is a cat corresponding The image is such that the corresponding image portion of the cat is selected.

Similarly, the user can also perform long-pressing operations such as long-pressing operations and double-click operations on an image subject in the image, and the electronic device can determine the image body targeted by the user operation by using image analysis technology, so that the image portion of the image body is selected. status.

How to use the image analysis technology to determine the image body for the user operation in the image can also refer to the prior art. The embodiments of the present application are not described in detail herein.

Mode 2, the electronic device automatically recognizes the ROI image.

Using the image recognition technology, the electronic device can recognize the preset feature image included in the current display image, and determine that the image portion of the display image that includes the preset feature image is an ROI image. For example, the electronic device recognizes that the image includes the person image by using image recognition technology, and further determines that the image portion including the person is an ROI image. In the embodiment of the present application, the specific content of the preset feature image is not limited, and may be an image of a person, an image of an animal, a facial image of a person, a scene image, and a text. The image of the word, etc., can be personalized according to the user's actual needs and usage habits.

In addition, in the embodiment of the present application, the electronic device automatically recognizes that the ROI image in the current display image may be automatically performed by the electronic device when displaying the current image, or may perform the recognition after acquiring the trigger instruction of the user, and the triggering instruction may be The embodiment of the present application is not limited by the virtual button generated by the user touching the display screen, or the physical button on the electronic device is generated, or the electronic device is generated by shaking or shaking.

Specifically, in step 102, after determining the ROI image on the display image, the electronic device performs dynamic range processing on the ROI image, and the brightness value of the pixel in the processed image is more reasonable, and the display quality of the image is relative to the processing. The previous ROI image will be improved.

The embodiments of the present application provide two ways to process the dynamic range of the ROI image to obtain an image of a user's sensing area with better display quality, as follows:

In the first method, the ROI image is directly subjected to dynamic range expansion processing.

Specifically, when the ROI image is dynamically expanded, the brightness value of the brightest pixel in the processed image is greater than the brightness value of the brightest pixel in the ROI image, or the darkest pixel in the processed image is made. The brightness value is smaller than the brightness value of the darkest pixel point in the ROI image, or even the bright part of the ROI image is brighter, and the dark part of the ROI image is darker, so that the dynamic range of the processed image will be larger than the ROI image in the LDRI image. Dynamic range.

Preferably, the brightness value of the pixel with the highest brightness in the ROI image is increased to the maximum brightness value that the display screen can display, and the brightness value of the pixel with the smallest brightness in the ROI image is reduced to the minimum displayable by the display screen. The brightness value, the brightness value of the pixel between the brightest point and the darkest point in the ROI is correspondingly changed.

In this embodiment of the present application, the same luminance mapping may be used for each pixel in the ROI image, specifically including a linear mapping and a nonlinear mapping. In addition, different brightness mappings can be performed on pixel points located at different positions in combination with the positional parameters of the pixel points, so that the brightness value of the pixel points in the processed image is more reasonable and the display effect is better.

By performing dynamic range expansion processing on the ROI image, the dynamic range of the processed image becomes larger, the light and dark details of the image are more abundant, and the display quality is improved.

In the second mode, when the currently displayed image is an LDRI compressed by HDRI, the dynamic range compression is re-based based on the HDRI.

Specifically, referring to FIG. 2, step 102: performing dynamic range processing on the ROI image, and the obtained display image has better display quality than the ROI image display quality, and includes the following steps in the process of performing:

Step 1021: Determine an area image corresponding to the ROI image position in the HDRI.

Specifically, since the LDRI is compressed by the HDRI, the image regions corresponding to the positions of the LDRI and the HDRI correspond to the same scene in the real world. When the step 1021 is implemented, the electronic device first acquires a position parameter of the ROI image in the LDRI, and then maps the position parameter to the HDRI, thereby determining an area image corresponding to the ROI image position in the HDRI.

In addition, in the embodiment of the present application, the HDRI may be an image collected by another device stored locally by the electronic device, or may be collected by the electronic device itself; when the electronic device itself is collected, multiple frames of different exposure images may be used for fusion. You can use the direct acquisition method of dedicated hardware.

Step 1022: Perform dynamic range compression on the determined area image, and obtain the compressed image as the processed image, and the dynamic range of the compressed image is greater than or equal to the dynamic range of the ROI image in the LDRI.

Specifically, the electronic device performs dynamic range compression on the determined region image corresponding to the ROI image position in the HDRI to obtain a compressed image, and the dynamic range of the compressed image is greater than or equal to the dynamic range of the ROI image.

First, the dynamic range of the compressed image is greater than the dynamic range of the ROI image, including the following three cases: the brightness value of the brightest pixel of the compressed image is greater than the brightness value of the brightest pixel in the ROI image, or the darkest pixel of the compressed image. The brightness value is less than the brightness value of the darkest pixel point in the ROI image, or both of the above conditions are met. When the dynamic range of the compressed image is larger than the dynamic range of the ROI image, the brightness and darkness of the compressed image will be richer and the display quality will be higher than that of the ROI image.

For example, when the display device displays the brightness of an image with 8-bit data, the brightness value of the pixel having the highest brightness in the displayed LDRI is 255, and the brightness value of the pixel having the smallest brightness is 0. The brightness of the pixel with the highest brightness in the ROI image of interest to the user in the LDRI is 200, and the image with the smallest brightness If the luminance value of the prime point is 50, the dynamic range of the ROI image is only 200:50. When step 1022 is performed, the area image is compressed into a compressed image by using a global mapping algorithm, and the brightness value of the brightest pixel of the area image is 255, and the brightness value of the darkest pixel in the area image is 0, and the area image is The brightness of the pixel between the brightest pixel and the darkest pixel is between 0 and 255. In actual cases, the luminance value in the area image is close to the brightest pixel due to the compression of the luminance value range. The brightness value of some pixels after compression may be the same as 255. Similarly, the brightness value of the partial pixel of the area image with the brightness value close to the darkest pixel may be 0). The dynamic range of the compressed image obtained in step 1022 is 256:1, which is much larger than the dynamic range of the ROI image in the LDRI, and the display quality of the compressed image is better than the display quality of the ROI image.

Secondly, since the step 1022 performs dynamic range compression on the region image in the HDRI, the image compression gradation mapping algorithm is determined for the region image, and the algorithm is more targeted, and the obtained luminance value distribution of the pixel in the compressed image is more reasonable. . When the HDRI is compressed into LDRI, the compression algorithm is determined according to the display quality of the entire image, and the appropriate algorithm is not specifically selected for the region image in the HDRI, so the display quality of the obtained ROI image in the LDRI does not reach the step 1022. The display quality of the compressed image obtained in .

Preferably, the dynamic range of the compressed image obtained in step 1022 is the maximum dynamic range that the display device can respond to, so that the compressed image presents as detailed detail as possible, providing the user with an image of the region of interest with excellent display quality.

The specific compression algorithm for compressing the area image in the HDRI into a compressed image is also not limited in the embodiment of the present application, and may be a global mapping algorithm or a local mapping algorithm. In addition, the compression algorithm may be the same as or different from the algorithm for compressing HDRI into LDRI.

Specifically, in step 103, when displaying the processed image, the electronic device may display in all display areas of the display screen, or may perform in a partial display area of the display screen. In the implementation process of step 103, the following situations may be specifically:

In case 1, only the processed image is displayed in the image display area, and the processed image fills the display area for displaying the picture.

Case 2, the LDRI is still displayed in the image display area, but the ROI image in the LDRI Replace with the processed image. For example, after the user determines the ROI from the LDRI by using the selected operation, after performing the steps 1021 to 1022 to obtain the compressed image, the electronic device can keep the display state of the image portion other than the ROI image in the current image display area unchanged, and Replace the ROI image with a compressed image.

Case 3, while the area image is subjected to dynamic range compression in step 1022, the same compression algorithm is compressed on the portion other than the area image in the HDRI, that is, the entire HDRI image is recompressed to obtain the second LDRI. The compressed image has both the brightest pixel and the darkest pixel of the second LDRI, which is equal to the dynamic range of the second LDRI. Step 103 is performed to display the second LDRI.

In the case of no conflict, the implementation of step 103 in the embodiment of the present application may adopt any one of the above three situations.

In the above technical solution of the embodiment of the present application, the electronic device can determine the ROI image in the display image, and perform dynamic range processing on the ROI image, because the obtained dynamic range of the processed image is larger, or the pixel in the processed image The brightness value of the point is more reasonable, so that the display quality of the processed image is better than the ROI image in the LDRI, enabling the user to view the image of the region of interest with better display quality.

Optionally, for the technical solution of the step 101 to the step 103, the embodiment of the present application provides a modification. Referring to FIG. 3, it is another refinement flowchart of the image processing method in the embodiment of the present application, where the process includes:

Step 201: Determine a ROI image of a region of interest of the user from the display image.

Step 202: Determine whether the dynamic range of the ROI image is smaller than the dynamic range of the display image; if yes, execute step 203, otherwise, perform step 205;

Step 203: Perform dynamic range processing on the ROI image, and the obtained display image has better display quality than the ROI image.

Step 204: Display the processed image.

Step 205: Display the ROI image.

Specifically, after determining the ROI image in step 201, first compare the dynamic range of the ROI image. The size of the dynamic range of the entire image is displayed. When the dynamic range of the ROI image is smaller than the dynamic range of the displayed image, steps 203-204 are performed. The implementation of the step 201 is the same as that of the step 101. The implementation of the steps 203-204 is the same as that of the steps 102-103.

In step 202, the brightest point and the darkest point in the display image and the ROI image are respectively searched, and the brightness value of the brightest point of the ROI image is smaller than the brightness value of the brightest point of the displayed image, or the brightness value of the darkest point of the ROI image. It is greater than the brightness value of the darkest point of the displayed image to determine whether the dynamic range of the ROI image is smaller than the dynamic range of the displayed image.

In addition, in general, the dynamic range of the displayed image is the maximum dynamic range that the display can respond to. Therefore, it is only necessary to calculate the dynamic range of the ROI image and then compare it with the dynamic range of the display.

In step 202, if it is determined that the ROI image dynamic range is smaller than the display image dynamic range, then steps 203 to 204 are performed to perform dynamic range processing on the ROI image to display an image with a larger dynamic range and better display quality for the user.

However, if in step 202, if it is determined that the ROI image dynamic range is equal to the display image dynamic range, it may be determined that the ROI image has the maximum dynamic range that the current display device can display, and has a good display effect, and the ROI image can be directly displayed. Provide users with images with better display quality.

Through the above variant, the corresponding processing is performed for the ROI images of different dynamic ranges, and when the dynamic range of the ROI image can be improved, the dynamic range expansion processing of the ROI graphics is performed, thereby providing the user with a larger dynamic range and better display quality. A good image; when the dynamic range of the ROI image reaches the threshold that the display device can display, the ROI image is directly displayed, thereby avoiding waste of system resources caused by dynamic range processing and reducing the response time of the electronic device displaying the image.

It should be noted that, in the actual situation, when the current display image is an LDRI compressed by HDRI, even if the dynamic range of the ROI image in the LDRI is equal to the dynamic range of the LDRI, the dynamic range compression is performed on the ROI image by using an appropriate algorithm. The display quality of the obtained compressed image can still be superior to the display quality of the ROI image in LDRI. This is because when compressing HDRI to LDRI, It is necessary to select the algorithm of the gradation mapping in consideration of the display quality of the entire image, and when compressing the area image into a compressed image, it is possible to select a compression algorithm that is more suitable for the area image, and therefore, even the obtained compressed image and the ROI image in the original LDRI The dynamic range is the same, but because the algorithm is better when compressing, the brightness value of the pixel points in the obtained compressed image will be more reasonable, and the display quality is better than the display quality of the ROI image in LDRI, which can provide a better viewing experience for the user. This processing method is included in the technical solutions of steps 101 to 103 in the embodiment of the present application.

For the purpose of more clearly understanding the present invention, the above image processing method provided by the embodiments of the present application is described in detail by using specific application examples.

Referring to FIG. 4, it is a schematic flowchart of an image processing method in Application Example 1, which includes:

Step 301: Collect 3 frames of images for the same scene, wherein one frame is shortly exposed, one frame is long exposed, and one frame is normally exposed;

Step 302: align the three frames of images, and convert the three frames of images into the irradiation domain image according to a Camera Response Function (CRF);

Step 303: Weighting and merging the obtained 3-frame irradiation domain image to obtain an HDRI;

Step 304: When the HDRI is turned on, the HDRI is compressed by the tone scale mapping into an LDRI that the display screen can respond to, and the entire image of the LDRI is displayed;

Step 305: detecting a zoom operation of the user, and determining an ROI image from the LDRI according to the zooming operation;

Step 306: Determine an area image corresponding to the ROI image position in the HDRI;

Step 307: compress the determined area image into a compressed image by using a tone scale mapping, and obtain a dynamic range of the compressed image to reach a maximum dynamic range that the display device can display;

Step 308: Display the obtained compressed image.

In the application example 1, for the ROI image in the LDRI, the dynamic range compression of the region image corresponding to the ROI image position in the HDRI is performed, not only obtaining the dynamic range of the compressed image but also the dynamic range of the ROI image, and The compression algorithm of the area image, the obtained brightness value of the pixel in the compressed image will be more reasonable, the display quality of the compressed image is better than the display quality of the ROI image, and the user needs to view the image of the region of interest with better display quality.

Example 2

HDRI can be obtained by using dedicated image acquisition hardware, or it can also use a chip with strong computing power to perform fusion of multiple frames of different exposure images. The hardware requirements of the device are high. Some devices cannot obtain HDRI and can only obtain a single device. Image of exposure time, but image acquisition with a single exposure time will result in partial loss of image detail. Therefore, when displaying an image acquired at a single exposure time, if the user wants to view a ROI image of a user's region of interest in a single exposure time image, It will be difficult to guarantee the display quality of the ROI image.

For the above problem, Embodiment 2 of the present application provides an image processing method. Referring to FIG. 5, it is a schematic flowchart of the image processing method. The process includes the following steps:

Step 401: Determine, when displaying the first frame image of the at least two frames of images for the same scene, the ROI image of the user region of interest on each of the at least two frames of images;

Step 402: determining whether there is a second frame image in at least two frames of images, the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image; if yes, step 403 is performed;

Step 403: Switch from displaying the first frame image to displaying the ROI image in the second frame image.

Specifically, in step 401, when the display screen of the electronic device (including an external display device, such as a projector) displays the first frame image of the at least two frames of images, the user sense in the currently displayed first frame image can be determined. Interest area ROI image. In the embodiment of the present application, the implementation manner of determining the ROI image from the first frame image is the same as the implementation manner of determining the ROI image from the display image in the step 101, and the related description of the implementation manner of the step 101 in the embodiment of the present application. .

Then, the ROI image in each of the other frames in the at least two frames of images is determined. Specifically, since at least two frames of images are for the same scene, the ROI image positions of any two of the at least two frames of images correspond to each other. By mapping the position parameter of the ROI image in the first frame image to each of the frames other than the first frame in the at least two frames, the region corresponding to the position of the ROI image in the first frame can be determined in each of the other frames. The image, the determined area image is the ROI image of the frame in which it is located.

Optionally, the exposure time of any two of the at least two frames of the image in step 401 is different, so that each frame image contains different brightness and dark details of the collected scene, for example, long exposure time collection. The details of the dark parts in the image frame are rich, and the details of the highlights in the images acquired during the short exposure time are rich.

In step 402, a second frame image is searched for in an image other than the first frame, and the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image of the first frame. The display quality of the ROI image can be measured by image parameters. The image parameter may be any one of a plurality of parameters such as a dynamic range, a brightness value, and a saturation, or a combination of any two or more of two or more.

For example, when only the dynamic range is considered, the image display quality is larger as the image dynamic range is larger; the image display quality is better when the image saturation is larger only when the saturation is considered; the brightness of the metric image can be compared only when the brightness is considered. index. For example, the average brightness indicator of an image can be calculated from a Gaussian function:

Where W is an index that characterizes the average brightness of the ROI image, and I _i,j is the brightness value of the pixel at position (I, j) in the ROI image, and the brightness value is mapped to the interval [0, 1], that is, the brightest pixel The brightness value of the point is 1, and the brightness value of the darkest pixel is 0; A is the correlation coefficient, which can be taken as 12.5. When comparing the display quality of two ROI images, the display quality of the image with a larger W value is better.

When two or more image parameters are simultaneously considered to measure the display quality of the image, weights are added for each parameter, and then the indicators of all the image parameters are summed, and the quality of the image display quality is compared according to the obtained indicators and values.

In step 403, if it is determined that the second frame image exists, the ROI image in the second frame image is switched to display the image of the user's region of interest with better display quality. Specifically, when the ROI image in the second frame image is displayed, only the ROI image in the second frame image may be displayed, or the entire second frame image may be displayed.

Preferably, in step 402, the ROI image included in at least two frames of images is searched for the best image frame, and in step 403, the frame image is displayed to display the best image quality of the included ROI image, thereby enabling the user to View to show the best quality ROI image.

Further, step 401 includes the following two implementation manners:

First, detecting a user operation, determining each frame image of at least two frames according to a user operation The ROI image on it.

Specifically, the user operation is first detected to determine that the image portion corresponding to the user operation in the first frame image is the ROI image of the first frame image; and the user operation includes any one of a zoom operation, a drag operation, and a selected operation. The embodiment is the same as the mode 1 of the step 101 in the first embodiment, and the present application will not be described in detail herein.

Then, it is determined that an area image corresponding to the ROI image position in the first frame image in each of the at least two frames of the first frame image is an ROI image. That is, the pixel position parameter of the ROI image in the first frame image is acquired, mapped to the remaining frames, and the area image corresponding to the ROI image position in the first frame image in the remaining frames is determined, and the area image is The ROI image corresponding to the frame.

Second, it is determined that an image portion of the at least two frames of the image including the preset feature image is an ROI image. In a specific implementation, the ROI image in the first frame may be determined first, and then the ROI image in the remaining frames is determined by using the above location mapping manner, and the same ROI image automatic recognition rule may be used, and automatically in at least two frames of images. The ROI image identifying each frame is identified. For any frame image, how to determine the image portion in which the preset feature image is included is an ROI image, which is the same as the mode 2 of step 101 in the first embodiment.

Further, in step 401, displaying a first frame image of at least two frames of images for the same scene, including:

Determining, as the first frame image, a frame image of which the display quality is not the worst in at least two frames of images for the same scene;

The determined first frame image is displayed.

Specifically, the storage device of the electronic device stores at least two frames of images for the same scene, and at least two frames of images may be associated with the same file name. When the user opens the file according to the file name, the electronic device searches for at least two frames of images. The display quality is not the worst one frame image, and the frame image is used as the first frame image to display the user, so that the user can view the image with good overall display quality of the scene. Among them, the manner of comparing the display quality of different frame images is the same as the manner of comparing the display quality of the ROI image described above.

Preferably, a frame with the best display quality is searched from at least two frames of images as the first frame, and displayed, thereby providing the user with an image frame with the best overall display quality.

Referring to FIG. 6, which is a schematic flowchart of an image processing method in Application Example 2, the process includes:

Step 501: Collect 3 frames of images for the same scene, wherein one frame is shortly exposed, one frame is long exposed, and one frame is normally exposed;

Step 502: Store 3 frames of images, and associate 3 frames of images with the same file name;

Step 503: When opening the file corresponding to the file name, determining that one frame of the normal exposure is the one with the best display quality, and displaying the normal exposure frame;

Step 504: detecting that the user selects a face image of the person in the normal exposure frame, and determines that the ROI image of the normal exposure frame is the selected face image of the person;

Step 505: Determine an area image corresponding to the ROI image position in the normal exposure frame in the other two frames as the ROI image corresponding to the ROI image;

Step 506: Determine whether the ROI image display quality of one frame in the other two frames is better than the display quality of the ROI image of the normal exposure frame.

Step 507: It is determined that the display quality of the ROI image of the long exposure frame is better than the display quality of the ROI image of the normal exposure frame, and the ROI image of the long exposure frame is displayed.

In Application Example 2, the electronic device stores a multi-frame single-exposure image for the same scene. When a certain frame image is displayed, if the user-sensing region in the image is determined, whether the user included in one frame in the remaining frames is compared is compared. The display quality of the region of interest is better, and if there is, an image showing the region of interest of the user with better quality is displayed, providing the user with a better experience of viewing the image.

Example 3

Based on the same technical concept as the first embodiment, the embodiment of the present application provides an image processing apparatus. Referring to FIG. 7, the apparatus includes: a determining module 601, an image processing module 602, and a display module 603.

The determining module 601 is configured to determine a ROI image of the user's region of interest from the displayed image.

The image processing module 602 is configured to perform dynamic range processing on the ROI image, and obtain the processed The display quality of the image is better than the display quality of the ROI image;

The display module 603 is for displaying the processed image.

Optionally, the display image is a low dynamic range image LDRI compressed by the high dynamic range image HDRI, and the image processing module 602 is specifically configured to determine an area image corresponding to the ROI image position in the HDRI; and determine the determined area image. The dynamic range compression is performed, and the obtained compressed image is used as the processed image, and the dynamic range of the compressed image is greater than or equal to the dynamic range of the ROI image in the LDRI.

Optionally, the determining module 601 is specifically configured to detect a user operation, and determine an ROI image from the displayed image according to a user operation.

Optionally, the determining module 601 is specifically configured to detect a user operation, determine that the image portion corresponding to the user operation in the display image is an ROI image, and the user operation includes any one of a zoom operation, a drag operation, and a selected operation.

Optionally, the determining module 601 is specifically configured to determine that the image portion of the display image that includes the preset feature image is an ROI image.

Example 4

Based on the same technical concept as the embodiment 2, the embodiment of the present application provides an image processing apparatus. Referring to FIG. 8, the apparatus includes: a determining module 701, a determining module 702, and a display module 703.

The determining module 701 is configured to: when displaying the first frame image of the at least two frames of images for the same scene, determine a ROI image of the user region of interest on each of the at least two frames of images;

The determining module 702 is configured to determine whether there is a second frame image in the at least two frames of images, and the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image;

The display module 703 is configured to switch from displaying the first frame image to displaying the ROI image in the second frame image when the second frame image is present.

Optionally, the exposure time of any two of the at least two frames of images is different.

Optionally, the determining module 701 is specifically configured to detect a user operation, determine an ROI image on each of the at least two frames of images according to a user operation, or determine each frame in the at least two frames of images. The image portion of the image containing the preset feature image is an ROI image.

Optionally, the determining module 701 is specifically configured to detect a user operation, and determine that the image portion corresponding to the user operation in the first frame image is an ROI image of the first frame image; the user operation includes a zoom operation, a drag operation, and a selected operation. Any one of the operations; and determining that the area image corresponding to the ROI image position in the first frame image in each of the at least two frames of the first frame image is an ROI image.

Example 5

Based on the same technical concept as Embodiment 1, the embodiment of the present application provides an electronic device. Referring to FIG. 9, the electronic device includes a memory 801, a processor 802, and an output device 803 connected to the same bus 800.

The memory 801 is used to store instructions. The processor 802 is configured to execute an instruction to determine a ROI image of a region of interest of the user from the display image; perform dynamic range processing on the ROI image, and obtain a display quality of the processed image that is better than a display quality of the ROI image; Image; output device 803 is configured to display an image in accordance with an indication by processor 802.

Optionally, the display image is a low dynamic range image LDRI compressed by the high dynamic range image HDRI, and the processor 802 is configured to perform dynamic range processing on the ROI image, specifically: determining an area corresponding to the ROI image position in the HDRI. Image; the determined area image is subjected to dynamic range compression, and the obtained compressed image is used as the processed image, and the dynamic range of the compressed image is greater than or equal to the dynamic range of the ROI image in the LDRI.

Optionally, the processor 802 is configured to determine a ROI image of the user's region of interest from the display image, specifically: detecting a user operation, and determining an ROI image from the display image according to a user operation.

Optionally, the processor 802 is configured to detect a user operation, and determine an ROI image from the display image according to a user operation, specifically: detecting a user operation, determining that an image portion corresponding to the user operation in the display image is an ROI image, and the user operates It includes any one of zoom operation, drag operation, and selected operation.

Optionally, the processor 802 is configured to determine a ROI image of the user's region of interest from the display image, specifically: determining that the image portion of the display image that includes the preset feature image is an ROI image.

Optionally, the electronic device further includes: an image acquisition unit configured to acquire an image; an image storage unit configured to store the image, and the image storage unit may be the same memory as the memory 801, or may be different.

Optionally, the electronic device further includes: a touch unit, where the user acquires a touch operation of the user. The processor 802 is further configured to generate a corresponding instruction in response to the obtained user operation.

Preferably, please refer to FIG. 10 , which is a specific schematic diagram of an electronic device according to Embodiment 5 of the present application. As can be seen from FIG. 10, the electronic device includes an output device 803, a processor 802, an input device 804, a random access memory 801, a read only memory 805, and a bus 800. The processor 802 is coupled to the output device 803, the input device 804, the random access memory 801, and the read only memory 805 via the bus 800. When it is desired to operate the image processing apparatus, the basic input/output system booting system in the read only memory 805 is booted to boot the image processing apparatus into a normal operating state. It can be seen that the processor 802 in FIG. 9 is the same component as the processor 802 in FIG. 10. The bus 800 in FIG. 9 is the same component as the bus 800 in FIG. 10, the output device 803 in FIG. 9 and the output device 803 in FIG. The output device 803 is the same component, and the memory 801 in FIG. 9 is the same component as the random access memory 801 in FIG.

After the electronic device enters a normal operating state, the application and operating system are run in the random access memory 801.

Input device 804 is used for image acquisition, wherein input device 804 can include a camera, dual camera, etc. device having an image capture function.

The output device 803 is for displaying a result image, wherein the output device 803 can include a touch screen, a display, a printer, and the like.

Example 6

Based on the same technical concept as Embodiment 2, an embodiment of the present application provides an electronic device. Referring to FIG. 11, the electronic device includes a memory 901, a processor 902, and an output device 903 connected to the same bus 900.

The memory 901 is used to store instructions. The processor 902 is configured to execute an instruction, when displaying the first frame image of the at least two frames of images for the same scene, determining each of the at least two frames of images a ROI image of the user's region of interest on the frame image; determining whether there is a second frame image in at least two frames of images, and the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image; If present, switching from displaying the first frame image to displaying the ROI image in the second frame image. The output device 903 is for displaying an image according to an instruction of the processor.

Optionally, the processor 902 is configured to determine a ROI image of the user region of interest on each of the at least two frames of images, specifically: detecting a user operation, and determining each frame image of the at least two frames according to a user operation. The upper ROI image; or determining that the image portion of each of the at least two frames of images containing the preset feature image is an ROI image.

Optionally, the processor 902 is specifically configured to detect a user operation, and determine, according to a user operation, an ROI image on each of the at least two frames of images, specifically: detecting a user operation, determining that the first frame image corresponds to a user operation. The image portion is an ROI image of the first frame image; the user operation includes any one of a zoom operation, a drag operation, and a selected operation; determining each frame of the at least two frames of the image other than the first frame image The area image corresponding to the ROI image position in one frame image is an ROI image.

Optionally, the electronic device further includes: an image acquisition unit configured to acquire an image; an image storage unit configured to store the image, and the image storage unit may be the same memory as the memory 901, or may be different.

Optionally, the electronic device further includes: a touch unit, configured to acquire a touch operation of the user. The processor 802 is further configured to generate a corresponding instruction in response to the obtained user operation.

Preferably, please refer to FIG. 12 , which is a detailed schematic diagram of an electronic device according to Embodiment 6 of the present invention. As can be seen from FIG. 11, the electronic device includes an output device 903, a processor 902, an input device 904, a random access memory 901, a read only memory 905, and a bus 900. The processor 902 is coupled to the input device 904, the output device 903, the random access memory 901, and the read-only memory 905 via the bus 900. When it is desired to operate the image processing apparatus, the basic input/output system booting system in the read only memory 905 is booted to boot the image processing apparatus into a normal operating state. It can be seen that the processor 902 in FIG. 11 is the same component as the processor 902 in FIG. 12, in FIG. The bus 900 is the same component as the bus 900 of FIG. 12, the output device 903 of FIG. 11 and the output device 903 of FIG. 12 are the same component, and the memory 901 of FIG. 11 is the same as the random access memory 901 of FIG. component.

After the electronic device enters a normal operating state, the application and operating system are run in the random access memory 901.

Input device 904 is used for image acquisition, wherein input device 904 can include a camera, dual camera, etc. device having image capture functionality.

The output device 903 is for displaying a result image, wherein the output device 903 may include a touch screen, a display, a printer, and the like.

In the embodiment of the present application, the electronic device can determine the ROI image in the display image, and perform dynamic range processing on the ROI image, because the obtained dynamic range of the processed image is larger, or the brightness of the pixel in the processed image. The value is more reasonable, so that the display quality of the processed image is better than the ROI image in the LDRI, enabling the user to view the image of the region of interest with better display quality.

It will be clearly understood by those skilled in the art that for the convenience and brevity of the description, only the division of each functional module described above is exemplified. In practical applications, the above function assignment can be completed by different functional modules as needed. The internal structure of the device is divided into different functional modules to perform all or part of the functions described above. For the specific working process of the system, the device and the unit described above, reference may be made to the corresponding process in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the technical solution of the present application may be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a computer device (which may be a personal computer, A server, or network device, or the like, or a processor, performs all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

The above embodiments are only used to describe the technical solutions of the present application in detail, but the description of the above embodiments is only for helping to understand the method and the core idea of the present invention, and should not be construed as limiting the present invention. Those skilled in the art will be able to devise variations or alternatives within the scope of the present invention within the scope of the present invention.

Claims

An image processing method, the method comprising:

Determining an ROI image of a region of interest of the user from the display image;

Performing dynamic range processing on the ROI image, and obtaining a display quality of the processed image is better than a display quality of the ROI image;

The processed image is displayed.
The method according to claim 1, wherein the display image is a low dynamic range image LDRI compressed by a high dynamic range image HDRI, and the dynamic range processing of the ROI image comprises:

Determining an area image corresponding to the ROI image position in the HDRI;

And performing dynamic range compression on the determined area image, and the obtained compressed image is used as the processed image, and the dynamic range of the compressed image is greater than or equal to a dynamic range of the ROI image.
The method according to claim 1 or 2, wherein determining the ROI image of the user's region of interest from the display image comprises:

A user operation is detected, and the ROI image is determined from the display image according to the user operation.
The method of claim 3, wherein detecting the user operation, determining the ROI image from the display image according to the user operation comprises:

Detecting the user operation, determining that an image portion corresponding to the user operation in the display image is the ROI image, and the user operation includes any one of a zoom operation, a drag operation, and a selection operation.
The method according to claim 1 or 2, wherein determining the ROI image of the user's region of interest from the display image comprises:

Determining that the image portion of the display image including the preset feature image is the ROI image.
An image processing method, the method comprising:

Determining a user region ROI image on each of the at least two frames of images when displaying the first frame image of the at least two frames of images for the same scene;

Determining whether there is a second frame image in the at least two frames of images, and the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image;

If present, switching from displaying the first frame image to displaying the ROI image in the second frame image.
The method of claim 6 wherein the exposure time of any two of the at least two frames of images is different.
The method of claim 6, wherein determining a ROI image of the user region of interest on each of the at least two frames of images comprises:

Detecting a user operation, determining an ROI image on each of the at least two frames of images according to the user operation; or

Determining, in each of the at least two frames of images, an image portion including a preset feature image as an ROI image.
The method according to claim 8, wherein detecting a user operation, determining an ROI image on each of the at least two frames of images according to the user operation comprises:

Detecting the user operation, determining that an image portion corresponding to the user operation in the first frame image is an ROI image of the first frame image; and the user operation includes a zoom operation, a drag operation, and a selection operation Any kind of operation;

Determining, in each frame other than the first frame image, the area image corresponding to the ROI image position in the first frame image in the at least two frames of images is an ROI image.
An image processing apparatus, comprising:

a determining module, configured to determine a ROI image of the user's region of interest from the display image;

An image processing module, configured to perform dynamic range processing on the ROI image, and obtain a display quality of the processed image that is better than a display quality of the ROI image;

a display module for displaying the processed image.
The device of claim 10 wherein said display image is highly dynamic a low dynamic range image LDRI compressed by the range image HDRI, the image processing module is specifically configured to: determine an area image corresponding to the ROI image position in the HDRI; and perform dynamic on the determined area image The range is compressed, and the obtained compressed image is used as the processed image, and the dynamic range of the compressed image is greater than or equal to the dynamic range of the ROI image.
The apparatus according to claim 10 or 11, wherein the determining module is specifically configured to: detect a user operation, and determine the ROI image from the display image according to the user operation.
The device according to claim 12, wherein the determining module is specifically configured to: detect the user operation, and determine that an image portion corresponding to the user operation in the display image is the ROI image, The user operation includes any one of a zoom operation, a drag operation, and a selected operation.
The device according to claim 10 or 11, wherein the determining module is specifically configured to: determine that an image portion of the display image that includes a preset feature image is the ROI image.
An image processing apparatus, comprising:

a determining module, configured to determine a ROI image of a user region of interest on each of the at least two frames of images when displaying the first frame image of the at least two frames of images for the same scene;

a determining module, configured to determine whether there is a second frame image in the at least two frames of images, where the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image;

And a display module, configured to switch from displaying the first frame image to displaying an ROI image in the second frame image when the second frame image is present.
The method of claim 15 wherein the exposure time of any two of the at least two frames of images is different.
The apparatus according to claim 15, wherein the determining module is specifically configured to: detect a user operation, determine an ROI image on each of the at least two frames of images according to the user operation; or determine An image portion including a preset feature image in each of the at least two frames of images is an ROI image.
The device according to claim 17, wherein the determining module is specifically configured to: detect the user operation, and determine that an image portion corresponding to the user operation in the first frame image is the first frame An ROI image of the image; the user operation includes any one of a zoom operation, a drag operation, and a selected operation; and determining each frame other than the first frame image in the at least two frames of images The area image corresponding to the ROI image position in the first frame image is an ROI image.
An electronic device, comprising:

a memory for storing instructions;

a processor, configured to execute the instruction, determine a ROI image of a region of interest of the user from the display image; perform dynamic range processing on the ROI image, and obtain a display quality of the processed image that is better than display of the ROI image Quality; display the processed image;

An output device for displaying an image according to an indication of the processor.
The electronic device according to claim 19, wherein the display image is a low dynamic range image LDRI compressed by a high dynamic range image HDRI, and the processor is configured to perform dynamic range processing on the ROI image, Specifically, determining an area image corresponding to the ROI image position in the HDRI; performing dynamic range compression on the determined area image, and obtaining a compressed image as the processed image, the compressed image The dynamic range is greater than or equal to the dynamic range of the ROI image.
The electronic device according to claim 19 or 20, wherein the processor is configured to determine a ROI image of the user's region of interest from the display image, specifically: detecting a user operation, and displaying the image according to the user operation The ROI image is determined on the image.
The electronic device according to claim 21, wherein the processor is configured to detect a user operation, and determine the ROI image from the display image according to the user operation, specifically: detecting the user operation, Determining, in the display image, an image portion corresponding to the user operation is the ROI image, and the user operation includes any one of a zoom operation, a drag operation, and a selection operation.
The electronic device according to claim 19 or 20, wherein said processor is Determining the ROI image of the user's region of interest from the display image, specifically: determining that the image portion of the display image that includes the preset feature image is the ROI image.
An electronic device, comprising:

a memory for storing instructions;

a processor, configured to execute, when displaying the first frame image of the at least two frames of images for the same scene, determining a ROI image of the user region of interest on each of the at least two frames of images; Determining whether there is a second frame image in the at least two frames of images, wherein the display quality of the ROI image included in the second frame image is better than the display quality of the ROI image included in the first frame image; if present, Displaying that the first frame image is switched to display an ROI image in the second frame image;

An output device for displaying an image according to an indication of the processor.
The electronic device according to claim 24, wherein an exposure time of any two of the at least two frames of images is different.
The electronic device according to claim 24, wherein the processor is configured to determine a ROI image of a user region of interest on each of the at least two frames of images, specifically: detecting a user operation, according to The user operation determines an ROI image on each of the at least two frames of images; or determines that an image portion of the at least two frames of each of the at least two frames of images includes a preset feature image as an ROI image.
The electronic device according to claim 26, wherein the processor is specifically configured to detect a user operation, and determine an ROI image on each of the at least two frames of images according to the user operation, specifically Detecting the user operation, determining that an image portion corresponding to the user operation in the first frame image is an ROI image of the first frame image; the user operation includes a zoom operation, a drag operation, and a selection operation Any one of the operations; determining, in each frame of the at least two frames, the area image corresponding to the ROI image position in the first frame image in each of the first frame images is an ROI image.