CN110942487A - Chrominance adjustment system, method and non-transitory computer readable medium thereof - Google Patents

Abstract

The chrominance adjustment system includes a memory and a processor. The memory stores instructions. The processor is used for accessing and executing the instructions to perform the following steps: accessing the image; providing a control interface, wherein the control interface comprises a plurality of control points, and the control points define a plurality of areas on the chromaticity plane; in response to one of the control points moving from a first positioning point to a second positioning point in the chromaticity plane, selecting a plurality of modified areas around the first positioning point in the areas, and redefining original chromaticities in the modified areas as modified chromaticities according to the second positioning point; and judging whether the image comprises pixels corresponding to the original chroma in the correction areas or not, and if the pixels correspond to the original chroma in the correction areas, displaying the pixels in the image according to the correction chroma.

Description

Chrominance adjustment system, method and non-transitory computer readable medium thereof

Technical Field

The present disclosure relates to electronic systems, control methods, and computer readable media thereof, and more particularly, to a system, method, and computer readable media for adjusting image chrominance.

Background

The chrominance adjustment techniques in the prior art are mostly data calculation and are not intuitive for users. In addition, the chromaticity adjustment technique in the conventional art can only perform global adjustment, and it is difficult to perform local control for a specific region.

Disclosure of Invention

One aspect of the present disclosure is a chrominance adjustment system including a memory and a processor, the processor being coupled to the memory. The memory stores instructions. The processor is used for accessing and executing instructions to: accessing the image; providing a control interface, wherein the control interface comprises a plurality of control points which define a plurality of areas on the chromaticity plane; responding to one of the control points moving from a first positioning point to a second positioning point in the chromaticity plane, selecting a plurality of correction areas around the first positioning point in the areas, and redefining original chromaticities in the correction areas into corrected chromaticities according to the second positioning point; and judging whether the image comprises pixels corresponding to the original chroma in the correction areas or not, and if the pixels correspond to the original chroma in the correction areas, displaying the pixels in the image according to the correction chroma.

Another aspect of the present disclosure is a method for adjusting chrominance, which is executed by a processor accessing at least one instruction from a memory. The chroma adjustment method comprises the following steps: accessing the image; providing a control interface, wherein the control interface comprises a plurality of control points which define a plurality of areas on the chromaticity plane; responding to one of the control points moving from a first positioning point to a second positioning point in the chromaticity plane, selecting a plurality of correction areas around the first positioning point in the areas, and redefining original chromaticities in the correction areas into corrected chromaticities according to the second positioning point; and judging whether the image comprises pixels corresponding to the original chroma in the correction areas or not, and if the pixels correspond to the original chroma in the correction areas, displaying the pixels in the image according to the correction chroma.

Yet another embodiment of the present disclosure is a non-transitory computer readable medium associated with at least one instruction to define the chrominance adjustment method.

Therefore, according to the present disclosure, the present embodiment provides a chrominance adjustment system, which can display a movable chrominance control point on the chrominance plane of a control interface for correcting the chrominance of some pixels in an image, and is an effective and intuitive chrominance adjustment system.

Drawings

Fig. 1 is a schematic diagram of a chrominance adjustment system according to an embodiment of the disclosure;

fig. 2 is a flowchart illustrating a chromaticity adjusting method according to an embodiment of the disclosure;

FIG. 3 is a schematic diagram of an image according to an embodiment of the disclosure;

FIG. 4 is a schematic diagram of a control interface according to an embodiment of the present disclosure;

FIG. 5A is a schematic diagram of a control interface according to an embodiment of the disclosure;

FIGS. 5B, 5C, and 6 are schematic diagrams illustrating a calculation process according to an embodiment of the disclosure;

FIGS. 7A, 7B, and 8 are schematic diagrams of a control interface according to an embodiment of the disclosure; and

fig. 9A and 9B are schematic diagrams of a chromaticity plane according to an embodiment of the disclosure.

100: chrominance adjustment system

110: memory body

120: processor with a memory having a plurality of memory cells

130: display device

200: chroma adjustment method

S210 to S250: method step

IMG 1: image of a person

CI: control interface

CPL: plane of chroma

CP 1-CP 9: control point

P1, P2: coordinate point

Dl, Dr: horizontal distance

Dt, Db: vertical distance

SF: selecting frame

SFC: center of a ship

Detailed Description

Fig. 1 is a schematic diagram of a chrominance adjustment system according to an embodiment of the disclosure. In some embodiments, the chrominance adjustment system 100 includes a memory 110 and a processor 120. The processor 120 may include, but is not limited to, a single processing circuit or an integration of a plurality of microprocessor circuits, the single processing circuit or the integration being electrically coupled to the memory 100. The memory 110 is a computer readable medium that may be volatile or non-volatile internal or external memory.

In some embodiments, the processor 120 is configured to access at least one instruction from the memory 100, the at least one instruction being associated with a chroma adjustment method. The processor 120 is configured to execute the at least one instruction to implement the chroma adjustment method defined by the instruction. For better understanding of the operation of the processor 120, the chroma adjustment method defined by the at least one instruction is described in the following paragraphs with the help of the drawings.

In some embodiments, the chrominance adjustment system 100 further comprises a display 130. During the process of implementing the chrominance adjustment method by the processor 120, the processor 120 can display a corresponding frame to a user through the display 130.

It should be understood that the above embodiments are only examples and are not intended to limit the present disclosure. In some embodiments, the chrominance adjustment system 100 may further include a plurality of input devices and output devices to facilitate a user to operate the chrominance adjustment system 100.

Fig. 2 is a flowchart illustrating a chrominance adjustment method according to an embodiment of the disclosure. In some embodiments, the chrominance adjustment method 200 is implemented by the chrominance adjustment system 100 in fig. 1, so that reference can be made to the embodiment of fig. 1. In the present embodiment, the steps of the chrominance adjustment system 100 executing the chrominance adjustment method will be described in detail in the following paragraphs.

Step S210: the image is accessed.

In some embodiments, as shown in fig. 1, the processor 120 in the chrominance adjustment system 100 may access at least one image from the memory 110 (or other memories), and further may display the at least one image via the display 130. For better understanding, reference is also made to fig. 3, which is a schematic diagram of an image according to an embodiment of the disclosure. In some embodiments, processor 120 may access image IMG1 from memory 110 and correspondingly display this image IMG1 on display 130. As shown in FIG. 3, the image IMG1 includes a person wearing a jacket.

Step S220: a control interface is provided, wherein the control interface comprises a plurality of control points, and the control points define a plurality of areas on the chromaticity plane.

In some embodiments, as shown in fig. 1, the processor 120 of the chrominance adjustment system 100 may provide at least one control interface via the display 130. For better understanding, reference is also made to fig. 4, which is a schematic diagram of a control interface according to an embodiment of the disclosure. As shown in fig. 4, in some embodiments, the processor 120 may display the control interface CI through the display 130, and the initial state of the color plane (U-V color plane) CPL is displayed on the control interface CI. The chromaticity plane CPL is represented in a coordinate system, and has a horizontal axis, and the scale of the horizontal axis is used for displaying the U component on the chromaticity plane CPL, and the value range of the U component is 0-255. The chromaticity plane CPL also has a vertical axis, and the scale of the vertical axis is used to display the V component on the chromaticity plane CPL, and the value range of the V component is 0-255.

It should be understood that, on the chromaticity plane CPL of the control interface CI, each plane coordinate point corresponds to a chromaticity (Chroma). For example, the origin (U: 0, V: 0) of the chrominance plane CPL and the endpoints (U: 255, V: 255) of the chrominance plane CP each correspond to two different chromaticities.

As shown in fig. 4, in the initial state, a plurality of control points CP 1-CP 9 are displayed on the chromaticity plane CPL according to a specific distance, and the control points CP 1-CP 9 are respectively located at certain plane coordinate points on the chromaticity plane CPL. For example, as shown in fig. 4, in the initial state, the specific pitch is 64 units corresponding to the scale of the horizontal axis and the vertical axis of the chromaticity plane CPL.

That is, in the initial state, the control point CP1 corresponds to the coordinate point (U: 63, V: 63), the control point CP2 corresponds to the coordinate point (U: 127, V: 63), and the control point CP3 corresponds to the coordinate point (U: 191, V: 63). The rest of the control points CP 4-CP 9 are similar and will not be described in detail. As shown in fig. 4, the control points CP 1-CP 9 are uniformly distributed on the chrominance plane CPL according to the specific interval, and the chrominance plane CPL is roughly divided into 16 regions. The chromaticity corresponding to each coordinate point in these regions is defined by these control points CP 1-CP 9.

Step S230: in response to one of the control points moving from a first location point to a second location point in the chromaticity plane, a plurality of modified areas around the first location point are selected from the areas, and the original chromaticities in the modified areas are redefined as modified chromaticities according to the second location point.

In some embodiments, the control points CP 1-CP 9 on the chrominance plane CPL are adjustable. For example, in the first operation state, the user can move at least one of the control points CP 1-CP 9 to the other location points on the chrominance plane CPL, thereby adjusting some chrominance in the image. For better understanding, reference is also made to fig. 5A, which is a schematic diagram of a control interface according to an embodiment of the disclosure. In some embodiments, in the first operating state, the control point CP3 on this chroma plane CPL is moved. Compared to the embodiment of FIG. 4, in some embodiments, after the first operation state, the control point CP3 is located at the upper right position in the initial state, and the coordinate point corresponding to the control point CP3 has been changed from (U: 191, V: 63) to (U: 208, V: 30), which operation represents that the original chromaticity (U: 191, V: 63) is mapped to the modified chromaticity (U: 208, V: 30), and the chromaticity of the image IMG1 is correspondingly adjusted, as described below. It should be understood that the original chromaticity values and the modified chromaticity values are only examples and are not intended to limit the present disclosure.

In some embodiments, based on the movement of control point CP3, the original chromaticities in the four regions around control point CP3 will also be mapped to the corresponding modified chromaticities, respectively. Please refer to fig. 5B together with a schematic diagram of the calculation process. Fig. 5B is a schematic diagram of the lower left side region of the control point CP3 after the first operation state, i.e., the region defined by the control points CP2, CP3, CP5, and CP6 on the chromaticity plane CPL. It should be understood that in the embodiment of fig. 4, this area is a square. After the first operation state, as shown in FIG. 5B, the area is a non-equilateral quadrilateral. In some embodiments, after the first operating state, at least one of the control points CP2, CP5, CP6 is moved in addition to the control point CP3 being moved. For convenience of description, after the first operation state, the chromaticities corresponding to the control points CP2, CP3, CP5, and CP6 are all referred to as modified chromaticities, wherein the modified chromaticities corresponding to the moved control points are different from the original chromaticities thereof, and the modified chromaticities corresponding to the control points that are not moved are the same as the original chromaticities thereof.

It should be understood that the corrected chromaticity corresponding to each coordinate point (e.g., P1) in the region illustrated in fig. 5B is defined by the control points CP2, CP3, CP5, and CP 6. Specifically, the corrected chromaticity corresponding to each coordinate point is determined according to the distance between each coordinate point and each surrounding control point in the initial state and the corrected chromaticity corresponding to each surrounding control point after the first operation state. For example, taking a coordinate point P1 in the region as an example, after the first operating state, the corrected chromaticity of the coordinate point P1 can be represented as P1(u, v). Correspondingly, after the first operating state, the modified chromaticity of control point CP2 may be denoted as CP2(u, v), the modified chromaticity of control point CP3 may be denoted as CP3(u, v), the modified chromaticity of control point CP5 may be denoted as CP5(u, v), and the modified chromaticity of control point CP6 may be denoted as CP6(u, v). The corrected chromaticity value corresponding to P1(u, v) is calculated as follows:

p1(u, v) ═ W2 × CP2(u, v) + W3 × CP3(u, v) + W5 × CP5(u, v) + W6 × CP6(u, v). W2 is a weight corresponding to the chromaticity value of the control point CP2, and W2 has a value of (1-Dl/(Dl + Dr)) × (1-Dt/(Dt + Db)).

For better understanding, reference is also made to fig. 5C, which is a schematic diagram illustrating a calculation process according to an embodiment of the disclosure. It should be understood that fig. 5C illustrates horizontal and vertical distances of the connecting lines of the respective control points CP2, CP3, CP5, CP6 from the coordinate point P1 in the initial state, for convenience of understanding. As shown in fig. 5C, in this region, the control point CP2 is located on the upper left side of the coordinate point P1. In the above equation, Dl represents the horizontal distance of the coordinate point P1 from the connecting line between the control point CP2 and the control point CP5 (i.e., the segment at the left end of the region) in the initial state, and Dr represents the horizontal distance of the coordinate point P1 from the connecting line between the control point CP3 and the control point CP6 (i.e., the segment at the right end of the region) in the initial state. Dt represents a vertical distance from the connection line between the control point CP2 and the control point CP3 (i.e., the segment at the top end of the region) at the coordinate point P1 in the initial state, and Db represents a vertical distance from the connection line between the control point CP5 and the control point CP6 (i.e., the segment at the bottom end of the region) at the coordinate point P1 in the initial state.

Correspondingly, W3 is the weight corresponding to CP3(u, v), and W3 has a value of (1-Dr/(Dl + Dr)) × (1-Dt/(Dt + Db)). Similarly, W5 has a value of (1-Dl/(Dl + Dr)) × (1-Db/(Dt + Db)), and W6 has a value of (1-Dr/(Dl + Dr)) × (1-Db/(Dt + Db)). That is, the weights W2, W3, W5, and W6 are determined according to the distance between the coordinate point P1 and the control points CP2, CP3, CP5, and CP6 in the initial state.

It should be understood that, as shown in fig. 5C, in the initial state, the control points are located at the initial positioning points, and each coordinate point on the chromaticity plane CPL corresponds to an original chromaticity. As shown in fig. 5B, when the positions of some control points are changed after the operation state, the chromaticity of each coordinate point in the area adjacent to the control point on the chromaticity plane CPL is also changed, which corresponds to a corrected chromaticity respectively.

It should be understood that the control points CP 1-CP 9 can be arbitrarily moved to other fixed points on the chromaticity plane CPL, and the processor 120 can correspondingly calculate the corrected chromaticity of each coordinate point. For better understanding, refer to fig. 6, which illustrates a schematic diagram of a calculation process according to an embodiment of the disclosure. As shown in fig. 6, after the second control state, in some embodiments, control point CP3 is moved to the lower left side on the chromaticity plane CPL. Fig. 6 shows the area defined by the control points CP2, CP3, CP5, CP6 on this chromaticity plane CPL after the second operating state. The corrected chromaticity of a coordinate point P2 in the region defined by the control points CP2, CP3, CP5 and CP6 in the initial state can also be obtained by the above calculation method, which is not described herein again. In this embodiment, the position of the control point CP3 is greatly changed, so that the corrected chromaticity corresponding to each coordinate point is greatly different from the original chromaticity.

It should be understood that the above embodiment is exemplified by the state that the single control point CP3 is moved, but the present application is not limited thereto. In some embodiments, more than two of the control points CP 1-CP 9 can be moved, and the corresponding modified chromaticity calculation method can be referred to the above embodiments.

It should be understood that each coordinate point falling in the chromaticity plane CPL has its own weight corresponding to the adjacent control point, and the chromaticity of each coordinate point is defined by these weights and the chromaticities of its adjacent control points.

Step S240: and judging whether the image comprises at least one pixel corresponding to the original chroma in the correction areas, and if the at least one pixel corresponds to the original chroma in the correction areas, displaying the at least one pixel in the image according to the corrected chroma.

In some embodiments, the processor 120 in the chrominance adjustment system 100 may determine whether any of the pixels in the accessed image correspond to the original chrominance in the modified region on the chrominance plane CPL, and if some of the pixels correspond to the original chrominance in the modified region, the processor 120 may display the pixels in the image according to the modified chrominance. In other words, the processor 120 may modify the pixels in the image corresponding to the original chromaticity in the modified region to modify the chromaticity display.

As with the embodiment of FIG. 3, the processor 120 may access the image IMG1 from the memory 110. In some embodiments, the processor 120 can provide the user with the control interface CI through the display 130 in order to make the user intuitively understand the change of the chromaticity on the chromaticity plane CPL after the control point is moved. Besides displaying the chrominance plane CPL, the control interface CI can also display the image IMG1, so that the user can directly view the chrominance changes of some pixels in the image IMG1 on the control interface CI.

For better understanding, please refer to fig. 7A and 7B together, which illustrate a schematic diagram of a control interface according to an embodiment of the present disclosure. Fig. 7A corresponds to the embodiment of fig. 5A-5C, and fig. 7B corresponds to the embodiment of fig. 6. It should be understood that if the original color of the jacket of the person in the image IMG1 corresponds to the area defined by the control points CP2, CP3, CP5 and CP6 on the chromaticity plane CPL in the initial state, the processor 120 will display the jacket of the person with the modified chromaticity after the first or second operation state. As shown in FIGS. 7A and 7B, the color of the jacket of the person in the image IMG1 differs between the two images.

Step S250: and if the at least one pixel is positioned in the region of interest, displaying the at least one pixel in the region of interest according to the original chromaticity and the mixed chromaticity of the corrected chromaticity allocation.

In some embodiments, display 130 displays control interface CI including chrominance plane CPL and image IMG 1. The user can select the region of interest with a specific size or shape in the control interface CI, and the processor 120 can determine whether the original color of some pixels in the region of interest corresponds to the area defined by the control points CP2, CP3, CP5, and CP6 on the chromaticity plane CPL in the initial state, if so, the processor 120 can only correct the corresponding pixels in the region of interest. That is, by selecting the region of interest, the processor 120 may make local adjustments rather than making adjustments to the image IMG1 as a whole. For a better understanding, reference is also made to fig. 8. In some embodiments, the processor 120 may display a control interface CI via the display 130, on which a selection box SF, which may be octagonal in shape, is displayed that is indicated on the image IMG1 as corresponding to the region of interest.

In some embodiments, the processor 120 may select the frame SF corresponding to the region of interest in the image IMG1 according to a face detection logic. That is, the region of interest is the face of the person in the image. With this arrangement, the processor 120 can only adjust (or enhance) the chrominance of the face of the person to avoid enhancing the chrominance of the remaining noise in the image.

In some embodiments, the processor 120 may determine whether there is a selected frame SF corresponding to the region of interest, and further determine whether there are some pixels in the selected frame SF corresponding to the regions defined by the control points CP2, CP3, CP5, and CP6 on the chromaticity plane CPL in the initial state. If so, the processor 120 may adjust the original chromaticity and modify the chromaticity according to a distance weight to generate a mixed chromaticity, and then display the detected pixels in the frame SF with the mixed chromaticity. Wherein the distance weight is associated with a distance of the detected pixel to a center of the region of interest. As shown in fig. 8, the cull box SF has a center SFC. In some embodiments, the closer the detected pixel is to the center SFC, the higher the distance weight corresponding to the modified chromaticity, and the lower the distance weight corresponding to the original chromaticity, in which case the more the mixed chromaticity is approximate to the modified chromaticity. However, the present disclosure is not limited thereto, and the distance weight may be set in other manners.

It should be understood that, in the above embodiment, the control points CP 1-CP 9 are uniformly distributed on the chrominance plane CPL according to a specific pitch to divide the chrominance plane CPL into 16 regions with substantially equal areas, however, the disclosure is not limited thereto. In some embodiments, the control points disposed on the chrominance plane CPL may be in other numbers, and the control points may be arranged on the chrominance plane CPL according to a variable interval, so as to define different numbers of regions.

For better understanding, reference may be made to fig. 9A and 9B together. In some embodiments, as shown in fig. 9A, only one control point CP1 uniformly divides the chrominance plane CPL into 4 regions. In some embodiments, as shown in fig. 9B, the control points CP 1-CP 9 are arranged on the chrominance plane CPL at non-uniform intervals, and the chrominance plane CPL is divided into 16 regions with different areas. By means of the arrangement, fine adjustment can be carried out aiming at a specific chromaticity area without increasing the number of the whole control points, and the hardware requirement of the system can be saved.

In view of the foregoing, embodiments of the present invention provide a system, method and computer readable medium for adjusting chromaticity, which provides an efficient and intuitive way of operating to adjust or enhance some chromaticity in an image.

Claims (10)

1. A chrominance adjustment system, comprising:

a memory for storing at least one instruction; and

a processor, coupled to the memory, for accessing and executing the at least one instruction to:

accessing an image;

providing a control interface, wherein the control interface comprises a plurality of control points, and the control points define a plurality of areas on a color plane;

in response to a movement of one of the control points from a first positioning point to a second positioning point in the chromaticity plane, selecting a plurality of modified areas around the first positioning point in the areas, and redefining an original chromaticity in the modified areas as a modified chromaticity according to the second positioning point; and

and judging whether the image comprises at least one pixel corresponding to the original chroma in the correction areas, and if the at least one pixel corresponds to the original chroma in the correction areas, displaying the at least one pixel in the image according to the correction chroma.

2. The system of claim 1, wherein the processor is configured to access and execute the at least one instruction to:

responding to the selection of a region of interest in the image, and judging whether the at least one pixel is positioned in the region of interest; and

if the at least one pixel is located in the region of interest, displaying the at least one pixel in the region of interest according to the original chromaticity and a mixed chromaticity of the modified chromaticity allocation.

3. The system of claim 2, wherein the processor is configured to access and execute the at least one instruction to:

the original chromaticity and the modified chromaticity are adjusted according to a distance weight to generate the mixed chromaticity, wherein the distance weight is associated with a distance from the at least one pixel to a center of the region of interest.

4. The system of claim 2, wherein a shape of the region of interest is an octagon.

5. The system of claim 2, wherein the processor is configured to access and execute the at least one instruction to:

selecting the region of interest from the image according to a face detection logic.

6. The chrominance adjustment system of claim 1, wherein a plurality of reference control points of the control points are located adjacent to the first anchor point on the chrominance plane, the modified chrominance being determined according to at least three of the reference control points and the second anchor point.

7. The system of claim 1, wherein the control points are arranged on the chromaticity plane according to a fixed distance to define the regions.

8. The system of claim 1, wherein the control points are arranged on the chromaticity plane according to a variable spacing to define the regions.

9. A method for performing a chroma adjustment by a processor accessing at least one instruction from a memory, the method comprising:

accessing an image;

providing a control interface, wherein the control interface comprises a plurality of control points, and the control points define a plurality of areas on a color plane;

in response to a movement of one of the control points from a first positioning point to a second positioning point in the chromaticity plane, selecting a plurality of modified areas around the first positioning point in the areas, and redefining an original chromaticity in the modified areas as a modified chromaticity according to the second positioning point; and

and judging whether the image comprises at least one pixel corresponding to the original chroma in the correction areas, and if the at least one pixel corresponds to the original chroma in the correction areas, displaying the at least one pixel in the image according to the correction chroma.

10. A non-transitory computer readable medium associated with at least one instruction to define a chroma adjustment method, wherein the chroma adjustment method comprises:

accessing an image;

providing a control interface, wherein the control interface comprises a plurality of control points, and the control points define a plurality of areas on a color plane;

in response to a movement of one of the control points from a first positioning point to a second positioning point in the chromaticity plane, selecting a plurality of modified areas around the first positioning point in the areas, and redefining an original chromaticity in the modified areas as a modified chromaticity according to the second positioning point; and

and judging whether the image comprises at least one pixel corresponding to the original chroma in the correction areas, and if the at least one pixel corresponds to the original chroma in the correction areas, displaying the at least one pixel in the image according to the correction chroma.

Images