CN111127363A

CN111127363A - Image processing method, image processing apparatus, and storage medium for improving ultra-wide viewing angle

Info

Publication number: CN111127363A
Application number: CN201911361885.7A
Authority: CN
Inventors: 张永雷
Original assignee: TCL Huaxing Photoelectric Technology Co Ltd
Current assignee: TCL Huaxing Photoelectric Technology Co Ltd
Priority date: 2019-12-26
Filing date: 2019-12-26
Publication date: 2020-05-08
Anticipated expiration: 2039-12-26
Also published as: CN111127363B

Abstract

The embodiment of the invention discloses an image processing method for improving an ultra-wide visual angle, which is operated in an electronic device. The method comprises the following steps: selecting a specific color space containing skin color; selecting a particular one of the constituent primary colors in the particular color space; selecting a particular value for the particular primary color; determining a specific color plane in the specific color space corresponding to the specific value of the specific primary color; determining a target skin color region in a specific color plane; receiving an image; performing first image processing on a part of the image, the color of which accords with a target skin color area, so as to be suitable for large-view-angle display; and performing second image processing on the part of the image, the color of which does not accord with the target skin color area. The first image processing includes image processing of a first enhanced color saturation; the second image processing does not include the image processing of the first enhanced color saturation.

Description

Image processing method, image processing apparatus, and storage medium for improving ultra-wide viewing angle

Technical Field

The present invention relates to the field of information processing technologies, and in particular, to an image processing method, an image processing apparatus, and a storage medium for improving an ultra-wide viewing angle.

Background

With the continuous pursuit of the display quality of the lcd tv, the development trend of the tv has paid attention to the ultra-wide viewing angle and the fineness of the image. In order to improve the quality of a large viewing angle, most of the conventional image processing algorithms can be implemented by performing color saturation enhancement on the gray scale of each sub-pixel of three primary colors (red, green, blue, RGB).

Because human eyes are sensitive to skin color in an image, a skin color area and a non-skin color area adopt a uniform algorithm to enhance color saturation, the human eyes often become unnatural in visual effect, and the graininess in the image is serious.

In the aspect of ultra-wide viewing angle, the picture which is relatively concerned by the viewer when looking sideways is a skin color picture. If the sub-pixel gray scale is not processed, the color cast and white blur will occur when the display screen is viewed from side, and it is difficult to conform to the viewing angle specification in the industry. Some skin color frames, such as the four skin colors with RGB (133,101,75), (192,156,129), (186,161,143) and (211,153,126), may fall outside the detection region of the skin color algorithm, and the skin color will not meet the standard of the industry's viewing angle without performing the color saturation enhancement process.

Disclosure of Invention

Embodiments of the present invention provide an image processing method, an image processing apparatus, and a storage medium, which improve an algorithm and a debugging method for an ultra-wide viewing angle, and can improve quality of a large viewing angle while reducing graininess and suppressing color cast in a side view.

A first aspect of an embodiment of the present invention provides an image processing method for improving an ultra-wide viewing angle, which is implemented in an electronic device. The method comprises the following steps: selecting a specific color space containing skin color; selecting a particular one of the constituent primary colors in the particular color space; selecting a particular value for the particular primary color; determining a specific color plane in the specific color space corresponding to the specific value of the specific primary color; determining a target skin tone region in the particular color plane; receiving an image; performing first image processing on a part of the image, the color of which accords with the target skin color area, so as to be suitable for large-view-angle display; and performing second image processing on the part of the image, the color of which does not accord with the target skin color area.

In one embodiment of the present invention, the first image processing includes a first image processing for enhancing color saturation to be suitable for a large viewing angle display.

In one embodiment of the present invention, the second image processing does not include image processing of the first enhanced color saturation.

In one embodiment of the present invention, the color space is a three primary colors of red, green and blue (RGB) color space.

In one embodiment of the invention, one of the constituent primary colors in the specific color space is blue.

In one embodiment of the present invention, the target skin tone region is defined according to a linear relationship on the specific color plane.

In one embodiment of the present invention, the target skin color region is a pentagonal region defined by four lines on the specific color plane.

In one embodiment of the present invention, the specific value of the specific primary color is a blue value 75, an intersection of any 2 lines of the four lines is close to a skin color with an RGB value (133,101,75), and the target skin color region is made to contain the skin color with the RGB value (133,101, 75).

In a second aspect, an apparatus for improving image processing over a wide viewing angle includes a processor and an image receiver. The processor performs the steps of: the processor selects a specific color space containing skin color; the processor selecting a particular one of the constituent primary colors in the particular color space; the processor selecting a particular value of the particular primary color; the processor determining a particular color plane in the particular color space corresponding to the particular value of the particular primary color; the processor determining a target skin tone region in the particular color plane; the processor receiving an image from the image receiver; the processor performs first image processing on a part of the image, the color of which conforms to the target skin color area, so as to be suitable for large-view-angle display; and the processor performs second image processing on the part of the image, the color of which does not accord with the target skin color area.

Has the advantages that: the algorithm and the debugging method for improving the ultra-wide viewing angle provided by the invention can realize the improvement of the quality of a large viewing angle under the conditions of weakening granular sensation and inhibiting side-looking color cast.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic view of an electronic device in an embodiment of the invention.

FIG. 2 is a diagram illustrating an image processing method for improving an ultra-wide viewing angle according to an embodiment of the invention.

Fig. 3 shows a schematic diagram of a color plane corresponding to a blue value 75 (i.e., B-75) in the RGB color space.

Fig. 4 shows a schematic diagram of an example of a target skin tone region on a color plane corresponding to a blue value 75 (i.e., B-75) in an RGB color space.

Fig. 5 shows a schematic diagram of another example of a target skin tone region on a color plane corresponding to a blue value 75 (i.e., B-75) in an RGB color space.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the invention provides an image processing method for improving an ultra-wide viewing angle, which can be executed in an electronic device. The electronic device may comprise a television, an electronic computer, a mobile communication device.

FIG. 1 is a diagram of an electronic device 700 for performing the disclosed method according to an embodiment of the invention. The embodiments described herein may be implemented using any suitably configured hardware and/or software. Fig. 1 illustrates a device 700 comprising an image receiver 710, a transceiver 720, a processor 730, a memory/storage device 740, a display 750, a camera 760, sensors 770, and an input/output (I/O) interface 780, coupled to each other as shown.

Processor 730 may include circuitry such as, but not limited to, one or more single-core or multi-core processors. The processor may include any combination of general-purpose processors and special-purpose processors, such as a graphics processor and an application processor (applationprocessor). The processor may be coupled to memory/storage 740 and configured to execute instructions stored in memory/storage 740 to enable various applications and/or operating systems to run on the system.

The transceiver 720 may include circuitry such as, but not limited to, one or more single-core or multi-core processors. The processor may include baseband (baseband) circuitry and Radio Frequency (RF) circuitry. The baseband circuitry may handle various radio control functions and communicate with one or more radio networks through the radio frequency circuitry. The radio control functions may include, but are not limited to, signal modulation, encoding, decoding, radio frequency conversion, and the like. In some embodiments, the baseband circuitry may provide communications compatible with one or more radio technologies. For example, in some embodiments, the baseband circuitry may support Evolved Universal Terrestrial Radio Access Network (EUTRAN) and/or other Wireless Metropolitan Area Networks (WMAN), Wireless Local Area Networks (WLAN), Wireless Personal Area Networks (WPAN). An embodiment in which the baseband circuitry is configured to support radio communications of multiple wireless protocols may be referred to as multi-mode baseband circuitry. In various embodiments, the baseband circuitry may include circuitry for operating on signals that are not strictly considered baseband frequencies. For example, in some embodiments, baseband circuitry may include circuitry to operate in signals having intermediate frequencies (i.e., baseband and radio frequencies).

The radio frequency circuit may communicate with a wireless network using modulated electromagnetic radiation through a non-solid medium. In various embodiments, the RF circuitry may include switches, filters, amplifiers, etc. for communication with the wireless network. In various embodiments, the RF circuitry may include circuitry for operating with signals that are not strictly considered to be in radio frequencies. For example, in some embodiments, the RF circuitry may include circuitry for operating with signals having an intermediate frequency between a baseband frequency and a radio frequency.

As used herein, "circuitry" may refer to, participate in, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or chipset), and/or execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable hardware components that provide the described functionality. In some embodiments, the circuitry of the electronic device or the functionality associated with the circuitry may be implemented in one or more software or firmware modules. In some embodiments, some or all of the baseband circuitry, application circuitry, and/or components of memory/storage 740 may be implemented together on a system on a chip (SOC).

Memory/storage 740 may be used to load and store data and/or instructions, for example, to a system. The Memory/storage in one embodiment may comprise any combination of suitable volatile Memory, such as Dynamic Random Access Memory (DRAM), and/or non-volatile Memory, such as flash Memory.

Similarly, the apparatus may also include a Read Only Memory (ROM) or other static storage device for storing static information and instructions for the processor.

The memory/storage 740, for example, may include a media disk drive and a removable storage device interface. The media disk drive may include a disk drive or other mechanism that supports fixed or removable storage media, such as a hard disk drive, a floppy disk drive, a tape drive disk drive, an optical disk drive, a compact disk drive, or a Digital Video Disk (DVD) drive read-write (R or RW) disk drive or other removable or fixed media disk drive. The storage media may include, for example, a hard disk, floppy disk, magnetic tape, Compact Disc (CD) or DVD, or other fixed or removable medium that is read by and written to by a media disk drive. The storage media may include a computer-readable storage medium having particular computer software or data stored therein

In various embodiments, I/O interface 780 may include one or more user interfaces intended to enable a user to interact with the system and/or peripheral component interfaces intended to enable interaction with peripheral components of the system. The user interface may include, but is not limited to, a physical keyboard or keypad, a touch pad, a speaker, a microphone, and the like. The peripheral component interfaces may include, but are not limited to, a non-volatile memory port, a Universal Serial Bus (USB) port, an audio jack, and a power interface.

FIG. 2 shows an embodiment of the image processing method for improving an ultra-wide viewing angle according to the present invention. The image processing method for improving the super-wide viewing angle is implemented in the electronic device 700. The image receiver 710 may receive images from the transceiver 720, processor 730, memory/storage 740, camera 760, sensor 770, and input/output (I/O) interface 780. In one embodiment, image receiver 710 may comprise one of the aforementioned transceivers 720, processors 730, memory/storage devices 740, cameras 760, sensors 770, and input/output (I/O) interfaces 780.

First, the processor 730 performs the following steps:

step S1, selecting a specific color space containing skin color.

A particular one of the constituent primary colors in the particular color space is selected, step S2.

A particular value of the particular primary color is selected, step S3.

A specific color plane in the specific color space corresponding to the specific value of the specific primary color is determined S4.

A target skin color region is determined in the particular color plane, step S5.

Step S6 is receiving an image from image receiver 710.

Step S7, determining whether the color of a portion of the image corresponds to the target skin color region.

And step S8, performing first image processing on the part of the image, the color of which accords with the target skin color area, so as to be suitable for large-view-angle display.

And step S9, performing second image processing on the part of the image, the color of which does not accord with the target skin color area.

The processor 730 selects a specific color space containing skin tones (step S1). The color space may illustratively be a red-green-blue primary color (RGB) color space, a Hue-Saturation-brightness (HSI), a Hue-Saturation-Value (HSV) color space, and a Lab color space. The hue may be a hue defined by any one of the color spaces. L in the Lab color space represents luminance (luminescence), a represents a range from red to green, and b represents a range from yellow to blue. In fact, the hue can be defined in any other color space, and various hues can be used with the method of the present invention. In the present embodiment, the color space is exemplarily illustrated by an RGB color space.

The processor 730 selects a specific primary color among the constituent primary colors in the specific color space (step S2), selects a specific value of the specific primary color (step S3), and decides a specific color plane in the specific color space corresponding to the specific value of the specific primary color (step S4). The particular color plane is a color plane that includes skin tones. In one embodiment of the invention, one of the constituent primary colors in the specific color space is blue. In one embodiment of the present invention, the specific value of the specific primary color is a blue value 75, so the processor 730 determines a specific color plane in the RGB color space corresponding to the specific value 75 of blue (i.e., B-75).

Fig. 3 shows a schematic diagram of a color plane corresponding to a blue value 75 (i.e., B-75) in the RGB color space. The processor 730 determines a specific color plane 101 in the RGB color space 100 corresponding to a specific value 75 of blue (i.e., B-75).

The processor 730 determines a target skin color region in the specific color plane (step S5). In this embodiment, the processor 730 determines a target skin color region in the specific color plane 101.

Fig. 4 shows a schematic diagram of an example of a target skin tone region on a color plane corresponding to a blue value 75 (i.e., B-75) in an RGB color space. In one embodiment of the present invention, the target skin tone region is defined according to a linear relationship on the specific color plane. In one embodiment of the present invention, the target skin color region is a skin color region in a target population sample space, such as yellow, white, south ocean skin color, black, and the like. For example, the target skin tone region 401 is a trilateral region defined from the two

lines

201 and 202 on the particular color plane 101. It can be seen that the number two skin tones with RGB values (133,101,75) are at a position 301 outside the target skin tone region 401.

Fig. 5 shows a schematic diagram of another example of a target skin tone region on a color plane corresponding to a blue value 75 (i.e., B-75) in an RGB color space. In one embodiment of the present invention, the processor 730 defines the target skin tone region 402 with four

lines

201, 202, 203, and 204. The intersection of any 2 of the four lines is close to the position 301 where the number two skin tone is located, and such that the target skin tone region 402 contains the number two skin tone with the RGB value (133,101, 75). Similarly, the processor 730 may define the target skin tone region 402 with four

lines

201, 202, 203, and 204 and cause the target skin tone region 402 to include other numbered skin tones, such as the numbered four skin tones (192,156,129), the numbered five skin tones (186,161,143), and the numbered six skin tones (211,153,126).

The processor 730 receives an image from the image receiver 710 (step S6). The image receiver 710 may receive images from the transceiver 720, processor 730, memory/storage 740, camera 760, sensor 770, and input/output (I/O) interface 780. The image may be a static or dynamic image.

The processor 730 determines whether the color of a portion of the image corresponds to the target skin color region (step S7). In this embodiment, a portion of the image may be a region, a pixel, or a sub-pixel in the image.

The processor 730 performs a first image processing on a portion of the image whose color corresponds to the target skin color region to fit a large viewing angle (step S8), and performs a second image processing on a portion of the image whose color does not correspond to the target skin color region (step S9). The first image processing and the second image processing may include respective image processing such as processing for enhancing color saturation, enhancing compensation for color cast, whitening, and enhancing an ultra-wide viewing angle. But the first image processing and the second image processing are different. In one embodiment of the present invention, the first image processing includes image processing of a first enhanced color saturation to be suitable for large viewing angle display, and the second image processing does not include image processing of the first enhanced color saturation. The invention reduces granular sensation and improves ultra-wide visual angle.

In this document, the terms "computer program product," "computer-readable medium," and the like may be used generally to refer to tangible media, such as memory, storage devices, or storage units. These and other forms of computer-readable media may store one or more instructions for use by a processor comprising a computer system, to cause the processor to perform specified operations. Such instructions, generally referred to as "computer program code" (which may be grouped in the form of computer programs or other groupings), when executed, enable the computer system to perform functions of embodiments of the present invention. Note that the code may directly cause the processor to perform specified operations, be compiled to do so, or be used in combination with other software, hardware, and firmware elements (e.g., for executing a standard library of functions) to perform the methods described herein.

In embodiments where the elements are implemented using software, the software may be stored on a computer-readable medium and loaded into the device using, for example, a removable storage disk drive. The control module (in this example, software instructions or executable computer program code), when executed in the processor of the computer system, causes the processor to perform the functions of the invention as described herein.

Aspects of the invention may be implemented in any suitable form including hardware, software, firmware or any combination of these. The invention may alternatively be implemented, at least in part, as computer software running on one or more data processors and/or digital signal processors or configurable modular components, such as Field-Programmable Gate Array (FPGA) devices. Thus, the elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed the functionality may be implemented in one unit, in a plurality of units or as part of other functional units.

The method provided by the invention is based on a skin color detection algorithm, if the image is in a skin color area, the image processing for enhancing the color saturation is carried out, and the large visual angle is ensured; if the image is not in the skin color area, the image processing for enhancing the color saturation is not carried out, the grain sense of the display picture is effectively weakened by the algorithm, and the side viewing angle is ensured.

The edge of the skin color area is limited by RGB function relation, which is defined by two or more RGB linear relation curves, and a triangular skin color detecting area is formed by adjusting the positions of two lines. Or the positions of the four lines are adjusted to form a pentagonal skin color area together, so that the skin color needing to be processed outside the skin color area is located in the skin color area. In conclusion, the scheme reduces the picture graininess, improves the ultra-wide viewing angle and realizes the improvement of the quality of the large viewing angle.

The method, apparatus, system, and storage medium provided by the embodiments of the present invention are described in detail above, and the principles and embodiments of the present invention are described herein using specific examples, which are provided only to help understand the method and core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. An image processing method for improving an ultra-wide viewing angle, comprising:

selecting a specific color space containing skin color;

selecting a particular one of the constituent primary colors in the particular color space;

selecting a particular value for the particular primary color;

determining a specific color plane in the specific color space corresponding to the specific value of the specific primary color;

determining a target skin tone region in the particular color plane;

receiving an image;

performing first image processing on a part of the image, the color of which accords with the target skin color area, so as to be suitable for large-view-angle display; and

and performing second image processing on the part of the image, the color of which does not accord with the target skin color area.

2. The method as claimed in claim 1, wherein the first image processing comprises a first image processing for enhancing color saturation to fit a large viewing angle display.

3. The method as claimed in claim 2, wherein the second image processing does not include the first image processing for enhancing color saturation.

4. The method as claimed in claim 1, wherein the color space is a red, green and blue (RGB) color space.

5. The method of claim 4, wherein one of the component primaries in the particular color space is blue.

6. The method of image processing for improving an ultra-wide viewing angle according to claim 5, wherein the target skin color region is defined according to a linear relationship on the specific color plane.

7. The method for image processing with improved ultra-wide viewing angle according to claim 5, wherein the target skin color region is a pentagonal region defined by four lines on the specific color plane.

8. The image processing method for improving an ultra-wide viewing angle according to claim 5, wherein the specific value of the specific primary color is a blue value of 75, an intersection of any 2 lines of the four lines is close to a skin color having an RGB value of (133,101,75), and the target skin color region is made to contain the skin color having the RGB value of (133,101, 75).

9. A non-volatile storage medium storing computer-executable instructions that, when loaded into an electronic device, direct the electronic device to perform the method of any one of claims 1 to 8.

10. An image processing apparatus for improving an ultra-wide viewing angle, comprising a processor and an image receiver: it is characterized by comprising:

the processor selects a specific color space containing skin color;

the processor selecting a particular one of the constituent primary colors in the particular color space;

the processor selecting a particular value of the particular primary color;

the processor determining a particular color plane in the particular color space corresponding to the particular value of the particular primary color;

the processor determining a target skin tone region in the particular color plane;

the processor receiving an image from the image receiver;

the processor performs first image processing on a part of the image, the color of which conforms to the target skin color area, so as to be suitable for large-view-angle display; and

the processor performs a second image processing on a portion of the image having a color that does not conform to the target skin color region.