TWI769692B - Image processing method, computer device and storage medium - Google Patents

Abstract

The present application provides an image processing method. The method includes obtaining a user head portrait taken by a camera; identifying a hair region and a scalp region from the user head portrait; calculating a proportion of the scalp region based on the hair region and the scalp region; comparing the proportion of the scalp area with a preset value to determine whether the user is bald; processing the scalp area using hair color in the hair area when it is determined that the user is bald. The present application also provides a computer device for realizing the image processing method. The present application can automatically detect baldness and supplement the original hair color in scalp area.

Description

Image processing method, computer device and storage medium

The present invention relates to the technical field of image processing, in particular to an image processing method and a computer device.

The living pressure of today's society is so great that many people start to lose a lot of hair and go bald at a young age. Therefore, some users will have low self-confidence due to baldness when they communicate with others via video.

In view of the above, it is necessary to propose an image processing method and a computer device, which can automatically detect the bald areas of the characters in the images or videos, and supplement the original hair color to generate the completed images or videos, so as to maintain the user's image. , so that people will not have psychological problems due to the baldness being photographed during the video.

The image processing method includes: acquiring a user's avatar photographed by a camera; identifying a hair area and a scalp area from the user's avatar; calculating the proportion of the scalp area based on the hair area and the scalp area; The comparison between the proportion of the area and the preset value determines whether the user is bald; and when it is determined that the user is bald, complementary color processing is performed on the scalp area to obtain the user's avatar after the complementary color processing.

Preferably, the method further includes: transmitting the user's avatar after the complementary color processing to other terminals.

Preferably, said identifying the user's hair area and scalp area from the user's avatar The domain includes: using a face detection algorithm to determine the coordinates of the face frame from the user's avatar; determining an initial position based on the coordinates of the face frame; and based on the initial position, the user's avatar in the The coordinates of each primitive point, and the RGB value of each primitive point determine the hair area and scalp area.

Preferably, the face frame is determined by four coordinate points, and the four coordinate points are respectively the first coordinate P1 (Xmin, Ymax), the second coordinate P2 (Xmax, Ymax), and the third coordinate P3 (Xmin, Ymin), the fourth coordinate P4 (Xmax, Ymin), wherein Xmax refers to the maximum X coordinate corresponding to the face frame in the user's avatar, and Xmin refers to the face frame in the user's avatar. The minimum X coordinate corresponding to the avatar is, Ymax refers to the maximum Y coordinate corresponding to the face frame in the user avatar, and Ymin refers to the face frame corresponding to the user avatar. The minimum Y coordinate; the initial position refers to the position of the straight line formed by the fifth coordinate P5 (X5, Y5) and the sixth coordinate P6 (X6, Y6) in the user avatar, where X5= Xmin, Y5=Ymax+a; X6=Xmax, Y6=Ymax+a, a is a preset value; wherein, the ordinate of each primitive point included in the hair area is greater than Y5 and Y6, and the hair area is The RGB value of each primitive point included belongs to the first preset range; wherein, the ordinate of each primitive point included in the scalp area is greater than Y5 and Y6, and each primitive point included in the scalp area is The RGB values of , belong to a second preset range; wherein, the first preset range and the second preset range have no intersection.

Preferably, the calculating the proportion of the scalp area based on the hair area and the scalp area includes: calculating the total number T1 of primitive points occupied by the hair area; calculating the total number T2 of primitive points occupied by the scalp area; and Calculate the proportion P of the scalp area, where P=T2/(T1+T2)*100%.

Preferably, performing complementary color processing on the scalp area includes: setting the RGB value of each primitive point of the scalp area to any value within the first preset range.

Preferably, performing complementary color processing on the scalp area includes: calculating the average value of RGB values of all primitive points in the hair area; and setting the RGB value of each primitive point in the scalp area to the said average.

Preferably, performing complementary color processing on the scalp area includes: using contour extraction calculation extracting a contour corresponding to the scalp area; copying an image from the hair area according to the shape and size of the contour; and filling the copied image into the scalp area.

The computer device includes a memory and a processor, the memory is used for storing at least one instruction, and the processor is used for implementing the image processing method when executing the at least one instruction.

The computer-readable storage medium stores at least one instruction, and the at least one instruction implements the image processing method when executed by the processor.

Compared with the prior art, the image processing method and computer device provided by the present invention,

It can automatically detect the bald areas of the characters in the images or videos, and fill in the original hair color to generate the completed images or videos, so as to maintain the user's image, so that people will not be affected by the baldness being photographed during the video. produce psychological problems.

3: Computer device

30: Image processing system

301: Get Mods

302: Execute the module

31: Storage

32: Processor

33: Camera

5: User avatar

51: face frame

52: Hair Area

53: Scalp Area

P1, P2, P3, P4, P5, P6: coordinate points

S1~S6: Steps

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to the provided drawings without creative work.

1 is a flowchart of an image processing method provided by a preferred embodiment of the present invention

Figure 2 illustrates a face frame.

FIG. 3 is a functional module diagram of an image processing system provided by a preferred embodiment of the present invention.

FIG. 4 is a structural diagram of a computer device according to a preferred embodiment of the present invention.

In order to more clearly understand the above objects, features and advantages of the present invention, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments may be combined with each other under the condition of no conflict.

In the following description, many specific details are set forth in order to facilitate a full understanding of the present invention, and the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terms used herein in the description of the present invention are for the purpose of describing specific embodiments only, and are not intended to limit the present invention.

FIG. 1 is a flowchart of an image processing method provided by a preferred embodiment of the present invention.

In this embodiment, the image processing method can be applied to a computer device. For a computer device that needs to perform image processing, the image processing function provided by the method of the present invention can be directly integrated on the computer device, or the computer device can be used for image processing. The form of software development kit (Software Development Kit, SDK) runs on the computer device.

As shown in FIG. 1 , the image processing method specifically includes the following steps. According to different requirements, the order of the steps in the flowchart can be changed, and some steps can be omitted.

In step S1, the computer device acquires the user's avatar photographed by the camera.

In one embodiment, the camera shoots the user in real time. The computer device acquires the video shot by the camera. The user avatar may refer to an image corresponding to any frame of the video captured by the camera.

Step S2, the computer device identifies the hair area and the scalp area from the user's avatar.

In one embodiment, the identifying the user's hair area and scalp area from the user avatar includes (a1)-(a3):

(a1) Using a face detection algorithm to determine the coordinates of the face frame from the user's avatar.

In one embodiment, the face frame is determined by four coordinate points, and the four coordinate points are respectively the first coordinate P1 (Xmin, Ymax), the second coordinate P2 (Xmax, Ymax), and the third coordinate P3 (Xmin, Ymin), the fourth coordinate P4 (Xmax, Ymin), where Xmax refers to the The maximum X coordinate corresponding to the face frame in the user avatar, Xmin refers to the minimum X coordinate corresponding to the face frame in the user avatar, and Ymax refers to the face frame in the The maximum Y coordinate corresponding to the user avatar, and Ymin refers to the minimum Y coordinate corresponding to the face frame in the user avatar.

For example, referring to FIG. 2 , the face frame 51 is determined by the first coordinate P1 , the second coordinate P2 , the third coordinate P3 , and the fourth coordinate P4 in the user avatar 5 .

(a2) Determine an initial position based on the coordinates of the face frame.

In one embodiment, the initial position refers to a position in the user's avatar based on a straight line formed by the fifth coordinate P5 (X5, Y5) and the sixth coordinate P6 (X6, Y6), wherein, X5=Xmin, Y5=Ymax+a; X6=Xmax, Y6=Ymax+a, a is the default value, for example, a is equal to 5 cm.

(a3) Determine the hair area and scalp area based on the initial position, the coordinates of each primitive point in the user's avatar, and the RGB value of each primitive point.

In one embodiment, the ordinate of each primitive point included in the hair region is greater than Y5 and Y6, and the RGB of each primitive point included in the hair region belongs to a first preset range. That is, the ordinate of each primitive point included in the hair region is located above the initial position. For example, still referring to FIG. 2 , the computerized device determines the hair region 52 .

In one embodiment, the first preset range may be a range of RGB values corresponding to pure black and light black.

In one embodiment, the ordinate of each primitive point included in the scalp area is greater than Y5 and Y6, and the RGB value of each primitive point included in the scalp area belongs to the second preset range. That is, the ordinate of each primitive point included in the scalp area is located above the initial position. For example, still referring to FIG. 2 , the computerized device determines the scalp area 53 .

In one embodiment, the first preset range may be a range of RGB values corresponding to pure skin tones and light skin tones.

In one embodiment, the first preset range and the second preset range have no intersection.

Step S3, the computer device calculates the proportion of the scalp area based on the hair area and the scalp area.

In one embodiment, the calculating the proportion of the scalp area based on the hair area and the scalp area includes: calculating the total number T1 of primitive points occupied by the hair area; calculating the total number of primitive points occupied by the scalp area T2; and calculating the proportion P of the scalp area, where P=T2/(T1+T2)*100%.

Step S4, the computer device determines whether the user is bald based on the comparison of the proportion of the scalp area with a preset value (eg, 20%). When it is determined that the user is bald, step S5 is performed. When it is determined that no user is bald, step S6 is performed.

In one embodiment, when the proportion of the scalp area is greater than or equal to the preset value, the computer device determines that the user is bald. When the proportion of the scalp area is less than the preset value, the computer device determines that the user is not bald.

Step S5, when it is determined that the user is bald, the computer device performs complementary color processing on the scalp area to obtain the user's avatar after the complementary color processing.

In the first embodiment, the performing complementary color processing on the scalp area includes: setting the RGB value of each primitive point of the scalp area to any value within the first preset range.

In the second embodiment, performing complementary color processing on the scalp area includes: calculating the average value of RGB values of all primitive points in the hair area; and converting the RGB values of each primitive point in the scalp area The value is set to the average value.

In the third embodiment, performing complementary color processing on the scalp area includes: extracting an outline corresponding to the scalp area by using an outline extraction algorithm; copying an image from the hair area according to the shape and size of the outline ; and filling the copied image into the scalp area.

In one embodiment, the shape of the copied image is the same as the shape of the contour, and the size of the copied image is the same as the size of the contour.

Step S6, the computer device transmits the user's avatar to other terminals.

It should be noted that, when the process is performed from step S5 to step S6, in step S6, the computer device transmits the user's avatar after the complementary color processing to the other terminal. When the process is performed from step S4 to step S6, in step S6, the computer device transmits the user avatar acquired in step S1 to the other terminal.

The other terminal may be a computer, a mobile phone, a tablet computer, or other equipment.

It should be noted that, when it is in video communication, step S6 may be included. Step S6 may not be included if only a computer device is used to take a photo, and the bald area is subjected to complementary color processing.

In addition, according to the above steps of the present invention, it can be seen that when the computer device performs video communication with the other terminal, because the computer device can perform baldness judgment on each frame of image captured by the camera, and when baldness is determined, it will Complementary color treatment for baldness so that the bald area can be the same as the hairy area. In this way, the bald head image captured by the camera can be prevented from being directly transmitted to other terminals.

1 describes the image processing method of the present invention in detail, and the functional modules of the software system for implementing the image processing method and the hardware device architecture for implementing the image processing method are introduced below with reference to FIG. 3 and FIG. 4 .

It should be understood that the embodiments are only used for illustration, and are not limited by this structure in the scope of the patent application.

Referring to FIG. 3 , it is a module diagram of an image processing system provided by a preferred embodiment of the present invention.

In some embodiments, the image processing system 30 runs in the computer device 3 . The image processing system 30 may include a plurality of functional modules composed of program code segments. The program codes of each program segment in the image processing system 30 can be stored in the memory 31 of the computer device 3 and executed by at least one processor 32 to realize the image processing function (see description in FIG. 2 for details).

In this embodiment, the image processing system 30 can be divided into a plurality of functional modules according to the functions performed by the image processing system 30 . The function modules may include: an acquisition module 301 and an execution module 302 . The module referred to in the present invention refers to a module that can be executed by at least one processor and can be fixed A series of computer program segments for functions, which are stored in memory. In this embodiment, the functions of each module will be described in detail in subsequent embodiments.

Specifically, the obtaining module 301 may be used to obtain the user's avatar photographed by the camera. Execution module 302 may be used to identify hair and scalp regions from the user avatar. The execution module 302 may also be used to calculate the proportion of the scalp area based on the hair area and the scalp area; determine whether the user is bald based on the comparison of the proportion of the scalp area and a preset value; and when determining whether the user is bald When the head is bald, the scalp area is subjected to complementary color processing to obtain the user's avatar after the complementary color processing; and the user's avatar subjected to the complementary color processing is transmitted to other terminals.

Referring to FIG. 4 , it is a schematic structural diagram of a computer device according to a preferred embodiment of the present invention. In a preferred embodiment of the present invention, the computer device 3 includes a storage 31 , at least one processor 32 , and a camera 33 . Those skilled in the art should understand that the structure of the computer device shown in FIG. 4 does not constitute a limitation of the embodiments of the present invention. It may be a bus-bar structure or a star structure. The computer device 3 may also include More or less other hardware or software, or different component arrangements are shown.

In some embodiments, the computer device 3 includes a terminal capable of automatically performing numerical calculation and/or information processing according to pre-set or stored instructions, the hardware of which includes but is not limited to microprocessors, dedicated integrated circuits, Programmable design gate arrays, digital word processors and embedded devices, etc.

It should be noted that the computer device 3 is only an example, and other existing or future electronic products that can be adapted to the present invention should also be included within the protection scope of the present invention, and are incorporated herein by reference.

In some embodiments, the storage 31 is used to store program codes and various data, such as the image processing system 30 installed in the computer device 3 , and realize high-speed and automatic completion during the operation of the computer device 3 . Access to programs or data. The storage 31 includes a Read-Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (Erasable Programmable Read Only Memory), and a Programmable Read-Only Memory (PROM). -Only Memory, EPROM), one-time programmable read-only memory (One-time Programmable Read-Only Memory (OTPROM), Electronically-Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM) or other optical discs Storage, disk storage, tape storage, or any other computer-readable storage medium that can be used to carry or store data.

In some embodiments, the at least one processor 32 may be composed of an integrated circuit, for example, may be composed of a single packaged integrated circuit, or may be composed of a plurality of integrated circuits packaged with the same function or different functions , including one or more central processing units (Central Processing Units, CPUs), microprocessors, digital signal processing chips, graphics processors and combinations of various control chips. The at least one processor 32 is the control core (Control Unit) of the computer device 3, and uses various interfaces and lines to connect the various components of the entire computer device 3, by running or executing the program stored in the storage 31 or module, and call the data stored in the storage 31 to execute various functions of the computer device 3 and process data, such as the function of image processing.

Although not shown, the computer device 3 may also include a power source (such as a battery) for supplying power to various components. Preferably, the power source may be logically connected to the at least one processor 32 through the power management device, so as to realize the realization through the power management device. Manage functions such as charging, discharging, and power management. The power supply may also include one or more of a DC or AC power source, a recharging device, a power failure detection circuit, a power converter or inverter, a power supply status indicator, or any other element. The computer device 3 may also include various sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be described herein again.

It should be understood that the embodiments are only used for illustration, and are not limited by this structure in the scope of the patent application.

The above-mentioned integrated units implemented in the form of software function modules can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, and includes several instructions for causing a computer device (which may be a server, a personal computer, etc.) or a processor (processor) to execute parts of the methods described in various embodiments of the present invention.

In a further embodiment, referring to FIG. 3 , the at least one processor 32 can execute the operating device of the computer device 3 and various installed applications (such as the image processing system 30 ), program codes, etc., For example, the above-mentioned modules.

The storage 31 stores program codes, and the at least one processor 32 can call the program codes stored in the storage 31 to execute related functions. For example, each module described in FIG. 3 is a program code stored in the storage 31 and executed by the at least one processor 32, so as to realize the functions of the various modules to achieve image processing. Purpose.

In one embodiment of the present invention, the storage 31 stores one or more instructions (ie, at least one instruction), and the at least one instruction is executed by the at least one processor 32 to realize the image shown in FIG. 1 . the purpose of processing.

In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the modules is only a logical function division, and other division methods may be used in actual implementation.

The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, they can be located in one place or distributed to multiple networks. on the unit. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or can be implemented in the form of hardware plus software function modules.

It will be apparent to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, but that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the embodiments are to be regarded in all respects as illustrative and not restrictive, the scope of the invention being defined by the appended claims rather than by the foregoing description, and it is therefore intended that All changes that come within the meaning and range of equivalents of the claims are intended to be embraced within the present invention. Any reference sign in a claim shall not be construed as limiting the claim to which it relates. Furthermore, it is clear that the word "comprising" does not exclude other units or, and the singular does not exclude the plural. Multiple units or means stated in the device claim may also be implemented by one unit or means through software or hardware. The terms first, second, etc. are used to denote names and do not denote any particular order.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be Modifications or equivalent substitutions can be made without departing from the spirit and scope of the technical solutions of the present invention.

S1~S6: Steps

Claims (9)

An image processing method, wherein the method comprises: acquiring a user's avatar photographed by a camera; using a face detection algorithm to determine the coordinates of a face frame from the user's avatar, the face frame is composed of four coordinate points It is determined that the four coordinate points include a first coordinate P1 (Xmin, Ymax), a second coordinate P2 (Xmax, Ymax), a third coordinate P3 (Xmin, Ymin), and a fourth coordinate P4 (Xmax, Ymin), Wherein, Xmax is the maximum X coordinate corresponding to the face frame in the user avatar, Xmin is the minimum X coordinate corresponding to the face frame in the user avatar, and Ymax is the face The maximum Y coordinate corresponding to the frame in the user avatar, Ymin is the minimum Y coordinate corresponding to the face frame in the user avatar; an initial position is determined based on the coordinates of the face frame, so The initial position is the position of the straight line formed by the fifth coordinate P5 (X5, Y5) and the sixth coordinate P6 (X6, Y6) in the user's avatar, wherein X5=Xmin, Y5=Ymax+ a; X6=Xmax, Y6=Ymax+a, a is a preset value; and determined based on the initial position, the coordinates of each primitive point in the user avatar, and the RGB value of each primitive point a hair area and a scalp area; calculating the proportion of the scalp area based on the hair area and the scalp area; determining whether the user is bald based on the comparison of the proportion of the scalp area and a preset value; and when it is determined that the user is bald , performing complementary color processing on the scalp area to obtain the user's avatar after the complementary color treatment. The image processing method according to claim 1, wherein the method further comprises: transmitting the user's avatar after the complementary color processing to other terminals. The image processing method according to claim 1, wherein the ordinate of each primitive point included in the hair region is greater than Y5 and Y6, and the RGB value of each primitive point included in the hair region belongs to the first preset range; Wherein, the ordinate of each primitive point included in the scalp area is greater than Y5 and Y6, and the RGB value of each primitive point included in the scalp area belongs to the second preset range; wherein, the first preset The set range has no intersection with the second preset range. The image processing method according to claim 1, wherein calculating the proportion of the scalp area based on the hair area and the scalp area comprises: calculating the total number T1 of primitive points occupied by the hair area; calculating the scalp area The total number of primitive points T2 occupied by the area; and the proportion P occupied by the scalp area is calculated, wherein, P=T2/(T1+T2)*100%. The image processing method according to claim 4, wherein the performing complementary color processing on the scalp area comprises: setting the RGB value of each primitive point of the scalp area to a value within the first preset range any value. The image processing method according to claim 4, wherein the performing complementary color processing on the scalp area comprises: calculating the average value of RGB values of all primitive points in the hair area; The RGB value of each primitive point is set to the average value. The image processing method according to claim 4, wherein performing complementary color processing on the scalp area comprises: extracting a contour corresponding to the scalp area by using a contour extraction algorithm; copying an image of the hair region; and filling the scalp region with the copied image. A computer device, wherein the computer device includes a storage and a processor, the storage is used to store at least one instruction, and the processor is configured to implement any one of claim 1 to 7 when executing the at least one instruction The image processing method. A computer-readable storage medium, wherein the computer-readable storage medium stores at least one instruction, and when the at least one instruction is executed by a processor, implements the image processing method according to any one of claim 1 to 7.

Images