WO2024037556A1

WO2024037556A1 - Image processing method and apparatus, and device and storage medium

Info

Publication number: WO2024037556A1
Application number: PCT/CN2023/113234
Authority: WO
Inventors: 谢一杰; 周栩彬
Original assignee: 北京字跳网络技术有限公司
Priority date: 2022-08-17
Filing date: 2023-08-16
Publication date: 2024-02-22
Also published as: CN115358919A

Abstract

Disclosed in the embodiments of the present disclosure are an image processing method and apparatus, and a device and a storage medium. The method comprises: identifying a target object in an original image to obtain an image of the target object and a segmentation line of the target object, wherein the image of the target object is divided by the segmentation line, an image of any side of the segmentation line serves as a first side image, and the other side image of the segmentation line serves as a second side image; replacing a pixel value of the first side image with a set pixel value; and performing mirror image processing on the second side image on the basis of the segmentation line to obtain a first side mirror image, wherein the first side mirror image and the second side image are mirror images.

Description

Image processing methods, devices, equipment and storage media

This application claims priority to the Chinese patent application with application number 202210988925.6, which was submitted to the China Patent Office on August 17, 2022. The entire content of this application is incorporated into this application by reference.

Technical field

The embodiments of the present disclosure relate to the field of image processing technology, such as an image processing method, device, equipment and storage medium.

Background technique

Image processing applications (Applications, APPs) have developed rapidly, entering users' lives and gradually enriching their spare time. Users can record their lives through videos, photos, etc., and process images through the special effects technology provided on the image processing APP, so that the images can be expressed in richer forms, such as beautification, stylization, expression editing, etc.

Contents of the invention

Embodiments of the present disclosure provide an image processing method, device, equipment and storage medium, which can generate images with mirror effects, enrich the display content of the image, and improve the interest of the image.

In a first aspect, an embodiment of the present disclosure provides an image processing method, including:

Identify the target object in the original image to obtain the target object image and the dividing line of the target object; wherein the target object image is divided into a first side image and a second side image by the dividing line;

Replace the pixel value of the first side image with the set pixel value;

The second side image is mirrored based on the dividing line to obtain a first side mirror image; wherein the first side mirror image and the second side image are mirror images of each other.

In a second aspect, embodiments of the present disclosure also provide an image processing device, including:

The target object recognition module is configured to identify the target object in the original image and obtain the target object image and the dividing line of the target object; wherein the target object image is divided into a first side image and a third side image by the dividing line. Bilateral image;

A pixel value replacement module configured to replace the pixel value of the first side image with a set pixel value;

The mirror processing module is configured to perform mirror processing on the second side image based on the dividing line to obtain a first side mirror image; wherein the first side mirror image and the second side image are mirror images of each other.

In a third aspect, embodiments of the present disclosure also provide an electronic device, where the electronic device includes:

one or more processors;

a storage device for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the image processing method as described in the embodiment of the present disclosure.

In a fourth aspect, embodiments of the present disclosure also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the image processing method as described in the embodiments of the present disclosure.

Description of drawings

Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It is to be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.

Figure 1 is a schematic flowchart of an image processing method provided by an embodiment of the present disclosure;

Figure 2 is a schematic diagram of determining a dividing line of a target object provided by an embodiment of the present disclosure;

Figure 3a is a schematic diagram of a mirror target object provided by an embodiment of the present disclosure;

Figure 3b is a schematic diagram of another mirror target object provided by an embodiment of the present disclosure;

Figure 4 is a schematic structural diagram of an image processing device provided by an embodiment of the present disclosure;

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described below with reference to the accompanying drawings. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that multiple steps described in the method implementations of the present disclosure may be executed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performance of illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "include" and its variations are open-ended, ie, "including but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" "Examples" means "at least some examples". Relevant definitions of other terms will be given in the description below.

Concepts such as "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. relation.

The modifications of "one" and "plurality" mentioned in this disclosure are illustrative and not restrictive. Those skilled in the art will understand that unless the context clearly indicates otherwise, it should be understood as "one or more" .

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

Before using the technical solutions disclosed in the multiple embodiments of this disclosure, users should be informed of the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and their authorization should be obtained.

For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly remind the user that the operation requested will require the acquisition and use of the user's personal information. Therefore, users can autonomously choose whether to provide personal information to software or hardware such as electronic devices, applications, servers or storage media that perform the operations of the technical solution of the present disclosure based on the prompt information.

As an optional but non-limiting implementation method, in response to receiving the user's active request, the method of sending prompt information to the user may be, for example, a pop-up window, and the prompt information may be presented in the form of text in the pop-up window. In addition, the pop-up window can also contain a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

The above notification and user authorization processes are only illustrative and do not limit the implementation of this disclosure. Other methods that satisfy relevant laws and regulations can also be applied to the implementation of this disclosure.

The data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of corresponding laws, regulations and related regulations.

Figure 1 is a schematic flowchart of an image processing method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is suitable for mirroring a target object in an image. The method can be executed by an image processing device, and the device can It is implemented in the form of software and/or hardware, and optionally, it is implemented through electronic equipment. The electronic equipment can be a mobile terminal, a personal computer (Personal Computer, PC) or a server, etc.

As shown in Figure 1, the method includes:

S110, identify the target object in the original image, and obtain the target object image and the dividing line of the target object.

The target object image is divided by a dividing line, and the image on either side of the dividing line is regarded as the first side image, and the image on the other side of the dividing line is regarded as the second side image. The target object can be any object such as human figures, animals, buildings, etc. The target object image can be understood as an image in which the target object is extracted from the original image. The dividing line of the target object can be the central axis of the target object, which is used as the symmetry line for subsequent mirroring processing.

In this embodiment, the target object in the original image is identified and the target object image is obtained by: identifying the target object in the original image to obtain a mask image of the target object; and combining the mask image of the target object with The original images are fused to obtain the target object image.

The pixel value of each pixel in the mask image of the target object represents the confidence that the pixel belongs to the target object. It can be any value between 0 and 1, with 1 being white and 0 being black. It can be stored in the set color channel in the mask image of the target object, for example: it can be the red channel (R), green channel (G) or blue channel (B). To identify the target object in the original image and obtain the mask map of the target object, you can input the original image into the target object recognition model to identify whether each pixel in the original image belongs to the target object, and obtain The confidence that each pixel belongs to the target object, thereby obtaining the mask image of the target object. The method of fusing the mask image of the target object and the original image may be: multiplying the pixel value of the mask image of the target object by the color value (RGBA four-channel value) of the original image to obtain the target object image. In this embodiment, the target object image is obtained based on the mask image of the target object, which can improve the accuracy of extracting the target object from the original image.

Optionally, the method of identifying the target object in the original image and obtaining the dividing line of the target object can be: determining two set key points of the target object in the original image; connecting the two set key points Determine the dividing line for the target object.

The key points can be two points located on the central axis of the target object. The method of determining the two set key points of the target object in the original image may be: input the original image into the central axis determination module and output the coordinate information of the two set key points. The method of determining the connection line between the two set key points as the dividing line of the target object may be: determining the expression of the dividing line based on the coordinate information of the two set key points. For example, assuming that the coordinate information of one of the two set key points is (x1, y1), and the coordinate information of the other set key point is (x2, y2), then the expression of the dividing line can be It is: (x-x1)/(x2-x1)=(y-y1)/(y2-y1). In this embodiment, the dividing line is determined based on two set key points, which can reduce the amount of calculation and improve calculation efficiency.

Optionally, if the target object is a portrait, and the portrait includes a face and/or a human body, the method of determining the two key points of the target object in the original image may be: determining the key point between the eyebrows on the face of the portrait in the original image. and the chin key point; the way to determine the connection line between the two set key points as the dividing line of the target object can be: determine the connection line between the eyebrow key point and the chin key point as the dividing line of the portrait.

First, 68 facial key points are detected on the face of the portrait, and the eyebrow center is extracted from the 68 facial key points. The key point (No. 49 key point) and the chin key point (No. 16 key point), and finally the line connecting the eyebrow key point and the chin key point is determined as the dividing line of the portrait. In this embodiment, the dividing line of the portrait is determined through the key points of the eyebrows and the chin key point, which can improve the accuracy of determining the dividing line of the portrait.

Optionally, the method of identifying the target object in the original image and obtaining the dividing line of the target object may be: determining the detection frame of the target object in the original image; determining the dividing line of the target object according to the central axis of the detection frame.

The method of determining the detection frame of the target object in the original image may be: input the original image into the target detection model and output the detection frame of the target object. The way to determine the central axis of the detection frame as the dividing line of the target object can be: obtain the horizontal central axis or vertical central axis of the detection frame, then obtain the posture information of the target object in the original image, and then obtain the posture information of the target object based on the posture information of the target object. Rotate the horizontal central axis or vertical central axis, and determine the rotated horizontal central axis or vertical central axis as the dividing line of the target object.

For example, FIG. 2 is a schematic diagram of determining the dividing line of the target object in this embodiment. As shown in Figure 2, the dividing line of the target object is determined according to the vertical central axis of the detection frame. In this embodiment, the dividing line of the target object is determined based on the central axis of the detection frame, which can improve the efficiency of determining the dividing line.

S120: Replace the pixel value of the first side image with the set pixel value.

The first side image can be an image on either side of the dividing line. For example: assuming the dividing line is a vertical dividing line, the first side image can be the image on the right side or the left side of the dividing line; assuming the dividing line is a horizontal dividing line, the first side image can be the image on the upper side of the dividing line Or the image below. The set pixel value can be a pixel value set arbitrarily by the user or a pixel value selected from the background area of the original image.

In this embodiment, the process of replacing the pixel values of the first side image with the set pixel values may be: first extracting the pixels belonging to the first side image in the target object image, and then converting the pixels belonging to the first side image into The pixel value is replaced with the set pixel value.

Optionally, the method of replacing the pixel value of the first side image with the set pixel value can be: traverse the pixel points of the target object image, enter the coordinate information of each traversed pixel point into the expression of the dividing line, and obtain The result value of the traversed coordinate information of each pixel point; if the result value of the traversed coordinate information of each pixel point is greater than the set value, the pixel of each traversed pixel point will be The value is replaced with the set pixel value.

The expression of the dividing line can be understood as the functional expression of the dividing line. The functional expression is a linear equation of two variables, which can be expressed as f(x, y)=a*x+b*y+c, where a, b and c are constants. The setting value can be 0. The expression of inputting the coordinate information of the traversed pixel point into the dividing line can be understood as the functional expression of substituting the coordinate information of the traversed pixel point into the dividing line. If the result value is greater than 0, the traversed pixel point belongs to the first Side image, if the result value is equal to 0, the pixel is located on the dividing line, if the result value is less than 0, the pixel belongs to the second side image. For example, assuming that the coordinate information of the traversed pixel is (x0, y0), the result value is f(x0, y0)=a*x0+b*y0+c, if f(x0, y0)>0 , then the traversed pixel belongs to the first side image, and the pixel value of the traversed pixel is replaced with the set pixel value.

Optionally, the method of replacing the pixel value of the first side image with the set pixel value can be: traverse the pixel points of the target object image, enter the coordinate information of each traversed pixel point into the expression of the dividing line, and obtain Result value; if the result value of the traversed coordinate information of each pixel is less than the set value, then the pixel value of each traversed pixel is replaced with the set pixel value.

The expression of the dividing line can be understood as the functional expression of the dividing line. The functional expression is a linear equation of two variables, which can be expressed as f(x, y)=a*x+b*y+c, where a, b and c are constants. The setting value can be 0. The expression of inputting the coordinate information of the traversed pixel point into the dividing line can be understood as the functional expression of substituting the coordinate information of the traversed pixel point into the dividing line. If the result value is less than 0, the traversed pixel point belongs to the first For the side image, if the result value is equal to 0, the pixel is located on the dividing line. If the result value is greater than 0, the pixel belongs to the second side image. For example, assuming that the coordinate information of the traversed pixel is (x0, y0), the result value is f(x0, y0)=a*x0+b*y0+c, if f(x0, y0)<0 , then the traversed pixel belongs to the first side image, and the pixel value of the traversed pixel is replaced with the set pixel value. In this embodiment, the coordinate information of the traversed pixel is input into the expression of the dividing line to obtain the result value to determine whether the pixel belongs to the first side image, which can improve the accuracy of replacing the pixel value.

Optionally, the method of replacing the pixel value of the first side image with the set pixel value may be: selecting a pixel value from the background area of the original image as the set pixel value; replacing the pixel value of the first side image with the set pixel value. To set the pixel value.

Select a pixel value from the background area of the original image as a way to set the pixel value: arbitrarily select a pixel point from the background area and use the pixel value of the pixel point as the set pixel value; or, set the pixel value in the background area Calculate the average of the pixel values of the pixels, and use the average pixel value as the set pixel value; or, select a pixel from the pixels located on the edge of the target object and in the background area, and use the pixel value of the pixel as the set pixel value. Set the pixel value; or average the pixel values of the pixels located on the edge of the target object and in the background area, and use the average pixel value as the set pixel value. In this embodiment, replacing the pixel values of the first side image with pixel values selected from the background area of the original image can make the subsequently generated first side mirror image and the background area smoothly transition and improve the display effect of the mirror target object. .

Optionally, after replacing the pixel values of the first side image with the set pixel values, the following step is also included: blurring the first side image after replacing the pixel values.

The blur processing method can be Gaussian blur. In this embodiment, the method of blurring the first side image after replacing the pixel values may be: performing multiple Gaussian blur on the first side image after replacing the pixel values to obtain a blurred first side image. In this embodiment, the first side image after replacing the pixel values is blurred, so that the first side image can be hidden and the first side image can be prevented from affecting the second side image. Display effect of mirrored image on one side.

S130: Mirror the second side image based on the dividing line to obtain the first side mirror image.

The first side mirror image and the second side image are mirror images of each other, that is, the second side image and the first side mirror image are symmetrical with respect to the dividing line.

In this embodiment, the method of mirroring the second side image based on the dividing line may be: determining the pixel points of each pixel in the second side image that are symmetrical with respect to the dividing line, and then converting the pixels of the second side image to The pixel value is used as the pixel value of the pixel point that is symmetrical with the pixel point of the second side image, and the first side image is rendered based on the determined pixel value to obtain the first side mirror image.

Optionally, the second side image is mirrored based on the dividing line. The method of obtaining the first side mirror image may be: for the pixel points of the second side image, determine the pixel points of the second side image that are symmetrical with respect to the dividing line. pixels of the first side image; determine the pixel values of the pixels of the second side image as target pixel values of the pixels of the first side image; render the first side image based on the target pixel value to obtain the first side mirror image.

The method of determining the pixel points of the first side image in which the pixel points of the second side image are symmetrical with respect to the dividing line may be: obtaining the coordinate information of the pixel points of the second side image and the functional expression of the dividing line, and determining the first side image based on the symmetry principle. The coordinate information of the pixel points of the first side image where the pixel points of the two side images are symmetrical with respect to the dividing line. Among them, the implementation process of the symmetry principle will not be described again here. Exemplarily, Figures 3a-3b are schematic diagrams of the mirror target object generated in this embodiment. As shown in Figures 3a-3b, the target object is a portrait, and the right side of the portrait is the generated first side mirror image. The portrait The left side of is the portrait of the original image. In this embodiment, mirror processing is performed on the second side image based on the dividing line, which can improve the accuracy of obtaining the mirror image.

Optionally, before mirroring the second side image based on the dividing line, the method further includes the following steps: obtaining the screen ratio; transforming the dividing line based on the screen ratio; and mirroring the second side image based on the dividing line. , including: mirroring the second side image based on the transformed dividing line.

The screen ratio can be understood as the ratio between the height and width of the current terminal device screen. For example, the screen ratio can be: 16:9 or 4:3, etc. In this embodiment, the method of transforming the dividing line based on the screen ratio may be: transforming the slope of the dividing line based on the screen ratio. Assuming that the slope of the dividing line is k and the screen ratio is 16:9, the transformed slope is k*16/9. Optionally, the method of transforming the dividing line based on the screen ratio can also be: transforming the coordinates of two points on the dividing line based on the screen ratio, and generating a new dividing line based on the two points after the transformed coordinates. For example, assume that the coordinates of the two points on the dividing line are A(x1, y1) and B(x2, y2), the screen ratio is 16:9, and the transformed coordinates of the two points are A1(x1, y1*16/ 9), B1 (x2, y2*16/9), and finally the connection between A1 and B1 is used as the transformed dividing line. In this embodiment, transforming the dividing line based on the screen ratio can prevent the mirror target object from being stretched when displayed on the current screen.

The technical solution of the embodiment of the present disclosure is to identify the target object in the original image and obtain the target object image and the dividing line of the target object; wherein, the target object image is divided into a first side image and a second side image by the dividing line; The pixel value of the first side image is replaced with the set pixel value; the second side image is mirrored based on the dividing line to obtain the first side mirror image; wherein the first side mirror image and the second side image are mirror images of each other. The image processing method provided by the embodiment of the present disclosure mirrors the target object on one side of the dividing line based on the dividing line of the target object to obtain a mirror image of the target object, which can generate an image with mirroring special effects and enrich the display content of the image. .

Figure 4 is a schematic structural diagram of an image processing device provided by an embodiment of the present disclosure. As shown in Figure 4, the device includes: a target object recognition module 410, configured to identify target objects in the original image, and obtain the target object. The object image and the dividing line of the target object; wherein the target object image is divided into a first side image and a second side image by the dividing line; the pixel value replacement module 420 is configured to replace the first side image The pixel value of is replaced with the set pixel value; the mirror processing module 430 is configured to perform mirror processing on the second side image based on the dividing line to obtain a first side mirror image; wherein the first side mirror image and The second side images are mirror images of each other.

Optionally, the target object identification module 410 is configured to identify the target object in the original image and obtain the target object image in the following manner: identify the target object in the original image and obtain a mask image of the target object; The mask image of the target object is fused with the original image to obtain the target object image.

Optionally, the target object recognition module 410 is configured to identify the target object in the original image and obtain the dividing line of the target object in the following manner: determine two set key points of the target object in the original image; combine the two Set the connecting line of key points as the dividing line of the target object.

Optionally, if the target object is a portrait, and the portrait includes a face and/or a human body, the target object identification module 410 is configured to determine two set key points of the target object in the original image in the following manner: determine The key point between the eyebrows and the key point on the chin in the portrait face; the target object recognition module 410 is configured to determine the connection line between the two set key points as the dividing line of the target object in the following way: the key point between the eyebrows and the key point on the chin The connecting line is determined as the dividing line of the portrait.

Optionally, the target object identification module 410 is configured to identify the target object in the original image and obtain the dividing line of the target object in the following manner: determine the detection frame of the target object in the original image; determine the target according to the central axis of the detection frame. The dividing line of the object.

Optionally, the pixel value replacement module 420 is configured to: traverse the pixel points of the target object image, input the coordinate information of each traversed pixel point into the expression of the dividing line, and obtain each of the traversed pixel points. The result value of the coordinate information of the pixel point; if the result value of the coordinate information of each pixel point traversed is greater than the set value, then the pixel value of each pixel point traversed is replaced with the set pixel value; or , if the result value of the traversed coordinate information of each pixel point is less than the set value, then the pixel value of each traversed pixel point is replaced with the set pixel value.

Optionally, the pixel value replacement module 420 is configured to: select a pixel value from the background area of the original image as the set pixel value; and replace the pixel value of the first side image with the set pixel value.

Optionally, the device further includes: a blur processing module configured to: blur the first side image after replacing the pixel values.

Optionally, the mirror processing module 430 is configured to: for the pixel points of the second side image, determine the pixel points of the first side image in which the pixel points of the second side image are symmetrical with respect to the dividing line; The pixel value of the point is determined as the target pixel value of the pixel point of the first side image; the first side image is rendered based on the target pixel value to obtain the first side mirror image.

Optionally, the device also includes: a transformation module, configured to: obtain the screen ratio; transform the dividing line based on the screen ratio; optionally, the mirror processing module 430 is configured to: based on the transformed dividing line, the second The side image is mirrored.

The image processing device provided by the embodiments of the present disclosure can execute the image processing method provided by any embodiment of the present disclosure, and has functional modules and effects corresponding to the execution method.

The multiple units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned divisions, as long as they can achieve the corresponding functions; in addition, the names of the multiple functional units are only for the convenience of distinguishing each other. , are not used to limit the protection scope of the embodiments of the present disclosure.

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Referring now to FIG. 5 , a schematic structural diagram of an electronic device (such as the terminal device or server in FIG. 5 ) 500 suitable for implementing embodiments of the present disclosure is shown. Terminal devices in embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (Personal Digital Assistant, PDA), tablet computers (Portable Android Device, PAD), portable multimedia players Mobile terminals such as (Portable Media Player, PMP), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital television (television, TV), desktop computers, etc. The electronic device shown in FIG. 5 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG. 5 , the electronic device 500 may include a processing device (such as a central processing unit, a graphics processor, etc.) 501 , which may process data according to a program stored in a read-only memory (Read-Only Memory, ROM) 502 or from a storage device. 508 loads the program in the random access memory (Random Access Memory, RAM) 503 to perform various appropriate actions and processes. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. Processing device 501, ROM 502 and RAM 503 are connected to each other via bus 504. An input/output (I/O) interface 505 is also connected to bus 504.

Generally, the following devices can be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a Liquid Crystal Display (LCD) , an output device 507 such as a speaker, a vibrator, etc.; a storage device 508 including a magnetic tape, a hard disk, etc.; and a communication device 509. Communication device 509 may allow electronic device 500 to communicate wirelessly or wiredly with other devices to exchange data. Although FIG. 5 illustrates electronic device 500 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.

According to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication device 509, or from storage device 508, or from ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

The electronic device provided by the embodiments of the present disclosure and the image processing method provided by the above embodiments belong to the same inventive concept. Technical details that are not described in detail in this embodiment can be referred to the above embodiments, and this embodiment has the same features as the above embodiments. Effect.

Embodiments of the present disclosure provide a computer storage medium on which a computer program is stored. When the program is executed by a processor, the image processing method provided by the above embodiments is implemented.

The computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard drives, RAM, ROM, Erasable Programmable Read-Only Memory Memory, EPROM) or flash memory, optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. While in this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which It contains computer-readable program code. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate using any currently known or future developed network protocol, such as HyperText Transfer Protocol (HTTP), and can communicate with digital data in any form or medium. Communications (e.g., communications network) interconnections. Examples of communication networks include local area networks (LANs), wide area networks (WANs), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any current network for knowledge or future research and development.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.

The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: identifies the target object in the original image and obtains the target object image and the target. The dividing line of the object; wherein the target object image is divided by the dividing line, and the image on any side of the dividing line is used as the first side image, and the image on the other side of the dividing line is used as the second side image. side image; replace the pixel value of the first side image with a set pixel value; perform mirror processing on the second side image based on the dividing line to obtain a first side mirror image; wherein, the first side The mirror image and the second side image are mirror images of each other.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages—such as "C" or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In situations involving remote computers, the remote computer may be connected to the user computer through any kind of network, including a LAN or WAN, or may be connected to an external computer (eg, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, segment, or portion of code that Or a portion of the code contains one or more executable instructions for implementing specified logical functions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.

The units/modules described in the embodiments of the present disclosure may be implemented in software or hardware. The name of the unit/module does not constitute a limitation on the unit itself under certain circumstances. For example, the target object recognition module can also be described as "identifying the target object in the original image, obtaining the target object image and the target Module of the object's dividing line".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: field programmable gate array (Field Programmable Gate Array, FPGA), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), application specific standard product (Application Specific Standard Parts (ASSP), System on Chip (SOC), Complex Programmable Logic Device (CPLD), etc.

In the context of this disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, RAM, ROM, EPROM or flash memory, optical fiber, portable CD-ROM, optical storage device, magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, an image processing method is provided, including: identifying a target object in an original image, and obtaining an image of the target object and a dividing line of the target object; wherein, the target object The image is divided by the dividing line, and the image on either side of the dividing line is taken as the first side image, and the image on the other side of the dividing line is taken as the second side image; The pixel value is replaced with the set pixel value; the second side image is mirrored based on the dividing line to obtain a first side mirror image; wherein the first side mirror image and the second side image are mutually exclusive Mirror.

Optionally, identifying the target object in the original image and obtaining the target object image includes: identifying the target object in the original image and obtaining a mask image of the target object; The mask image is fused with the original image to obtain the target object image.

Optionally, identifying the target object in the original image and obtaining the dividing line of the target object includes: determining two set key points of the target object in the original image; The line connecting the points is determined as the dividing line of the target object.

Optionally, if the target object is a portrait, determining two set key points of the target object in the original image includes: determining the key point between the eyebrows and the chin key point on the face of the portrait in the original image; Determining the connection line between the two set key points as the dividing line of the target object includes: determining the connection line between the eyebrow key point and the chin key point as the dividing line of the portrait.

Optionally, identifying the target object in the original image and obtaining the dividing line of the target object includes: determining the detection frame of the target object in the original image; determining the target object according to the central axis of the detection frame dividing line.

Optionally, replacing the pixel value of the first side image with the set pixel value includes: traversing the pixel points of the target object image, and inputting the coordinate information of the traversed pixel point into the expression of the dividing line. , obtain the result value; if the result value is greater than the set value, replace the pixel value of the traversed pixel with the set pixel value; or, if the result value is less than the set value, replace the traversed pixel The pixel value of the point is replaced with the set pixel value.

Optionally, replacing the pixel value of the first side image with a set pixel value includes: selecting a pixel value from the background area of the original image as the set pixel value; replacing the first side image with a set pixel value. The pixel value is replaced with the set pixel value.

Optionally, after replacing the pixel values of the first side image with the set pixel values, the method further includes: blurring the first side image after replacing the pixel values.

Optionally, performing mirror processing on the second side image based on the dividing line to obtain the first side mirror image includes: for the pixel points of the second side image, determining the symmetry of the pixel points of the second side image. pixel points of the first side image; determining the pixel value of the pixel point of the second side image as the target pixel value of the pixel point of the first side image; rendering the first side image based on the target pixel value , obtain the first side mirror image.

Optionally, before mirroring the second side image based on the dividing line, the method further includes: obtaining a screen ratio; transforming the dividing line based on the screen ratio; Mirroring the second side image includes mirroring the second side image based on the transformed dividing line.

Although operations are depicted in a specific order, this should not be understood as requiring that the operations be performed in the specific order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although specific implementation details are included in the discussion above, these are not should be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. The specific features and acts described above are merely example forms of implementing the claims.

Claims

An image processing method including:

Identify the target object in the original image to obtain the target object image and the dividing line of the target object; wherein the target object image is divided by the dividing line, and the image on either side of the dividing line is As the first side image, the image on the other side of the dividing line serves as the second side image;

Replace the pixel value of the first side image with the set pixel value;

The second side image is mirrored based on the dividing line to obtain a first side mirror image; wherein the first side mirror image and the second side image are mirror images of each other.
The method according to claim 1, wherein identifying the target object in the original image and obtaining the target object image includes:

Recognize the target object in the original image and obtain the mask image of the target object;

The mask image of the target object and the original image are fused to obtain an image of the target object.
The method according to claim 1, wherein identifying the target object in the original image and obtaining the dividing line of the target object includes:

Determine two set key points of the target object in the original image;

The connecting line between the two set key points is determined as the dividing line of the target object.
The method according to claim 3, wherein when the target object is a portrait, the portrait includes at least one of a face and a human body;

Determining two set key points of the target object in the original image includes: determining the eyebrow key point and the chin key point in the face of the portrait in the original image;

Determining the connection line between the two set key points as the dividing line of the target object includes: determining the connection line between the eyebrow key point and the chin key point as the dividing line of the portrait.
The method according to claim 1, wherein identifying the target object in the original image and obtaining the dividing line of the target object includes:

Determine the detection frame of the target object in the original image;

The dividing line of the target object is determined according to the central axis of the detection frame.
The method according to claim 1, wherein replacing the pixel value of the first side image with a set pixel value includes:

Traverse the pixel points of the target object image, input the coordinate information of each traversed pixel point into the expression of the dividing line, and obtain the result value of the traversed coordinate information of each pixel point;

When the result value of the traversed coordinate information of each pixel is greater than the set value , replace the pixel value of each traversed pixel point with the set pixel value; or, in the case where the result value of the coordinate information of each traversed pixel point is less than the set value, Then replace the pixel value of each traversed pixel point with the set pixel value.
The method according to claim 1, wherein replacing the pixel value of the first side image with a set pixel value includes:

Select a pixel value from the background area of the original image as the set pixel value;

Replace the pixel values of the first side image with the set pixel values.
The method according to claim 1 or 7, after replacing the pixel value of the first side image with the set pixel value, further comprising:

Blur the first side image after replacing the pixel values.
The method according to claim 1, wherein performing mirror processing on the second side image based on the dividing line to obtain the first side mirror image includes:

Determine the pixel points of the first side image in which the pixel points of the second side image are symmetrical with respect to the dividing line;

Determine the pixel value of the pixel point of the second side image as the target pixel value of the pixel point of the first side image;

The first side image is rendered based on the target pixel value to obtain a first side mirror image.
The method according to claim 1, before mirroring the second side image based on the dividing line, further comprising:

Get the screen ratio;

Transform the dividing line based on the screen ratio;

Mirroring the second side image based on the dividing line includes: mirroring the second side image based on the transformed dividing line.
An image processing device, including:

The target object recognition module is configured to identify the target object in the original image and obtain the target object image and the dividing line of the target object; wherein the target object image is divided into a first side image and a third side image by the dividing line. Bilateral image;

A pixel value replacement module configured to replace the pixel value of the first side image with a set pixel value;

The mirror processing module is configured to perform mirror processing on the second side image based on the dividing line to obtain a first side mirror image; wherein the first side mirror image and the second side image are mirror images of each other.
An electronic device including:

at least one processor;

a storage device arranged to store at least one program,

When the at least one program is executed by the at least one processor, the at least one processor implements the image processing method according to any one of claims 1-10.
A storage medium containing computer-executable instructions, which when executed by a computer processor are used to perform the image processing method according to any one of claims 1-10.