WO2019015522A1 - Emoticon image generation method and device, electronic device, and storage medium - Google Patents

Abstract

The application discloses an emoticon image generation method and device, an electronic device, and a storage medium, relating to the technical field of computers. The method comprises: when an image on a page comprises a facial region, displaying an emoticon image generation entry, corresponding to the image, on the page; receiving an emoticon image generation operation triggered by the emoticon image generation entry; and synthesizing the facial regions of the image, according to the emoticon image generation operation, into a background image to be synthesized, and generating an emoticon image associated with the image. The method automatically generates an emoticon image without requiring a user to leave the image display page. The method simply and conveniently completes the emoticon image generation process by effectively reducing the number of user operated steps, thereby improving the effectiveness of emoticon image generation.

Description

Emoticon image generation method, device, electronic device and storage medium

This application claims the priority of the Chinese Patent Application submitted by the State Intellectual Property Office of the People's Republic of China, the application number is 201710586647.0, and the invention name is "Expression Picture Generation Method, Apparatus and Electronic Equipment" on July 18, 2017. The citations are incorporated herein by reference.

Technical field

The present application relates to the field of computer technologies, and in particular, to an expression picture generating method, apparatus, electronic device, and storage medium.

Background technique

With the continuous development of computer technology, users are no longer limited to text in the traditional sense when transmitting information. For example, the expression language is also a kind of information that can be transmitted. The expression language is represented by the expression portrayed in the picture. Corresponding information.

At present, the expression language is usually provided to the user through various expression pictures, and the user can select an expression picture to express the mood at the moment, and then convey some information to the other party through the expression picture. However, the ready-made emoticons are not only limited in number, but also have fixed content, which is difficult to meet the diversified needs of users. Users often need to customize the emoticons.

The existing expression image generation method is that the user actively performs a series of processing such as mapping, editing, and synthesis on the favorite image, and then generates and saves an expression image related to the image for subsequent use.

It can be seen that although the above prior art can generate an emoticon for the user, the operation is too cumbersome, and there is still a problem that the emoticon image generation efficiency is low.

Summary of the invention

The present application provides a method, an apparatus, an electronic device, and a storage medium for generating an emoticon, which can solve the problem that the user is too cumbersome in the process of generating an emoticon.

Among them, the technical solution adopted in this application is:

In one aspect, an emoticon image generating method is provided for use in an electronic device, the method comprising:

When the picture in the page includes a face area, an emoticon image generation entry corresponding to the picture is displayed in the page;

Receiving an generated emoticon picture operation triggered by the emoticon image generation entry;

Generating a face region in the picture to a background image to be synthesized according to the generating an emoticon picture operation, and generating an emoticon picture related to the picture.

In another aspect, an emoticon image generating apparatus is provided, the apparatus comprising:

a display module, configured to: when the picture in the page includes a face area, display an expression picture generation entry corresponding to the picture in the page;

a receiving module, configured to receive an generated emoticon image triggering operation on the emoticon image generation entry;

And a synthesizing module, configured to synthesize a face region in the image to a background image to be synthesized according to the generating an emoticon image operation, and generate an emoticon image related to the image.

In another aspect, an electronic device is provided, comprising: a processor and a memory, the memory having computer readable instructions stored thereon, the computer readable instructions being executed by the processor to implement an emoticon generation as described above method.

In another aspect, a computer readable storage medium is provided having stored thereon a computer program, wherein the computer program is executed by a processor to implement an emoticon generation method as described above.

The beneficial effects brought by the technical solutions provided by the embodiments of the present application include at least:

According to the face area included in the picture in the page, the picture is automatically triggered to form an associated expression picture generation entry, thereby intercepting the generated expression picture operation triggered by the expression picture generation entry, and then performing the operation according to the generated expression picture operation. The face area is synthesized to the background image to be synthesized, and finally an expression picture related to the picture is generated.

Therefore, when browsing the favorite picture, the user does not need to leave the page displaying the picture, and can complete the series of operations of generating the above-mentioned expression picture by automatically generating the generated expression picture in the page, which is simple, fast and effective. Improved the efficiency of emoticon image generation.

The above general description and the following detailed description are intended to be illustrative and not restrictive.

DRAWINGS

The accompanying drawings, which are incorporated in and constitute in the claims

FIG. 1 is a block diagram showing the hardware structure of an electronic device according to an exemplary embodiment.

FIG. 2 is a flowchart of an emoticon image generation method according to an exemplary embodiment.

FIG. 3 is a schematic diagram of a picture and its associated emoticon picture display in a picture message according to an exemplary embodiment.

FIG. 4 is a schematic diagram of an emoticon picture forming a new picture message posted on a message page according to an exemplary embodiment.

Figure 5 is a flow diagram of an embodiment of step 250 in the corresponding embodiment of Figure 2.

FIG. 6 is a flowchart of another method for generating an emoticon according to an exemplary embodiment.

FIG. 7 is a flowchart of another method for generating an emoticon according to an exemplary embodiment.

FIG. 8 is a flowchart of another method for generating an emoticon according to an exemplary embodiment.

FIG. 9 is a schematic diagram of a specific implementation of an expression image generation method in an application scenario.

FIG. 10 is a schematic diagram of a specific implementation of an expression image generating method in another application scenario.

FIG. 11 is a schematic diagram of a specific implementation of an expression image generating method in another application scenario.

FIG. 12 is a schematic diagram of a specific implementation of an expression image generating method in another application scenario.

FIG. 13 is a schematic flowchart of a method for generating an emoticon in the application scenario of FIG. 9 to FIG.

FIG. 14 is a schematic diagram of a specific process of face recognition and expression picture synthesis in an emoticon image generation method in the application scenario of FIG. 9 to FIG.

FIG. 15 is a block diagram of an emoticon image generating apparatus according to an exemplary embodiment.

FIG. 16 is a block diagram of an emoticon image generating apparatus according to another exemplary embodiment.

The embodiments of the present invention have been described in detail with reference to the accompanying drawings. The concepts of the present application are described by those skilled in the art.

Detailed ways

The description will be made in detail herein with respect to exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of devices and methods consistent with aspects of the present application as detailed in the appended claims.

Please refer to FIG. 1. FIG. 1 is a block diagram of an electronic device according to an exemplary embodiment. The electronic device can be a desktop computer, a laptop portable computer, a tablet computer, a smart phone, an e-book reader, a computer device for image processing, or the like.

It should be noted that the electronic device 100 is only an example that is suitable for the present application, and is not considered to provide any limitation on the scope of use of the present application. The electronic device 100 is also not to be construed as having to rely on or must have one or more of the exemplary electronic devices 100 illustrated in FIG.

As shown in FIG. 1, the electronic device 100 includes a memory 101, a memory controller 103, one or more (only one shown in FIG. 1) processor 105, a peripheral interface 107, a radio frequency module 109, a positioning module 111, and a camera module. 113. The audio module 115, the touch screen 117, and the button module 119. These components communicate with one another via one or more communication bus/signal lines 121.

The memory 101 can be used to store software programs and modules, such as the emoticon image generating method and device corresponding to the program instructions and modules in the exemplary embodiment of the present application, and the processor 105 executes by executing the program instructions stored in the memory 101. Various functions and data processing, that is, the method of generating an expression picture.

The memory 101 serves as a carrier for resource storage, and may be a random storage medium such as a high speed random access memory, a nonvolatile memory such as one or more magnetic storage devices, flash memory, or other solid state memory. The storage method can be short-term storage or permanent storage.

The peripheral interface 107 can include at least one wired or wireless network interface, at least one serial-to-parallel conversion interface, at least one input-output interface, and at least one USB interface, etc., for coupling external external input/output devices to the memory 101 and processing The device 105 is configured to communicate with various external input/output devices.

The radio frequency module 109 is configured to transmit and receive electromagnetic waves, and realize mutual conversion between electromagnetic waves and electric signals, thereby communicating with other devices through a communication network. The communication network includes a cellular telephone network, a wireless local area network, or a metropolitan area network, and the above communication networks can use various communication standards, protocols, and technologies.

The positioning module 111 is configured to acquire a geographic location where the electronic device 100 is currently located. Examples of positioning module 111 include, but are not limited to, Global Positioning System (GPS), wireless local area network or mobile communication network based positioning technology.

The camera module 113 is attached to the camera for taking pictures or videos. The captured picture or video can be stored in the memory 101, and can also be sent to the host computer through the radio frequency module 109.

The audio module 115 provides an audio interface to the user, which may include one or more microphone interfaces, one or more speaker interfaces, and one or more earphone interfaces. Audio data interaction with other devices through the audio interface. The audio data can be stored in the memory 101 and can also be transmitted through the radio frequency module 109.

The touch screen 117 provides an input and output interface between the electronic device 100 and the user. Specifically, the user can perform an input operation, such as a click, a touch, a slide, or the like, through the touch screen 117 to cause the electronic device to respond to the input operation. The electronic device 100 displays the output content formed by any one or combination of text, picture or video to the user through the touch screen 117.

The button module 119 includes at least one button for providing an interface for the user to input to the electronic device 100, and the user can cause the electronic device 100 to perform different functions by pressing different buttons. For example, the sound adjustment button can be used by the user to adjust the volume of the sound played by the electronic device 100.

It will be understood that the structure shown in FIG. 1 is merely illustrative, and the electronic device 100 may further include more or less components than those shown in FIG. 1, or have components different from those shown in FIG. The components shown in Figure 1 can be implemented in hardware, software, or a combination thereof.

Referring to FIG. 2, in an exemplary embodiment, the method for generating an emoticon is applied to the electronic device 100 shown in FIG. 1 as an example. The method includes the following steps:

Step 210: When a picture in the page includes a face area, an emoticon image generation entry corresponding to the picture is displayed in the page.

The above page, relative to the touch screen configured by the electronic device, refers to displaying the content to the user by using the touch screen as a carrier. For example, the content displayed by the touch screen to the user includes a picture, and at this time, the page is displayed.

The page for displaying the image includes, but is not limited to, any one of a picture browser page, a message page, and a picture selection page. Accordingly, the picture displayed in the page may be a single picture (such as a picture browser page) or multiple pictures (such as a message page).

The message page is used for continuously publishing messages, and corresponds to an application that can continuously publish messages, such as a social application and an instant messaging application. The message includes a text message, a picture message, a graphic message, and the like. It should be noted that the text message only contains text, the picture message only contains the picture, and the picture message refers to the message formed by the picture and the text mixed.

Optionally, the emoticon image generation entry is used to generate an emoticon image corresponding to the image, where the emoticon image is related to the image displayed in the webpage, and is a photo with the entire content in the image as the background, or only the image A picture of the expression contained in the face area. The face area in the picture may be a face area of a person, a face area of an animal, or a face area of a character such as a cartoon or anime, which is not limited herein.

The facial region can be acquired by detecting by biometric technology, including but not limited to face recognition, animal facial recognition, and the like.

Thus, when a picture is displayed in the page and the picture is detected in the face area, the electronic device can perform a process of generating a related expression picture for the picture.

Optionally, the emoticon generation portal is an entry provided by the electronic device to the user for performing the emoticon generation process, that is, the user may cause the electronic device to generate a correlation for the image by performing related operations triggered by the emoticon generation portal. Emoticon picture.

Optionally, the emoticon image generation portal is an entry provided by an application corresponding to the page for generating an emoticon image corresponding to the image.

Specifically, the emoticon image generation portal is automatically triggered to be formed in the page according to the facial region included in the image, that is, when the image of the page includes the facial region, the emoticon image generation portal is automatically triggered to be formed in the webpage.

For example, when a message message is included in a message page, face recognition is performed on the image in the image message, thereby detecting a face region in the image, thereby automatically displaying an associated expression image generation portal for the image, and the text message is generated. And the text message does not automatically display the emoticon image generation entry.

Therefore, the user only needs to generate an entry trigger related operation on the displayed emoticon image, and the electronic device can complete a series of operations of the subsequent emoticon image generation, which greatly simplifies the excessively cumbersome operation of the user in the prior art.

It should be noted that the emoticon image generation entry is associated with the image displayed in the page, which means that each image displayed in the page can form an emoticon image generation portal, such as the virtual icons 1 and 4 shown in FIG. Correspondingly, in the emoticon image generation process performed by the emoticon image generation portal, the emoticon image is related to the image associated with the emoticon image generation portal.

Step 230: Receive an generated emoticon picture operation triggered by an emoticon image generation entry.

Optionally, the generating an emoticon picture operation is used to generate an emoticon picture according to the picture. After the emoticon image generation entry is displayed, the user generates an emoticon image triggered by the emoticon image generation portal to enable the electronic device to know that the user wants to generate a related emoticon image for the image displayed in the page, thereby performing the image displayed on the page. The process of generating an emoticon.

For example, in the message page for displaying the picture, as shown in FIG. 3, the expression picture generation entry may be a virtual icon 1 in the message page, and the virtual icon 1 is associated with the picture message in the message page. The user generates a related emoticon picture for the picture in the picture message by clicking the virtual icon 1 , and the click operation is an generated emoticon picture operation triggered by the emoticon image generation entry.

After the emoticon image generation entry is triggered, the electronic device can listen to the generated emoticon image operation and perform subsequent image synthesizing processes.

Step 250: Synthesize a face region in the image to a background image to be synthesized according to the generated emoticon image operation, and generate an emoticon image related to the image.

The background image to be synthesized may be randomly generated by the background image material in the preset background image material library, or may be randomly generated by the image in the local storage specified by the user, or may be a default fixed image, that is, each expression The fixed picture is set to the background image to be synthesized during the image generation process. Correspondingly, the acquisition of the background image to be synthesized may be completed before the execution of step 250, or may be completed during the execution of step 250, which is not limited herein.

After obtaining the face area in the picture and the background picture to be synthesized, the picture synthesis process can be performed.

Specifically, a blank picture is created, and the background image to be synthesized and the face area in the picture are sequentially placed in the picture size matching process, and in order to further ensure the combined effect of the two, the face area in the picture is corresponding to Gaussian Blur is applied to the area on the background image to be synthesized (English: Gaussian Blur). Gaussian Blur processing, also known as Gaussian Blur, is an image processing technique used to reduce image noise and reduce image detail levels. Emoticon image.

It can be understood that if the area on the background image to be synthesized also includes a face area, the face area in the background image to be synthesized may affect the face area in the picture, thereby affecting the face area in the picture and The composite effect of the background image to be synthesized.

Therefore, in order to make the face region in the picture merge with the background image to be synthesized more naturally, before performing Gaussian blurring on the region on the composite background image, the face region in the background image to be synthesized is also mastered. Tonal fill.

The main color used for the filling refers to the main color of the remaining facial area except the facial features in the facial region to be synthesized in the background image. The primary color tone is related to the saturation of the remaining face regions, the average color of the remaining face regions, and the grayscale distribution of the remaining face regions.

Further, after the emoticon image is generated, the emoticon image can be stored locally for use by subsequent users, and can also be displayed for preview by the user, or a new photo message formed by the emoticon image is posted in the message page.

In the emoticon image preview for the user, the generated emoticon image can be displayed on the page simultaneously with the image displayed on the page, and can also be displayed in another new page.

For example, the message page is used as the page for displaying the picture. As shown in FIG. 3, the picture in the expression picture and the picture message are displayed side by side in the message page, and the user can confirm whether the expression picture meets the requirement by previewing the displayed picture.

If the emoticon image meets the requirement, that is, the user is satisfied with the emoticon image, the user can click the emoticon image to cause the emoticon image to form a new photo message to be posted in the message page, as shown in FIG. At this time, the electronic device also cancels the display of the emoticon image associated with the picture in the old picture message in the message page.

If the emoticon image does not meet the requirement, that is, the user is dissatisfied with the emoticon image, further, the emoticon image previewing process further provides the user with a photo editing open entry and a background image replacement entry to be triggered by the user opening the portal at the photo editing. The related operation starts a picture editing process on the emoticon image, or replaces the background of the emoticon image by the related operation triggered by the user at the background image replacement entry until the user is satisfied.

As shown in FIG. 3, in the message page, the picture editing open entry 2 and the background picture replacement entry 3 are displayed on the side of the expression picture in the form of a virtual icon.

Of course, in other embodiments, the emoticon image can also be displayed in another new page. For example, the new page is a photo editing page. In this case, in addition to previewing the emoticon image in the photo editing page, the user can directly view the image. The image editing process is performed on the edit page.

Through the process as described above, in the scene displayed by the image, the automatic triggering of the expression image generation portal forms a guide image for the user to generate a related image for the image displayed in the page, and is not limited to relying on the user to actively generate the expression image. In this way, automatic generation of emoticons is achieved.

In addition, during the automatic generation process of the expression image, the user can complete the process of generating the expression image simply and conveniently without leaving the page displaying the image, thereby effectively reducing the operation steps of the user, thereby effectively improving the efficiency of generating the expression image.

In an exemplary embodiment, the page includes a message page that can continuously publish a message, and correspondingly, before step 210, the method as described above may further include the following steps:

Perform picture message detection in the message page.

Picture message detection refers to detecting whether a picture message is included in a message page according to a preset rule. The preset rule can be flexibly adjusted according to a specific application scenario.

Optionally, in an application scenario where the real-time requirement is high, the preset rule includes a preset time period, that is, the image message is detected in the message page according to the preset time period, and the image page is included in the message page in the preset time period. The message is used to perform face recognition on the picture in the picture message included in the message page to obtain a face area. Once the picture message exceeds the range of the preset time period, the real-time performance of the picture message is considered to be too low, and thus is not executed. Follow-up related emoticon generation process. Or, in the scenario application scenario, the preset time includes the number of picture messages, that is, whether the detection message page includes at least two picture messages, that is, only when detecting that the message page includes at least two picture messages, The user has the desire to perform a fight with the other party, and then performs subsequent related emoticon generation processes for all the picture messages included in the message page.

Optionally, the preset rule may further include a preset message publishing quantity, that is, performing a picture message detection on the continuously published message according to the preset message publishing quantity. Optionally, when the continuously published message in the preset message release quantity includes a picture message, performing face recognition on the picture in the picture message included in the continuous release message to detect a face area in the picture; or When at least two picture messages are included in the continuously published message in the preset number of published messages, face recognition is performed on the pictures in the picture message included in the continuous release message to detect the face area in the picture.

It should be noted that the detection of the face area in the picture may be to detect whether the face area is included in the picture, or directly obtain the face area in the picture.

In addition, the preset rule may be combined according to a specific application scenario. For example, the preset rule includes a preset time period and a number of pictures, that is, the picture message is detected according to the number of picture messages included in the message page in the preset time period.

For example, it is detected whether a picture message is included in a message page within a preset time period. The preset time period can be flexibly adjusted according to a specific application scenario. For example, the preset time period is 2 minutes.

If a picture message is included in the message page within the preset time period, the picture in the picture message is automatically triggered to form an associated expression picture generation entry. Specifically, the emoticon image generation portal is displayed in the form of the virtual icon 1 on one side of the picture in the picture message, as shown in FIG.

On the other hand, if it is detected that the message page does not include the picture message in the preset time period, the picture message may be continuously detected in the message page according to the preset time period, and the picture may be further performed in the message page according to other preset rules. Message detection.

Further, in an exemplary embodiment, after step 210, the method as described above may further include the following steps:

When it is detected that the message page does not include the picture message in the preset time period, or when the message page does not include at least two picture messages, the picture message detection is performed on the continuously published message according to the preset message release quantity.

Here, the preset number of message issuance is not for the message page, but for the continuously published message, that is, the picture message detection is performed for the message of the number of consecutively issued preset messages. The number of preset message advertisements can be flexibly adjusted according to specific application scenarios. For example, the number of preset message advertisements is 5. Accordingly, the picture message detection is performed for five consecutively published messages.

If it is detected that the message is continuously published in the preset number of publications, the picture in the picture message is automatically triggered to form an associated expression picture generation entry.

On the other hand, if it is detected that the message continuously published in the preset number of publications does not include the picture message, the step of performing picture message detection in the message page according to the preset time period is returned.

Preferably, in a specific embodiment, the automatic trigger formation of the emoticon generation portal depends on detecting that at least two picture messages are included in the message page within a preset time period, and further relies on if the preset rule is not satisfied And detecting, according to the preset message publishing quantity, whether at least two picture messages are included in the continuously published message, thereby the electronic device will consider that the user has a desire to transmit a message through the expression picture, thereby fully ensuring the expression picture. The probability that the entry is triggered is generated, for example, in the scenario application scenario.

With the cooperation of the foregoing embodiment, the setting of the preset rule, such as the preset time period, the number of picture messages, and the number of preset message releases, provides a sufficient basis for automatic triggering of the expression image generation entry, thereby avoiding the execution of the electronic device. The necessary processing tasks are conducive to improving the processing efficiency of electronic devices.

Further, in order to improve the probability that the emoticon image generation entry is triggered, the face image displayed in the page is also subjected to face recognition to detect the face region in the image, and then automatically triggered by the detected face region in the image. An emoticon image generation portal is formed to ensure that the emoticon image is related to the facial region in the image. Here, the page includes a message page, a picture browser page, a picture selection page, or other page that can display the picture.

On the one hand, if a face area is detected in the picture, the face area in the picture is used as an expression of the expression picture, that is, the face area is extracted from the picture and synthesized into a background picture to be synthesized. The background image to be synthesized may be randomly generated by the background image material to be synthesized in the background image material library to be synthesized, and may be generated by the user to specify the background image material to be synthesized in the background image material library, or may be locally stored by the user. The image is generated, or, set with a default fixed image.

Further, in order to ensure the composite effect of the face region in the picture and the background image to be combined, the image enhancement processing is performed on the face region in the image, and the image enhancement processing includes, but is not limited to, black and white processing, color gradation adjustment processing, Edge feathering and the like, thereby improving the composite effect of the face region and the background image to be synthesized in the picture, thereby improving the user's expression image generation experience.

Further, the face recognition and image enhancement processing is implemented by an image processing plug-in embedded in the application, so that the user can generate relevant expression images for the pictures displayed on the page, thereby facilitating the improvement of the generation efficiency of the expression images.

On the other hand, if the face area is not detected in the picture, the formation of the expression picture generation entry cannot be automatically triggered. At this time, the user can also perform the expression picture generation process for the picture through the preset expression picture generation entry.

For example, the page for displaying the image is a picture browser page, and the image browser page is preset with an expression image generation entry, and it is assumed that the picture displayed in the picture browser page does not detect the face area, and when the user is in the expression picture When the portal trigger related operation is generated, the displayed image is used as the background of the emoticon image, that is, the entire content in the image is used as the background image to be synthesized, and accordingly, a blank image is synthesized as the facial region to the background image to be synthesized. In order to automatically generate an emoticon image for the user.

Further, the generated emoticon image will be displayed in another new page, for example, the new page is a photo editing page, thereby enabling the user to preview the emoticon image and perform image editing processing in the photo editing page.

By setting in this way, regardless of whether the picture displayed on the page can detect the face area, the electronic device can automatically generate an expression picture for the user according to the expression picture generation entry, which greatly improves the applicability and compatibility of the expression picture generation process. .

It should be noted that, if the emoticon image generation entry is preset in the page for displaying the image, the other emoticon image generation entry may not be displayed. Therefore, the manner of forming the emoticon image generation portal may be flexibly adjusted according to the application scenario. For example, the message page may be automatically triggered to form an expression image generation entry, and an expression picture generation entry may be further set in the pull-up session box popped up in the message page, and only one expression picture generation entry is preset in the picture browser page. In order to meet the different needs of different users, it is beneficial to enhance the user's expression picture generation experience.

Referring to FIG. 5, in an exemplary embodiment, a face region in a picture is detected by face recognition, and when a face region is synthesized to a background image to be synthesized and an expression image is generated, the generated expression is first generated according to The picture operation determines the face area in the picture by facial feature extraction, crops the picture according to the face area, obtains a face area picture, and performs image enhancement processing on the face area picture to obtain a face picture, and finally The face image is synthesized to the background image to be synthesized, and an image corresponding to the image is generated. Correspondingly, the step 250 synthesizing the face region in the picture to the background image to be synthesized according to the generating the emoticon picture operation may include the following steps:

Step 251, determining a face region in the picture by facial feature extraction.

Optionally, the facial region is determined in the picture by facial feature extraction according to the generated emoticon image operation. The facial features include a facial contour, a left eye, a right eye, a left eyebrow, a right eyebrow, a nose, a mouth, and the like. Accordingly, the face region determined by the facial feature extraction includes a facial contour region and a left eye. Area, right eye area, left eye area, right eye area, nose area, mouth area, etc.

Optionally, each area in the picture is identified by a coordinate value, that is, the determined face area in the picture is uniquely represented in the form of coordinate values, so that the face is subsequently cropped according to the coordinate value corresponding to the face area. Part area picture.

In step 253, the picture is cropped according to the face area to obtain a picture of the face area.

Optionally, when the picture is cropped according to the face area, the picture may be cropped by the coordinate value in step 251 to obtain a face area.

In step 255, the facial region image is synthesized to the background image to be synthesized, and an emoticon image related to the image is generated.

Optionally, in the process of synthesizing the face region image into the image to be combined, first, the image of the face region may be subjected to image enhancement processing to obtain a face image, and then the face image is synthesized to the background image to be synthesized. Generate an emoticon image.

Wherein, the image enhancement processing process may include at least one of the following steps:

In the first step, the face region picture is black-whitened by calculating the gray value of the face region picture.

The gray value of the face area picture is related to the gray value of each pixel point in the face area picture and the number of non-transparent pixel points. Therefore, before calculating the gradation value of the face region picture, it is first necessary to obtain the gradation value of each pixel in the face region picture.

Specifically, traversing each pixel in the face region picture, and calculating a corresponding gray value, the calculation formula is as follows:

m = R x 0.3 + G x 0.59 + B x 0.11.

Where m represents the gray value of the pixel, R represents the red value corresponding to the pixel, G represents the green value corresponding to the pixel, and B represents the blue value corresponding to the pixel.

After obtaining the gray value of each pixel in the image of the face region, the gray value of the image of the face region can be calculated, and the calculation formula is as follows:

Where x represents the gray value of the face region picture, m _i represents the gray value of the i-th pixel point in the face region picture, N represents the total number of pixel points in the face region picture, and N′ represents the face region picture The number of transparent pixels in Central Africa.

Since the RGB color value ranges from 0 to 255, correspondingly, the gray value of the pixel and the gray value range of the face region picture are still 0 to 255, wherein 0 represents black, 255 represents white, and between 0 and 255. Indicates the corresponding gray.

Further, the black and white processing may be implemented by calling a grayscale processing plug-in preset by the system, or may be implemented by an image processing plug-in embedded in the application.

In the second step, the gradation adjustment parameter corresponding to the gradation value of the face region picture is obtained according to the correspondence between the gradation value and the gradation adjustment parameter, and the gradation adjustment is performed on the face region picture according to the gradation adjustment parameter. Get an intermediate result picture.

After the black-and-white processing of the face region picture is completed, in order to ensure that the black-and-white-processed face region picture meets the visual requirements, it is necessary to adjust the tone scale.

Specifically, according to the gray value of the face region picture, the corresponding color gradation adjustment parameter is obtained from the correspondence between the gray value and the gradation adjustment parameter, and the gradation of the face region image is performed according to the corresponding gradation adjustment parameter. Adjustment.

The correspondence between the gray value and the color tone adjustment parameter is formed according to the visual requirement, and the relationship between the gray value of the image of the massive face region and the different color tone adjustment parameters is statistically formed, and can be used in practical applications. Flexible adjustment, so that the image effects of subsequent generated emoticons can be dynamically changed, thereby enhancing the user's custom experience.

It should be noted that the visual requirement refers to an emoticon style designed according to the user's aesthetic standard for the emoticon image.

For example, the tone scale adjustment parameters include a black value, a white value, and a gamma value.

The correspondence between the gray value and the level adjustment parameter is shown in Table 1.

Table 1 Correspondence between gray value and color scale adjustment parameters

Therefore, after obtaining the gradation value of the face region picture, the corresponding gradation adjustment parameter can be confirmed by Table 1, and the corresponding gradation adjustment parameter is input to the image processing plug-in embedded in the application, thereby realizing Level adjustment of the face area picture.

In the third step, the intermediate result picture is subjected to edge feathering to obtain a face picture.

After the image of the face region is adjusted to obtain the intermediate result picture, the intermediate result picture is further subjected to edge feathering processing, thereby further ensuring the synthesis effect of the subsequent face picture and the background picture to be synthesized.

Specifically, first, each pixel point in the intermediate result picture is traversed, and the transparency of each pixel point is adjusted. The transparency adjustment process includes: maintaining the transparency of the pixel having zero transparency, and adjusting the transparency of the pixel whose transparency is not zero according to the following calculation formula.

n = R × 0.3 + G × 0.59 + B × 0.11.

Where n is the transparency of the pixel, R is the red value corresponding to the pixel, G is the green value corresponding to the pixel, and B is the blue value corresponding to the pixel.

Then, according to the face area in the face area picture, a corresponding mask pattern is created, and at the same time, Gaussian blur processing is performed on the mask pattern, and the gray value of each pixel in the mask pattern of the Gaussian blur processing is calculated. The calculation formula of the gray value of each pixel in the mask is consistent with the calculation formula of the gray value of each pixel in the image of the face region, and will not be described in detail herein.

Finally, at the same time, traversing the intermediate result image and each pixel in the mask image to perform pixel point merging, the calculation formula of the pixel point combination is as follows:

s _i =n _i ×t _i ³ , 0<i<=N.

Where s _i represents the transparency of the i-th pixel in the face image, n _i represents the transparency of the i-th pixel in the intermediate result picture, t _i represents the gray value of the i-th pixel in the mask, and N represents The total number of pixels in the face image.

Through the process as described above, the acquisition of the face image is realized, and the image enhancement processing provides a sufficient guarantee for the perfect fusion of the face image and the background image to be synthesized.

Referring to FIG. 6, in an exemplary embodiment, the method as described above may further include the following steps:

Step 310: Receive a picture editing open operation triggered for an emoticon picture.

Optionally, the image editing open operation is used to jump to the image editing page to edit the expression image.

As described above, when performing an emoticon preview for a user, if the user is dissatisfied with the generated emoticon image, the user is provided with a photo editing open entry to initiate execution of the emoticon image by the related operation triggered by the user in the photo editing open portal. Picture editing process.

For example, as shown in FIG. 3, in the message page for displaying a picture, a virtual icon 2 is set as a picture editing opening entrance on the side of the generated expression picture, and the user can pass the electronic when the user needs to perform image editing processing on the expression picture. The input module of the device configuration or the touch screen clicks the virtual icon 2, and the click operation is regarded as a picture editing open operation triggered by the user for the expression picture at the picture editing opening.

Step 330: Jump to the picture editing page according to the picture editing open operation.

Optionally, the electronic device jumps to the image editing page by the message page in response to the user-triggered picture editing opening operation, so that the subsequent user performs image editing processing on the expression image in the image editing page.

Step 350: Receive a picture editing operation triggered in the picture editing page.

Step 370: Perform image editing processing on the emoticon image according to the picture editing operation.

In the photo editing page, the user can perform image editing processing on the emoticon image. Since the emoticon image includes an emoticon and a background, the photo editing process includes, but is not limited to, changing the emoticon, changing the background, adding text, and the like.

When the user performs the expression replacement, the user first selects a picture in the local storage or uses the camera module configured by the electronic device to take a picture to obtain a corresponding picture, and then obtains a face included in the picture through face recognition, and then performs the face image in the face with the face. Expression replacement.

During the background replacement process, the background image material in the preset background image material library may be displayed for the user, and the background image in the emoticon image may be replaced according to the background image material selected by the user, or the user may directly select the image or use the electronic in the local storage. The camera module configured by the device performs a photo to obtain a corresponding background image to be synthesized, thereby replacing the background in the emoticon image.

If the emoticon image after the image editing process still does not meet the requirements, the user will continue to perform steps 350 and 370, receive a photo editing operation triggered by the emoticon image, and perform a photo editing process on the emoticon image.

On the other hand, if the emoticon image after the image editing process meets the requirements, the process proceeds to step 390, where the emoticon image is formed into a new photo message and posted in the message page.

Step 390: Forming a new picture message by using the picture edited image to be published in a message page of the continuously publishable message.

Under the action of the above embodiment, in the process of generating an emoticon image, the function of changing the expression, changing the background, and adding text is also provided for the user, which not only satisfies the custom requirement of the original user, but also helps to improve the emoticon image of the user. Generate experience.

Referring to FIG. 7, in an exemplary embodiment, the following steps may be further included before step 330 as described above:

Step 410: Generate a face selection message when at least two face regions are synthesized into a background image to generate an emoticon image.

Optionally, each face region picture corresponds to at least one face region in the emoticon picture.

Optionally, the face selection message is used to prompt selection in at least two face regions in the emoticon picture. Optionally, the face selection message includes related information of at least two face regions. For example, the related information may be a location of a face region in an emoticon picture, a feature of a face region, or a face region identification identifier.

Taking the face area identification mark as an example for description, when face recognition is performed in the picture to obtain a plurality of face areas, the face area identification mark is used to uniquely identify the face area, for example, the face area is digitally performed. Identifying and packaging the facial area identification identifier and the corresponding facial area to obtain a face selection message, and displaying the face selection message in a pop-up dialog box, thereby prompting the user to perform face selection.

In the pop-up dialog box, not only a plurality of face regions are displayed, but also a face region identification identifier corresponding to the plurality of face regions is displayed, for example, the face region identification identifier is displayed on the corresponding face in a highlighted form. In the area, correspondingly, the user can select the corresponding face area by selecting the face area identification mark.

Step 430: Generate a face selection instruction according to the face selection operation triggered in the face selection message, and display the face area indicated by the face selection instruction on the picture editing page.

The picture editing page is used to perform image editing processing on the face area.

After the user completes the selection according to the face selection message, the face selection instruction can be generated according to the selection operation (ie, the face selection operation) made by the user, that is, the face selection instruction includes the face area corresponding to the face area. Identify the logo.

Correspondingly, in the picture editing page, the corresponding face area can be displayed according to the face area identification mark included in the face selection instruction, so as to perform subsequent image editing processing on the face area.

With the cooperation of the foregoing embodiment, the generated face selection instruction reflects the user's requirement, and is favorable for subsequently generating an expression picture that meets the user's needs.

Referring to FIG. 8, in an exemplary embodiment, after step 255 as described above, the following steps may also be included:

Step 510: Acquire a replacement background picture operation triggered by the emoticon picture;

Step 530: Acquire a replacement background image to be synthesized according to the replacement background image operation.

As described above, when performing an emoticon preview for a user, if the user is dissatisfied with the generated emoticon image, the user will be provided with a background image replacement entry to background the emoticon image by the user's related operation triggered by the background image replacement entry. Picture replacement.

As shown in FIG. 3, a virtual icon 3 is set as a background image replacement entry on the side of the generated emoticon. When the user needs to replace the background in the emoticon, the user can click the virtual icon through an input device or a touch screen configured by the electronic device. 3. The click operation is regarded as a replacement background image operation triggered by the user for the expression picture in the background image replacement entry.

Correspondingly, the electronic device obtains the replaced background image to be synthesized by responding to the user-replaced background image replacement operation, so that the subsequent user can perform background replacement in the expression image.

Optionally, the replaced background image to be synthesized may be randomly generated by the background image material in the preset background image material library, may be specified by the user in the preset background image material library, or may be specified by the user. The picture in the specified local storage may also be randomly obtained in the locally stored picture, which is not limited in this embodiment.

Step 550: Perform re-synthesis of the expression image according to the replaced background image to be synthesized and the face region in the picture to obtain the re-synthesized expression picture.

Step 570, displaying the re-formed emoticon image as an emoticon image preview.

After re-synthesizing the emoticon image, the re-composed emoticon image can be displayed on the page where the image is displayed, or can be displayed on the new page.

For example, in the picture browser page, the re-synthesized expression picture is displayed in a picture editing page, which is different from the picture browser page.

Or, in the message page, the re-formed emoticon image is still displayed side by side in the message page with the picture in the picture message, so that the user can preview again and determine whether the re-formed emoticon image meets the requirement.

If the re-synthesized emoticon image meets the requirement, the user can post the re-formed emoticon image into a new photo message by clicking the re-formed emoticon image.

On the other hand, if the re-synthesized emoticon does not meet the requirements, the user can continue to change the entrance and/or the photo editing page through the photo editing to open the entrance and/or the photo editing page to continue to change the expression, change the background, Add text and other processing.

Under the action of the above embodiment, in the process of generating the expression image, the user is also provided with the function of changing the background, which not only satisfies the customization requirement of the original user, but also improves the user's expression picture generation experience.

9 to FIG. 14 are related diagrams of a method for generating an emoticon in a specific application scenario.

In the specific application scenario shown in FIG. 9 to FIG. 10, an application that can continuously publish a message, such as a social application, an instant messaging application, or the like, is run in the electronic device, and the currently displayed page in the touch screen is a message that can continuously publish a message. page.

As shown in FIG. 9 , when the message page 601 is included in the message page 600, the emoticon generation portal 602 associated with the photo message 601 is automatically triggered to be generated, and the image in the photo message 601 is triggered and executed according to the emoticon generation portal 602. The related emoticon generation process, and the pictures in the picture message 601 and the related emoticons 603 are displayed side by side in the message page 600 for the user to preview.

By previewing, if the user is satisfied with the emoticon 603, the emoticon 603 is clicked to cause the emoticon 603 to form a new photo message 604 to be posted in the message page 600. At this time, the emoticon image generation entry 602 disappears in the message page 600.

If the user is dissatisfied with the emoticon 603, the photo editing open entry 605 can be triggered, and the jump enters the photo editing page 606 to change the emoticon 603, change the background 608, and the like, and edit the emoticon 609. The image editing page 606 is displayed for the user to preview, or the user can trigger the background image replacement entry 607 to re-synthesize the emoticon image for previewing in the message page 600 until the generated emoticon image meets the user's needs.

In addition, if the emoticon picture is not formed in the message page 600, the emoticon image creation portal, the photo editing open portal, and the background image replacement portal associated with the emoticon will always exist in the message page 600.

As shown in FIG. 10, when the message page 700 does not include a picture message, the user may also initiate an expression picture generation process by using an preset expression picture generation entry 701. Here, the expression picture generation entry is preset to be popped up in the message page. Pull up in the dialog box.

At this time, the image editing page 706 will be jumped accordingly, so as to generate an emoticon image that meets the user's needs through the image editing process such as changing the expression and changing the background 708 in the photo editing page 706, thereby forming a new photo message 704. In the message page 700.

It should be noted that, in the emoticon image displayed on the photo editing page 706 shown in FIG. 10, the emoticon and background of the emoticon image may be displayed according to the specified default photo, or may be performed according to the user's previous image editing process. The expression image used is displayed and is not limited herein.

In the specific application scenario shown in FIG. 11 , an application capable of displaying a picture is run in an electronic device, for example, a picture browser application, and the currently displayed page in the touch screen is a picture browser page that can display a picture.

As shown in FIG. 11, the pictures 813 and 815 displayed in the picture browser page 811 can initiate the expression picture generation process through the preset expression picture generation entry 817 regardless of whether the face is included or not. The image editing page 812 is displayed, and the pictures 813 and 815 in the picture browser page are displayed in the picture editing page 812, and the picture 813, 815 is replaced with the image 813, and the background 814 is edited by the picture editing page 812. Processing, generating an emoticon image that meets the user's needs.

In the specific application scenario shown in FIG. 12, the related application is not run in the electronic device, and the currently displayed page in the touch screen is a picture selection page. For example, the picture selection page is a page where the user views the photo.

As shown in FIG. 12, in the picture selection page 918, after the user selects a certain picture 919, the expression picture generation process can be started through the preset expression picture generation entry 920. At this time, the corresponding jump will be entered. The image editing page 912 displays the user-selected picture 919 in the picture editing page 912, and then performs image editing processing on the picture 919 by changing the expression, changing the background 914, etc., to generate an expression that meets the user's needs. image.

Further, in the specific application scenario shown in FIG. 11 to FIG. 12, the generated emoticon image may be stored locally for use by subsequent users, and may also trigger an application running to continuously post a message to form a new image of the emoticon. The image message is posted on the app's message page.

For the specific process of the steps in the above-mentioned expression picture generation process, reference may be made to FIG. 13 and FIG. FIG. 13 is a schematic flowchart of a method for generating an emoticon in the specific application scenario. FIG. 14 is a schematic diagram of a specific process of face recognition and expression image synthesis in an expression image generation method in the above specific application scenario.

As shown in FIG. 13, the emoticon generating method includes:

In step 1301, the process begins.

In step 1302, the chat window is opened.

Optionally, after the user opens the chat window, the electronic device performs image message detection for the current chat window.

Step 1303, according to the rule, determine whether the current chat information needs to quickly generate a bucket map.

Optionally, the rule is the foregoing rule for performing image message detection in a message page, and details are not described herein again.

Step 1304: Perform face recognition on the image when it is required to quickly generate the bucket map.

In step 1305, it is determined whether there are multiple face images in the image.

Step 1306, when a plurality of face images are included in the image, the selection is made in the plurality of face images.

Step 1307: When a plurality of face images are not included in the image, the face region is extracted.

In step 1308, the face area and the background picture are edited.

Step 1309, synthesizing the face area and the background picture to obtain an expression image.

Optionally, after the expression image is obtained, the user may further re-edit the expression image, such as: adjusting the face image area in the expression image, modifying the background image, and the like.

At step 1310, the process ends.

As shown in FIG. 14, the method for generating face recognition and emoticon image in the emoticon generating method includes:

In step 1401, the face task starts.

In step 1402, the user selects a face.

Optionally, when the plurality of face regions are included in the picture, the user selects the target face region.

In step 1403, a range of facial maps is determined.

Optionally, before the electronic device performs the face operation, the result of identifying the range of the face region in the image may be displayed in the user interface, and the user may determine the accuracy of the recognition result, and when the recognition result is inaccurate , the recognition result is adjusted. Illustratively, the range of the face area is displayed in the user interface in the form of point coordinates, such as: using point coordinates to surround the face area.

Step 1404, licking the face and cropping.

The face area is cropped according to the point coordinates of the face area to obtain a face area image.

In step 1405, the face area image is black and white.

At step 1406, gray values and contrast are calculated.

In step 1407, the face region image is enhanced.

In step 1408, the background image is transparently processed.

Step 1409, performing edge feathering on the background image.

Optionally, the process of step 1405 to step 1409 has been described in detail in step 255 above, and details are not described herein again.

In step 1410, a result picture is determined.

Optionally, the result picture is a background picture for performing transparent processing and edge feathering effect processing.

In step 1411, a synthesis logic of the face region image and the resulting image is determined.

Step 1412: Perform image size matching on the face area image and the result picture.

In step 1413, the face area image and the result picture are combined.

Step 1414, completed.

In the embodiments of the present application, the automatic trigger formation by the expression picture generation entry not only simplifies the user's cumbersome operation, but also makes the expression picture generate more quickly, and also subtly combines face recognition, picture synthesis, and picture editing. Through the interesting connection of technology, users can experience a more active and enjoyable way of communication.

In addition, by generating an entry in the existing image display page in the image display, the program in the embodiments of the present application can be used to be compatible with various existing image display pages, so that the current Some display image pages can also guide users to quickly generate emoticons, and realize the rapid release of emoticons. They have very high versatility, which not only realizes the ingenious integration with the prior art, but also facilitates the implementation of emoticons in different applications. The rapid interaction between them further enhances the user's expression picture generation experience.

The following is an embodiment of the device of the present application, which can be used to execute the method for generating an emoticon image according to the present application. For details not disclosed in the embodiment of the present application, please refer to the embodiment of the emoticon generating method according to the present application.

Referring to FIG. 15 , in an exemplary embodiment, an emoticon generating device includes, but is not limited to, a display module 1510 , a receiving module 1520 , and a synthesizing module 1530 .

The display module 1510 is configured to: when the picture in the page includes a face area, display an expression picture generation entry corresponding to the picture in the page;

The receiving module 1520 is configured to receive an generated emoticon picture triggered by the emoticon image generation entry triggering;

The synthesizing module 1530 is configured to synthesize a face region in the image to a background image to be synthesized according to the generating an emoticon image operation, and generate an emoticon image related to the image.

In an optional embodiment, as shown in FIG. 16, the page includes a message page that can continuously publish a message, and the device further includes:

The detecting module 1540 is configured to perform image message detection in the message page according to a preset time period;

The face recognition module 1550 is configured to perform a face recognition on a picture in the picture message included in the message page to detect the picture in the picture page. Or the face page of the picture message included in the message page is subjected to face recognition to detect the The face area in the picture.

In an optional embodiment, the detecting module 1540 is configured to perform a picture message detection on the continuously published message according to the preset number of message releases;

The face recognition module 1550 is configured to perform face recognition on the picture in the picture message included in the continuous release message when the continuously published message includes the picture message in the preset number of published messages, And detecting a face region in the picture; or, when the continuously published message includes at least two picture messages in the preset message publishing quantity, the picture in the picture message included in the continuous release message Face recognition is performed to detect a face area in the picture.

In an optional embodiment, the synthesizing module 1530 includes:

a face region determining unit 1531, configured to determine a face region in the picture by facial feature extraction according to the generating an emoticon image operation;

a picture cropping unit 1532, configured to crop the picture according to the face area to obtain a picture of a face area;

The synthesizing module 1530 is further configured to synthesize the facial region picture to the background image to be synthesized, and generate the emoticon image related to the picture.

In an optional embodiment, the receiving module 1520 is further configured to receive a picture editing open operation triggered by the emoticon picture;

The device further includes:

The jump module 1560 is configured to jump to a picture editing page according to the picture editing open operation, where the picture editing page is used to perform editing processing on the expression picture;

The receiving module 1520 is further configured to receive a picture editing operation triggered in the picture editing page;

The editing module 1570 is configured to perform image editing processing on the emoticon image according to the photo editing operation;

The publishing module 1580 is configured to form a new picture message by using the image editing processed image to be published in the message page of the continuously publishable message.

In an optional embodiment, the apparatus further includes:

a generating module 1590, configured to generate a face selection message, where the face selection message is used to prompt at least two of the emoticons when the at least two facial region images are synthesized to the background image to generate an emoticon image Selecting in the face region, wherein each of the face region pictures corresponds to at least one face region in the emoticon image;

a generating module 1590, configured to generate a face selection instruction according to the face selection operation triggered in the face selection message, and display the face area indicated by the face selection instruction on the picture editing page. The picture editing page is used to perform image editing processing on the face area.

In an optional embodiment, the receiving module 1520 is further configured to acquire a replacement background picture operation triggered by the emoticon picture;

The receiving module 1520 is further configured to obtain the replaced background image to be synthesized according to the replacing the background image operation;

The synthesizing module 1530 is further configured to perform re-synthesis of the emoticon image according to the replaced background image to be synthesized and the facial region in the image, to obtain a recombined emoticon image;

The display module 1510 is further configured to display the re-formed emoticon image as an emoticon image preview

It should be noted that, when performing the expression picture generation process, the expression picture generation device provided by the above embodiment is only illustrated by the division of each function module. In actual application, the function may be assigned differently according to needs. The function module is completed, that is, the internal structure of the emoticon image generating device is divided into different functional modules to complete all or part of the functions described above.

In addition, the embodiment of the method for generating an emoticon and the method for generating an emoticon are provided in the same manner, and the specific manner in which each module performs the operation has been described in detail in the method embodiment, and details are not described herein again.

In an exemplary embodiment, an electronic device includes, but is not limited to, a processor and a memory.

The memory readable instructions are stored on the memory, and when the computer readable instructions are executed by the processor, the expression image generating method in each embodiment as described above is implemented.

In an exemplary embodiment, a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements an emoticon generating method in various embodiments as described above.

The above is only a preferred exemplary embodiment of the present application, and is not intended to limit the embodiments of the present application, and those skilled in the art can make corresponding modifications or modifications in a very convenient manner according to the main idea and spirit of the present application. Therefore, the scope of protection of this application shall be subject to the scope of protection required by the claims.

Claims (16)

1. An expression picture generating method is characterized in that it is applied to an electronic device, and the method includes:

   When the picture in the page includes a face area, an emoticon image generation entry corresponding to the picture is displayed in the page;

   Receiving an generated emoticon picture operation triggered by the emoticon image generation entry;

   Generating a face region in the picture to a background image to be synthesized according to the generating an emoticon picture operation, and generating an emoticon picture related to the picture.
2. The method according to claim 1, wherein the page comprises a message page that can continuously publish a message, wherein the picture in the page includes a face area, and the picture is automatically triggered to form a correlation in the page. Before the associated emoticon image generation portal, the method further includes:

   Performing picture message detection in the message page according to a preset time period;

   Performing face recognition on a picture in the picture message included in the message page to detect a face area in the picture when the picture message includes a picture message in the preset time period; or, when If the message page includes at least two picture messages in the preset time period, face recognition is performed on the picture in the picture message included in the message page to detect a face area in the picture.
3. The method according to claim 1, wherein said method further comprises: before said picture in the page comprises a face area, said method further comprises: before said picture is automatically triggered to form an associated expression picture generation entry for said picture include:

   Performing image message detection on consecutively posted messages according to the number of preset message releases;

   When the continuously published message includes the picture message in the preset number of published messages, performing face recognition on a picture in the picture message included in the continuous release message to detect a face in the picture Or, when the consecutively published message includes at least two picture messages, the face in the picture message included in the continuous release message is face-recognized to detect the location The face area in the picture.
4. The method according to claim 1, wherein the synthesizing a face region in the image to a background image to be synthesized according to the generating an emoticon image operation, and generating an emoticon image related to the image, comprising:

   Determining a face region in the picture by facial feature extraction according to the generating an emoticon picture operation;

   And cutting the picture according to the face area to obtain a picture of the face area;

   The face region picture is synthesized to the background image to be synthesized, and the expression picture related to the picture is generated.
5. The method according to any one of claims 2 to 4, wherein said synthesizing a face region in said picture to a background image to be synthesized according to said generating an emoticon picture operation, generating an expression related to said picture After the picture, the method further includes:

   Receiving a picture editing open operation triggered for the expression picture;

   And jumping to a picture editing page according to the picture editing open operation, where the picture editing page is used to edit the expression picture;

   Receiving a picture editing operation triggered in the picture editing page;

   Performing a picture editing process on the emoticon image according to the picture editing operation;

   The emoticon image processed by the photo editing forms a new photo message and is published in the message page of the continuously publishable message.
6. The method of claim 5, wherein the method further comprises: performing image editing processing on the emoticon image according to a photo editing operation triggered in the photo editing page, the method further comprising:

   Generating a face selection message for prompting selection in at least two facial regions in the emoticon image when at least two facial region images are synthesized to the background image to generate an emoticon image Wherein each of the facial region pictures corresponds to at least one facial region in the emoticon image;

   Generating a face selection instruction according to the face selection operation triggered in the face selection message, and displaying the face area indicated by the face selection instruction on the picture editing page, where the picture editing page is used for Performing a picture editing process on the face area.
7. The method according to any one of claims 1 to 4, wherein said synthesizing a face region in said picture to a background image to be synthesized according to said generating an emoticon picture operation, generating an expression related to said picture After the picture, the method further includes:

   Obtaining a replacement background image operation triggered by the emoticon image;

   Obtaining the replaced background image to be synthesized according to the replacing the background image operation;

   Performing re-synthesis of the expression image according to the replaced background image to be synthesized and the face region in the image, to obtain a re-synthesized expression image;

   The re-formed emoticon image is displayed as an emoticon image preview.
8. An expression picture generating device, characterized in that the device comprises:

   a display module, configured to: when the picture in the page includes a face area, display an expression picture generation entry corresponding to the picture in the page;

   a receiving module, configured to receive an generated emoticon image triggering operation on the emoticon image generation entry;

   And a synthesizing module, configured to synthesize a face region in the image to a background image to be synthesized according to the generating an emoticon image operation, and generate an emoticon image related to the image.
9. The device of claim 8, wherein the page comprises a message page that can continuously publish a message, the device further comprising:

   a detecting module, configured to perform image message detection in the message page according to a preset time period;

   a face recognition module, configured to perform face recognition on a picture in the picture message included in the message page to detect a picture message in the message page during the preset time period, to detect a picture in the picture a face area; or, when the message page includes at least two picture messages in the preset time period, performing face recognition on the picture in the picture message included in the message page to detect the picture The face area in the middle.
10. The device of claim 8 further comprising:

    a detecting module, configured to perform image message detection on consecutively posted messages according to a preset number of message releases;

    a face recognition module, configured to perform face recognition on a picture in a picture message included in the continuous release message when the continuously published message includes the picture message in the preset number of published messages, Detecting a face region in the picture; or, when the continuously published message includes at least two picture messages, the picture in the picture message included in the continuous release message is performed Face recognition to detect a face area in the picture.
11. The apparatus of claim 8 wherein said synthesizing module comprises:

    a face area determining unit, configured to determine a face area in the picture by facial feature extraction according to the generating an emoticon picture operation;

    a picture cropping unit, configured to crop the picture according to the face area to obtain a picture of a face area;

    The synthesizing module is further configured to synthesize the facial region picture to the background image to be synthesized, and generate the emoticon picture related to the picture.
12. The device according to any one of claims 9 to 11, wherein the receiving module is further configured to receive a picture editing open operation triggered by the emoticon picture;

    The device further includes:

    a jump module, configured to jump to a picture editing page according to the picture editing open operation, where the picture editing page is used to edit the expression picture;

    The receiving module is further configured to receive a picture editing operation triggered in the picture editing page;

    An editing module, configured to perform image editing processing on the emoticon image according to the image editing operation;

    And a publishing module, configured to form a new picture message by using the image editing processed image to be published in the message page of the continuously publishable message.
13. The device of claim 12, wherein the device further comprises:

    a generating module, configured to generate a face selection message, where the face selection message is used to prompt at least two faces in the emoticon image when at least two facial region images are synthesized to the background image to generate an emoticon image Selecting in the region, wherein each of the facial region pictures corresponds to at least one facial region in the emoticon image;

    The generating module is further configured to generate a face selection instruction according to the face selection operation triggered in the face selection message, and display the face area indicated by the face selection instruction on the picture editing page. The picture editing page is configured to perform a picture editing process on the face area.
14. The device according to any one of claims 8 to 11, wherein the receiving module is further configured to acquire a replacement background image operation triggered by the emoticon image;

    The receiving module is further configured to obtain the replaced background image to be synthesized according to the replacing the background image operation;

    The synthesizing module is further configured to re-synthesize an emoticon image according to the replaced background image to be synthesized and a facial region in the image, to obtain a recombined emoticon image;

    The display module is further configured to display the re-formed emoticon image as an emoticon image preview.
15. An electronic device, comprising:

    Processor; and

    A memory having computer readable instructions stored thereon, the computer readable instructions being executed by the processor to implement the emoticon generating method of any one of claims 1 to 7.
16. A computer readable storage medium having stored thereon a computer program, wherein the computer program is executed by a processor to implement the expression image generating method according to any one of claims 1 to 7.

Images