WO2021047094A1 - Virtual gift special effect processing method and apparatus, and live streaming system - Google Patents

Abstract

Provided are a virtual gift special effect processing method and apparatus, a live streaming system, a device and a storage medium. The processing method comprises: receiving a gifting instruction of a virtual gift sent by an audience client; according to the gifting instruction, acquiring a corresponding target special effect gift and determining a feature area of the target special effect gift; according to the feature area, determining compositing position information of the target special effect gift on a live stream video; sending the live stream video and the compositing position information to the client so that the audience client can, according to the compositing position information, add the target special effect gift to the live stream video for compositing and display. The present application uses an anchor client to encode and encapsulate compositing position information outside of a live stream video, said information is transmitted independently from the live stream video and is decoded at an audience client, which facilitates the audience client editing the effect display of a virtual special effect gift for the second time, and which helps to improve the effect of the display of special effects.

Description

Method and device for processing virtual gift special effects, and live broadcast system Technical field

The embodiments of the present application relate to the field of live broadcast technology, in particular, to a method and device for processing virtual gift special effects, a live broadcast system, and also to a computer device and a storage medium.

Background technique

With the development of network technology, real-time video communication such as live webcasts and video chat rooms have become an increasingly popular form of entertainment. In the process of real-time video communication, the interaction between users can be increased by giving virtual gifts to display special effects.

For example, in a live broadcast scenario, the host user performs the live broadcast in the live broadcast room, and the viewer user watches the host's live broadcast process on the viewer client. In order to increase the interaction between the anchor user and the audience user, the audience user can choose a specific target special effect gift to give to the anchor, and add the target special effect gift to a specific position of the anchor screen according to the corresponding entertainment template to display the corresponding special effect.

The existing gift special effect display method is to synthesize the gift special effect into the video frame through the host client, and put the video frame containing the gift special effect into the video stream and transmit it to other host clients or audience clients for special effect display. The gift special effects are fixed in the video area, which is not conducive to the subsequent adjustment of the gift special effects and affects the overall display effect.

Summary of the invention

The purpose of this application is to solve at least one of the above technical shortcomings, especially the problem that it is not conducive to secondary adjustment of virtual gift special effects and poor display effect.

In the first aspect, an embodiment of the present application provides a method for processing virtual gift special effects, including the following steps:

Receiving a gifting instruction of a virtual gift, obtaining a corresponding target special effect gift according to the gifting instruction, and determining a characteristic area of the target special effect gift;

Determining, according to the characteristic area, synthetic location information of the target special effect gift on the live video;

The live video and the synthesized location information are sent to the audience client, so that the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesized location information.

In the second aspect, an embodiment of the present application provides a method for processing virtual gift special effects, including the following steps:

Send a virtual gift giving instruction to the host client; wherein, the host client obtains the corresponding target special effect gift according to the gift instruction and determines the characteristic area of the target special effect gift, and determines the target special effect gift according to the characteristic area Synthesized location information on the live video;

Receiving live video stream data sent by the host client; wherein the live video stream data includes the combined location information of the live video and the target special effect gift;

The live video stream data is forwarded to a viewer client; wherein, the viewer client adds the target special effect gift to the live video according to the combined location information to synthesize and display.

In a third aspect, an embodiment of the present application provides a device for processing virtual gift special effects, including:

The feature acquisition module is configured to receive a virtual gift giving instruction, obtain a corresponding target special effect gift according to the gift instruction, and determine the characteristic area of the target special effect gift;

An information determining module, configured to determine the combined location information of the target special effect gift on the live video according to the characteristic area;

The information sending module is configured to send the live video and the synthesized location information to the audience client, so that the audience client adds the target special effect gift to the live video for synthesis and synthesis according to the synthesized location information To show.

In a fourth aspect, an embodiment of the present application provides a device for processing virtual gift special effects, including:

The instruction sending module is used to send a virtual gift giving instruction to the host client; wherein, the host client obtains the corresponding target special effect gift according to the gift instruction and determines the characteristic area of the target special effect gift, according to the characteristic The area determines the synthesized location information of the target special effect gift on the live video;

The data receiving module is configured to receive live video stream data sent by the host client; wherein, the live video stream data includes the combined location information of the live video and the target special effect gift;

The data forwarding module is configured to forward the live video stream data to an audience client; wherein, the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesis location information.

In a fifth aspect, an embodiment of the present application provides a live broadcast system, including an anchor client, an audience client, and a server, the anchor client communicates with the audience client through the network through the server;

The server is configured to receive a virtual gift giving instruction sent by the viewer client, and send the gift instruction to the anchor client;

The anchor client is configured to receive the gift instruction and obtain a target special effect gift identifier; find the target special effect gift according to the target special effect gift identifier, and determine the characteristic area corresponding to the target special effect gift; according to the characteristic area Determine the combined location information of the target special effect gift on the live video; encode the combined location information and the live video into live video stream data and send it to the server;

The server is also used to forward the live video stream data to the viewer client;

The audience client is configured to receive live video stream data and target special effect gifts, and obtain the combined location information of the live video and the target special effect gifts from the live video stream data; combine the target with the combined location information The special effect gift is added to the live video for synthesis and display.

In a sixth aspect, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and capable of running on the processor. When the processor executes the program, it can implement any of the above The steps of the method for processing virtual gift special effects described in the embodiment.

In a seventh aspect, an embodiment of the present application provides a storage medium containing computer-executable instructions, when the computer-executable instructions are executed by a computer processor, they are used to perform the processing of virtual gift special effects as described in any of the above embodiments. Method steps.

The virtual gift special effect processing method and device, live broadcast system, equipment, and storage medium provided in the above embodiment receive the virtual gift gift instruction sent by the viewer client, obtain the corresponding target special effect gift according to the gift instruction, and determine the target special effect gift Feature area; Determine the composite location information of the target special effect gift on the live video according to the feature area; send the live video and composite location information to the client, so that the audience client adds the target special effect gift to the live video for synthesis and synthesis based on the composite location information To show. Compared with the host client, the target special effect gift is directly synthesized into the live video, and then sent to each viewer client to play the virtual gift special effect in the video area of the viewer client. This solution uses the host client to encode the synthesized location information outside the live video Encapsulation, independent of the live video transmission, so that the audience client decodes the synthesized location information, which is convenient for the secondary editing of the effect display of the virtual special effect gift, which is beneficial to the audience client to achieve hierarchical special effect processing and cross-live video playback area Special effects display, improve the effect of special effects display.

Description of the drawings

FIG. 1 is a schematic diagram of a system framework of a method for processing virtual gift special effects provided by an embodiment;

FIG. 2 is a schematic structural diagram of a live broadcast system provided by an embodiment;

FIG. 3 is a flowchart of a method for processing virtual gift special effects according to an embodiment;

FIG. 4 is a flowchart of a method for obtaining synthetic location information according to an embodiment;

FIG. 5 is a flowchart of a method for synthesizing virtual gift special effects according to an embodiment;

Figure 6 is a composite effect diagram of a virtual gift in a live broadcast technology;

FIG. 7 is an effect diagram of virtual gift synthesis provided by an embodiment;

FIG. 8 is a flowchart of a method for rendering virtual gift special effects according to an embodiment;

Figure 9 is a rendering effect diagram of a virtual gift in a live broadcast technology;

FIG. 10 is another flowchart of a method for processing virtual gift special effects provided by an embodiment;

FIG. 11 is a sequence diagram of a virtual gift giving process provided by an embodiment;

FIG. 12 is a schematic structural diagram of an apparatus for processing virtual gift special effects provided by an embodiment; and

FIG. 13 is a schematic diagram of another structure of a device for processing virtual gift special effects provided by an embodiment.

detailed description

In order to better explain the technical solution of this application, the following shows the applicable application environment of the virtual gift special effect processing method of this solution. As shown in FIG. 1, FIG. 1 is a schematic diagram of a system framework of a method for processing virtual gift special effects provided by an embodiment. The system framework may include a server and a client. The live broadcast platform on the server side may include multiple virtual live broadcast rooms and servers, etc., and each virtual live broadcast room correspondingly plays different live content. Clients include a viewer client and a host client. Generally speaking, the host conducts live broadcast through the host client, and the viewer chooses to enter a virtual live room through the viewer client to watch the host live. The audience client and the anchor client can enter the live broadcast platform through a live broadcast application (Application, APP) installed on the terminal device.

In this embodiment, the terminal device may be a terminal such as a smart phone, a tablet computer, an e-reader, a desktop computer, or a notebook computer, which is not limited. A server is a back-end server used to provide back-end services to terminal devices, and it can be implemented by an independent server or a server cluster composed of multiple servers.

The method for processing virtual gift special effects provided in this embodiment is applicable to the situation where virtual gifts are presented and the virtual gift special effects are displayed during the live broadcast. It can be that the audience presents virtual gifts to the target anchor through the audience client, so as to be at the target anchor’s location. The host client and multiple viewer clients display the special effects of virtual gifts, or the host can give a virtual gift to another host through the host client, so that the host who gives the virtual gift and the host who receives the virtual gift is located on the host client And multiple audience clients show special effects of virtual gifts, etc.

The following takes the audience client to present a virtual special effect gift to the target anchor as an example to illustrate the solution.

FIG. 2 is a schematic structural diagram of a live broadcast system provided by an embodiment. As shown in FIG. 2, the live broadcast system 200 includes: an anchor client 210, an audience client 230, and a server 220. The host client 210 communicates with the audience client 230 via the server 220 through a network.

In this embodiment, the host client can be the host client installed on a computer, or it can be installed on a mobile terminal, such as a mobile phone or tablet; similarly, the audience client can be installed on The audience client on the computer may also be the audience client installed on a mobile terminal, such as a mobile phone or a tablet computer.

The server 220 is configured to receive a virtual gift giving instruction sent by the viewer client 230, and send the gift instruction to the anchor client 210;

The host client 210 is configured to receive the gift instruction and obtain the target special effect gift identifier; find the target special effect gift according to the target special effect gift identifier, and determine the characteristic area corresponding to the target special effect gift; according to the characteristics The region determines the combined location information of the target special effect gift on the live video; encodes the combined location information and the live video into live video stream data and sends it to the server;

The server 220 is also used to forward the live video stream data to the viewer client 230;

The audience client 230 is configured to receive live video stream data and target special effect gifts, and obtain the combined location information of the live video and the target special effect gifts from the live video stream data; and convert the combined location information according to the combined location information. The target special effect gift is added to the live video for synthesis to obtain a special effect frame image; a special effect display area is set on the live broadcast window, and the special effect frame image is synchronously rendered in the special effect display area during the process of playing the live video .

FIG. 3 is a flowchart of a method for processing virtual gift special effects according to an embodiment. The method for processing virtual gift special effects is executed on a client, such as a host client. In some embodiments, it can also be executed on a server, such as a server. In this embodiment, the anchor client is taken as an example for description.

Specifically, as shown in FIG. 3, the method for processing the virtual gift special effect may include the following steps:

S110. Receive a gifting instruction of a virtual gift, obtain a corresponding target special effect gift according to the gifting instruction, and determine a characteristic area of the target special effect gift.

While watching the live video, the viewer presents a virtual gift to the target host, and selects the target special effect gift by triggering the relevant function button on the viewer client, and sends a virtual gift gift instruction to the server. The server receives the gift instruction and forwards it to the host client. Wherein, the gift request of the virtual gift carries information such as the target special effect gift identifier and the target anchor identifier.

The host client receives the virtual gift giving instruction sent by the viewer client, analyzes the information carried in the gift instruction, and obtains the target special effect gift identifier and the target host identifier. The server finds the corresponding target special effect gift according to the target special effect gift identifier. Optionally, the target special effect gift may be a special effect gift in a two-dimensional display form, or a special effect gift in a three-dimensional display form, that is, a three-dimensional special effect gift. In this embodiment, the target special effect gift is preferably a three-dimensional special effect gift, such as an AI (Artificial Intelligence) special effect gift. The three-dimensional special effect gift is used to create a three-dimensional special effect, enhance the reality experience, and improve the processing effect of the virtual gift special effect.

In the embodiment, the target special effect gift is displayed according to the characteristics of the character, and different target special effect gifts correspond to their own characteristic areas, where the characteristic area refers to the correspondingly set area of the target special effect gift on the live video. Exemplarily, the target special effect gift can be angel wings, masks, hats, etc. The angel wings can be set on the anchor’s back, and the characteristic area corresponding to the angel wings is the back; the mask is worn near the eyes of the anchor, the mask corresponds to the characteristic area It is the face; if the hat is worn on the head of the anchor, the characteristic area corresponding to the hat is the head, etc.

S120: Determine the combined location information of the target special effect gift on the live video according to the characteristic area.

Wherein, the synthesized position information may include: at least one of face information, human contour information, gesture information, and human bone information. In an embodiment, the synthesized location information may include the target special effect gift obtained by recognizing the live video based on the host client to synthesize the target location of the live video.

When the host client receives the virtual gift giving instruction sent by the viewer client, it obtains the live video of the live room where the target host is located, extracts the current video frame image from the live video, and processes the current video frame image according to the target special effect gift. In order to extract relevant information used to synthesize the target special effect gift, such as the synthesis position information of the characteristic area of the target special effect gift in the current video frame image. According to the synthesis position information, the target special effect gift can be synthesized to the target position of the current video frame image, wherein the characteristic area of the target special effect gift corresponds to the target position of the current video frame image one-to-one. In an embodiment, the synthesized position information may be represented by one or more key points of the person's outline, where each key point of the person's outline has a unique coordinate value in the current video frame image, according to one or more of the key points of the person's outline. A coordinate value can be obtained by adding the target special effect gift to the target position of the current video frame image.

In order to explain this solution more clearly, this embodiment will exemplify the "mask" as the target special effect gift.

In the embodiment, the audience presents the target special effect gift of "mask" to the target anchor, and the characteristic area corresponding to the "mask" is the face. The server obtains the live video of the live broadcast room where the target host is located, extracts the current video frame image, recognizes the current video frame image, and obtains a series of key outlines of characters, and determines certain target outline points from these key outlines of characters Corresponding to the feature area, such as target contour points A (50, 55), B (45, 48) and C (45, 60), the target contour points A, B and C are connected according to a specific algorithm. The area is the target position of the target special effect present in the current video frame image. Optionally, the combined position information of the "mask" in the current video frame image includes the coordinate values of the target contour points A, B, and C.

S130. Send the live video and the synthesized location information to the audience client, so that the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesized location information .

After the host client obtains the synthesized location information, it encodes the synthesized location information and the live video to form a data packet, which is sent to the viewer client. After the audience client receives the data packet, it decodes and extracts the live video and composite location information. In this embodiment, the synthesized position information includes the coordinate value of the target contour point of the target special effect present in the current video frame image.

After the viewer client obtains the composite location information, it will convert the composite location information according to the size of the special effect display area of the current viewer client, and determine the target of the target special effect gift on the current video frame image according to the converted composite location information Position, add the target special effect gift to the target position for synthesis.

For example, the host client recognizes that the resolution size of the current video frame image is 400*300, and the coordinate value of the target contour point A in the obtained composite position information is (50, 50), and the viewer client displays the same current The resolution size of the video frame image is 800*600, and the synthesized position information is converted correspondingly to obtain the coordinate value of the current target contour point A'(100, 100). The target special effect gift is added to the target position determined by the converted synthesis position information for synthesis. It should be noted that the same current video frame image means that the content of the video frame image is the same, and other features such as resolution and image size may be different.

In this embodiment, the current video frame image of the live video can be extracted, the target special effect gift is added to the current video frame image on the viewer client to synthesize the special effect frame image, and the effect is displayed in the pre-configured special effect display area. The special effect display area can be independent of the video area to improve the display effect of the special effect.

The method for processing virtual gift special effects provided in this embodiment is applied to an anchor client, by receiving a virtual gift giving instruction sent by the viewer client, obtaining the corresponding target special effect gift according to the giving instruction and determining the characteristic area of the target special effect gift; The characteristic area determines the combined location information of the target special effect gift on the live video; the live video and the combined location information are sent to the client, so that the viewer client adds the target special effect gift to the live video for synthesis and display according to the combined location information. In this solution, the synthesized location information is sent to the audience client along with the live video. Compared with the host client directly synthesizes the target special effect gift into the live video, and then sends it to each viewer client to play the virtual gift special effect in the video area of the viewer client, this embodiment uses the host client to synthesize location information outside the live video Encoding and encapsulation makes the synthesized location information independent of the live video, and is transmitted with the live video, so that the audience client can edit the effect of the virtual special effect gift according to the synthesized location information combined with the audience client, which is beneficial to the audience client Realize layered special effect processing and special effect display across the live video playback area to improve the effect of special effect display

In order to make the technical solution clearer and easier to understand, the specific implementation process and manner of each step in the technical solution are described in detail below.

In an embodiment, obtaining the corresponding target special effect gift according to the gift instruction in step S110 and determining the characteristic area of the target special effect gift may include the following steps:

S1101. Obtain a target special effect gift identifier.

In the embodiment, different virtual gifts have unique identifiers, and different virtual gifts have different display forms. For example, according to the types of virtual gifts, they can be divided into ordinary virtual gifts and special virtual gifts. If the gift is an ordinary virtual gift, the special effect display is performed according to the gift display method of the prior art; if the gift is a special virtual gift, the special effect display is performed according to the processing method of the virtual gift special effect provided by this solution.

In the embodiment, the target special effect gift identifier is acquired, and it is determined whether it is a special virtual gift according to the target special effect gift identifier, and if so, step S1102 is executed.

S1102. Find a target special effect gift according to the target special effect gift identifier, and determine the characteristic area corresponding to the target special effect gift.

In the embodiment, different target special effect gifts correspond to different feature regions, that is, different target special effect gifts are added to the live video at different positions. For example, "angel wings" is added to the anchor's back, "hat" is added to the anchor's head, etc.

The server obtains the target special effect gift identifier, and finds the target special effect gift and its characteristic area corresponding to the target special effect gift identifier from the pre-configured database. Optionally, the characteristic area can be identified by certain set characters, for example, the letter A represents the head and the letter B represents the back.

In one embodiment, the target special effect gift identifier, the target special effect gift, and the characteristic area may establish an association relationship, such as {0001, angel wings, A}, where 0001 represents the target special effect gift identifier, and "angel wings" represents the target special effect gift. Name, A represents the characteristic area of the target special effect gift, such as the back. Further, the association relationship can be stored in the form of a data structure.

FIG. 4 is a flowchart of a method for obtaining synthetic location information provided by an embodiment. As shown in FIG. 4, in an embodiment, in step S120, the target special effect gift on the live video is determined according to the characteristic region. Synthesizing location information may include the following steps:

S1201. Obtain a current video frame image of the live video.

Among them, the current video frame image may be one frame or multiple frames.

When receiving the virtual gift giving instruction sent by the viewer client, the host client obtains one or more current video frame images of the live video in the live broadcast room where the target live broadcast is located. When the current video frame image is multiple frames, the current video frame image of the multiple frames may be a connected frame video image or an alternate frame video image.

S1202, extract the key points of the outline of the person in the current video frame image.

In the embodiment, the host client preprocesses the current video frame image, such as image format conversion, filtering and de-drying, binarization processing, etc., extracts the person profile of the current video frame image after preprocessing, and then passes it according to the profile. The algorithm calculates the key points of the character outline. Generally speaking, the current video frame image needs to be converted into a bitmap image. The bitmap is composed of pixels. Pixels are the smallest information units of the bitmap. They are stored in the image grid. Each pixel has a specific position and color value. The position of the pixel can be coordinated according to the size of the image. (x,y) to represent.

It should be noted that the method of extracting the key points of the person's outline in the current video frame image can be achieved by existing tools and algorithms, such as OpenCV, HOG, and OTSU algorithms. Of course, the person in the current video frame image can also be extracted by other methods. Outline key points.

The collection of key points of different person outlines corresponds to different human body information. For example, the face part of the current video frame image is identified, and the contour key points of the face part are extracted. In one embodiment, the face information may include 106 contour key points, and each contour key point corresponds to the face For a certain part, each contour key point corresponds to a unique coordinate value, which indicates the position of the contour key point in the current video frame image. In the same way, the body contour includes 59 contour key points. Each contour key point corresponds to the edge contour of each part of the human body. The human skeleton includes 22 contour key points. Each contour key point corresponds to the joint point of the human bone. The coordinate value of the point indicates the position in the current video frame image.

S1203: Determine a target position corresponding to the characteristic region on the current video frame image according to the key points of the person contour, so as to synthesize the target special effect gift at the target position.

Among them, the characteristic area corresponding to the target special effect gift corresponds to the target position in the current video frame image. For example, the characteristic area of the target special effect gift "angel wings" is "back". From the extracted key points of the contours of the characters, the key points of the contours belonging to the "back" feature are identified and determined as the target contour points. According to these target contour points, The coordinate value on the current video frame image determines the target position for synthesis on the current video frame image where the target special effect gift is located. The target position can be a collection of the coordinate values of the target contour points, or it can be formed by the connection of the target contour points Area.

In an embodiment, the step S120 sending the live video and the synthesized location information to the client may include the following steps:

The live video and the synthesized location information are encoded and packaged into live video stream data, and the live video stream data is forwarded to the viewer client through a server.

In this embodiment, the host client encodes and encapsulates the live video and the synthesized location information identified according to the target special effect gift into a data packet to form live video stream data. The host client sends the live video stream data to the server, so that the server forwards the live video stream data to the viewer client.

The viewer client decodes the live video stream data to obtain synthesized location information, and processes the target special effect gift according to the synthesized location information.

Exemplary one: Figure 5 is a flowchart of a method for synthesizing virtual gift special effects according to an embodiment. As shown in Figure 5, the audience client performs layered synthesis processing on the target special effect gift according to the synthetic location information. The main process can be as follows:

S110a. Receive live video stream data and a target special effect gift, and obtain synthetic location information of the live video and the target special effect gift from the live video stream data.

Wherein, the combined location information may include a target location on the live video that is synthesized on the live video based on the target special effect gift obtained by the host client recognizing the live video.

In the embodiment, the user sends a virtual gift giving instruction to the server through the audience client. The host client receives the gift instruction forwarded by the end server, and obtains the feature area corresponding to the live video and the target special effect gift. Optionally, the characteristic area may be recognized by the host client according to the gift instruction, or it may be obtained by the server after receiving the gift instruction and then forwarded to the host client. In this embodiment, the anchor client recognizes the characteristic area corresponding to the target special effect gift according to the gift instruction as an example for description.

After the viewer client receives the live video stream data, decodes it to obtain the synthesized location information and the live video, and obtains the current video frame image from the live video. It should be noted that the host client is used to identify the current video frame image corresponding to the synthesized location information and the current video frame image obtained by the viewer client from the live video is the same frame image, which is displayed on the host client and the viewer client. Resolution, size, color, etc. can be different.

Among them, the target special effect gift can be a special effect gift in a two-dimensional display form, or a special effect gift in a three-dimensional display form, that is, a three-dimensional special effect gift. In this embodiment, the target special effect gift is preferably a three-dimensional special effect gift, and the three-dimensional special effect gift is used to create a three-dimensional special effect to enhance the reality experience and improve the display effect of the virtual gift special effect.

S120a: Divide the live video into a foreground image layer and a background image layer, and generate at least one virtual gift special effect layer according to the target special effect gift.

Specifically, the current video frame image is obtained from the live video; the current video frame image is divided into a foreground area and a background area; wherein the layer where the foreground area is located is the foreground image layer; the layer where the background area is located is the background image Floor.

In the embodiment, the viewer client obtains the current video frame image from the live video, where the current video frame image may be one frame of video frame image or multiple frames of video frame image.

Further, background segmentation processing is performed on the current video frame image. The existing algorithm can be used to compare the pixel values of the current video frame image, and the current video frame image is divided into the foreground area and the background area. For example, the area corresponding to the set of pixel points with a pixel value greater than a certain threshold is used as the foreground area , The area corresponding to the set of pixel points whose pixel value is less than a certain threshold is regarded as the background area. In the embodiment, the foreground area and the background area are located in different image layers, where the image layer where the foreground area is located is the foreground image layer, and the image layer where the background area is located is the background image layer.

In an embodiment, the foreground image layer may include an anchor character area in the live video, and the background image layer may include a background area excluding the anchor character area in the live video. In addition, in the embodiment, the target special effect gift can be split to generate one or more virtual gift special effect layers corresponding to the target special effect gift. For example, the "mask" gift has only one virtual gift special effect layer, and the "snowflake" gift can It includes multiple virtual gift special effect layers, such as the first snowflake on the virtual gift special effect layer A, the second snowflake on the virtual gift special effect layer B, and the third and fourth snowflakes on the virtual gift special effect layer C.

The viewer client obtains the foreground image layer, background image layer, and one or more virtual gift special effect layers corresponding to the target special effect gift of the current video frame image. Optionally, it can be processed and cached accordingly.

S130a: According to the synthesis position information, each of the virtual gift special effect layers, the foreground image layer and the background image layer are synthesized and displayed in sequence.

Exemplarily, the synthesized position information includes the positions A (50, 50), B (55, 60), C (70, 100) of the key points of the character outline, and each layer includes a foreground image layer a, a background image layer b, and virtual gift special effects. Layer c, virtual gift special effect layer d and virtual gift special effect layer e. The composition order of each layer is b, c, a, d and e, and c corresponds to the position of A, d corresponds to the position of B, and e corresponds to the position of C .

First, set the background image layer b on the bottom layer, then synthesize the virtual gift special effect layer c with the foreground image layer a according to the position A, then synthesize the virtual gift special effect layer d according to the position B, and finally combine the virtual gift special effect according to the position C Layer e is synthesized so that each part of the target special effect gift is added to the target position corresponding to the current video frame image, and then the current video frame image of the synthesized target special effect gift is displayed.

As shown in Figure 6, Figure 6 is a composite rendering of a virtual gift in a live broadcast technology. In this technology, especially in the process of displaying large special effects gifts, the virtual gift is directly added to the live video, so that the virtual gift and the live broadcast are directly added to the live video. The video images overlap and obscure the anchor characters and affect the user's viewing; and the technology of this application can avoid obstructing the anchor characters, and a better special effect display effect can be obtained.

Figure 7 is an effect diagram of virtual gift synthesis provided by an embodiment. As shown in Figure 7, the foreground image layer where the host character is located is set on the special effect layer where the "angel wings" is located according to the human back contour information of the host, and the "angel wings" is blocked. The setting area of “Angel Wings” achieves the effect of adding “Angel Wings” to the anchor character’s back. According to the anchor’s facial profile information, the special effect layer of the “mask” is set on the foreground image layer of the anchor character to block The face setting area of the host character achieves the effect of adding a "mask" to the eyes of the host character, so that the target special effect gift can be synthesized into the target position of the current video frame image of the live video according to the human contour characteristics, and better special effects are obtained Display of results.

In the method for synthesizing virtual gift special effects provided in this embodiment, by receiving live video stream data and target special effect gifts, the combined position information of the live video and target special effect gifts is obtained from the live video stream data; the live video is divided into foreground image layers and The background image layer, and at least one virtual gift special effect layer is generated according to the target special effect gift; the virtual gift special effect layer, the foreground image layer and the background image layer are synthesized and displayed in sequence according to the synthesis position information. In this embodiment, the audience client combines and displays the at least one virtual gift special effect layer corresponding to the target special effect gift and the foreground image layer and background image layer of the current video frame image in order according to the synthetic location information, thereby realizing the realization of the figure according to the profile. The obtained synthetic location information synthesizes the target special effect gift to the established target position of the current video frame image, avoiding the target special effect gift being directly displayed in the video area and obstructing the anchor character and affecting the live broadcast effect. At the same time, it also improves the virtual gift special effect. Display of results.

Example 2: FIG. 8 is a flowchart of a method for rendering virtual gift special effects according to an embodiment. As shown in FIG. 8, the audience client renders the target special effect gift across the live video playback area according to the synthesized location information. The process can be as follows:

Specifically, as shown in FIG. 8, the rendering method of the virtual gift special effect may include the following steps:

S110b. Receive live video stream data and a target special effect gift, and obtain combined location information of the live video and the target special effect gift from the live video stream data.

The target special effect gift in this embodiment may be a special effect gift in a three-dimensional display form, that is, a three-dimensional special effect gift (AI (Artificial Intelligence) virtual special effect gift). Create three-dimensional special effects through three-dimensional special effects gifts, enhance the feeling of reality, and improve the rendering effect of virtual gift special effects.

This step is the same as step S110a, and will not be described in detail here.

S120b: Add the target special effect gift to the live video for synthesis according to the synthesis position information to obtain a special effect frame image.

The audience client obtains the composite position information, determines the target position of the target special effect gift in the current video frame image of the live video according to the composite position information, adds the target special effect gift to the target position and synthesizes the current video frame image to obtain the special effect frame image. Among them, the current video frame image may be one frame of video frame image or multiple frames of video frame image.

In an embodiment, the current video frame image can be divided into a foreground image layer and a background image layer, and the target special effect gift can include one or more virtual gift special effect layers. In the embodiment, the target special effect gift can be split to generate the target One or more virtual gift special effect layers corresponding to the special effect gift, determine the target position of each virtual gift special effect layer on the foreground image layer or the background image layer according to the synthesis position information, and combine the virtual gift special effect layer, foreground image layer and background The image layer is synthesized to obtain the special effect frame image.

In an embodiment, each of the virtual gift special effect layers, the foreground image layer and the background image layer are synthesized and displayed in a priority order according to the synthesis position information.

S130b: Set a special effect display area on the live window, and render the special effect frame image synchronously in the special effect display area during the process of playing the live video.

The live broadcast window refers to the corresponding window when the live broadcast application is in the open state, and in the maximized state, it can occupy the entire terminal device screen. In this embodiment, a special effect display area is set on the live window, the special effect display area is set above the live video playback area, and the special effect display area is larger than the live video playback area, so that the special effect corresponding to the target special effect gift can be magnified and rendered. Improve the effect of special effects display. Among them, the live video playing area refers to an area used to play the live video.

After the viewer client obtains the composite location information, it will convert the composite location information according to the size of the special effect display area of the current viewer client, and determine the target of the target special effect gift on the current video frame image according to the converted composite location information Position, add the target special effect gift to the target position for synthesis.

For example, the host client recognizes that the resolution size of the current video frame image is 400*300, and the coordinate value of the target contour point A in the obtained composite position information is (50, 50), and the viewer client displays the same current The resolution size of the video frame image is 800*600, and the synthesized position information is converted correspondingly to obtain the coordinate value of the current target contour point A'(100, 100). The target special effect gift is added to the target position determined by the converted synthesis position information for synthesis. It should be noted that the same current video frame image means that the content of the video frame image is the same, and other features such as resolution and image size may be different.

In this embodiment, the special effect display of the image frame image and the live video playback occupy different threads, so that while one of the threads is playing the live video, the other thread can simultaneously render the special effect frame images to the special effect display area to achieve Video playback and special effects display are carried out simultaneously, which improves the display effect of special effects.

It should be noted that the area of the special effect layer corresponding to the special effect gift that is blocked by the host character is made transparent, so that the display of special effects across the live video playback area does not affect the normal video playback of the live video playback area.

As shown in Figure 9, Figure 9 is a rendering of a virtual gift in a live broadcast technology. In this technology, especially in the process of AR (Augmented Reality) virtual special effects gift display, AR virtual gifts can only be realistic In the live video playback area, the display effect is not good; however, after adopting the technology of this application, it can be displayed across the live video playback area, and a better special effect display effect can be obtained.

Continuing to refer to Figure 7, as shown in Figure 7, the special effect display area is set in the live video playback area. The area of the special effect display area is larger than the live video playback area. The virtual gift special effect is rendered to the special effect display area, so that the virtual gift special effect can be broadcast live The video area is displayed, such as the "angel wings" in the virtual special effects gift shown in Figure 7, to get a better special effect display effect.

The virtual gift special effect rendering method provided in this embodiment obtains the combined location information of the live video and the target special effect gift from the live video stream data by receiving the live video stream data and the target special effect gift; wherein the combined location information includes information based on the host client The target special effect gift obtained by recognizing the live video is synthesized on the target position of the live video; according to the synthesized position information, the target special effect gift is added to the live video for synthesis to obtain the special effect frame image; the special effect display area is set on the live broadcast window, In the process of playing the live video, the special effect frame images are synchronously rendered in the special effect display area, so that the virtual gift special effect is not limited to the live video play area of the client, and can be rendered and displayed across the video play area.

FIG. 10 is another flowchart of a method for processing virtual gift special effects according to an embodiment. The method for processing virtual gift special effects is applied to the server and can be executed by the server.

Specifically, as shown in FIG. 10, the method for processing virtual gift special effects includes the following steps:

S410: Send a virtual gift giving instruction to the anchor client.

Wherein, the host client obtains the corresponding target special effect gift according to the gift instruction and determines the characteristic area of the target special effect gift, and determines the synthesized position information of the target special effect gift on the live video according to the characteristic area .

While watching the live video, the viewer presents a virtual gift to the target anchor, and selects the target special effect gift by triggering the relevant function button on the viewer client, so that the viewer client sends a virtual gift gift instruction to the server, and the server receives the gift instruction and forwards it To the host client, the gift request of the virtual gift carries information such as the target special effect gift identifier and the target host identifier.

After the server forwards the virtual gift giving instruction sent by the viewer client to the anchor client, it determines the corresponding target special effect gift and its corresponding characteristic area according to the obtained target special effect gift identifier, and at the same time obtains the current video frame image in the live video , The current video frame image is recognized, and the characteristic area of the target special effect gift is obtained at the target contour point corresponding to the current video frame image, and the synthesized position information is obtained.

S420: Receive live video stream data sent by the host client.

Wherein, the live video stream data includes the combined location information of the live video and the target special effect gift.

The host client encodes the synthesized location information and the live video to form live video stream data, so that the synthesized location information is transmitted independently following the live video. In the embodiment, the server receives the live video stream data obtained by the host client for transmission according to the set communication protocol.

S430. Forward the live video stream data to a viewer client; wherein, the viewer client adds the target special effect gift to the live video according to the combined location information, combines and displays it.

The server receives the live video stream sent by the host client and forwards it to each viewer client in the same live room, so that the viewer client decodes the live video stream data to obtain synthesized location information, and adds the target special effect gift according to the synthesized location information Go to the target location on the live video to synthesize, and display the synthesized target special effect gift.

The method for processing virtual gift special effects provided in this embodiment is applied to the server by sending a virtual gift gift instruction to the host client; wherein the host client obtains the corresponding target special effect gift according to the gift instruction and determines the characteristic area of the target special effect gift , Determine the combined location information of the target special effect gift on the live video according to the characteristic area; receive the live video stream data sent by the host client; where the live video stream data includes the combined location information of the live video and the target special effect gift; convert the live video The streaming data is forwarded to the audience client; among them, the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesis location information. This solution sends the synthesized location information along with the live video to the audience client through the server, so that the synthesized location information is independent of the live video and is transmitted following the live video, so that the audience client can combine the synthesized location information with the audience client to present virtual special effects The effect of the display is re-edited, which is conducive to the realization of layered special effect processing and special effect display across the live video playback area on the audience client, thereby improving the effect of special effect display.

In order to explain the technical solution of the present application more clearly, a further description will be given in conjunction with examples in several scenarios.

Scenario 1: Refer to Figure 11, which is a timing diagram of the virtual gift giving process provided by an embodiment; in this example, the viewer presents the anchor with a three-dimensional special effect gift "angel wings", the corresponding identification is ID1648, then the main process can be as follows :

S11. The audience client sends a gift-giving request to the server.

The audience user W sends a gift-giving request to the server through the audience client, where the virtual gift is ID1648.

S12. The server performs business processing.

After the server receives the gift-giving request, it will do the corresponding business processing (such as deduction, etc.).

S13. The server broadcasts gift-giving information.

Broadcast the gift-giving information that the viewer user W presents the ID1648 gift to the host to all users in the channel, including the host client and the viewer client.

S14. After receiving the gift-giving information, the host client queries the virtual gift to identify the synthesized location information.

After the host client receives the broadcast of the gift information, it queries the gift configuration according to the virtual gift ID 1648 and obtains that the virtual gift is a three-dimensional special effect gift (such as an AI (Artificial Intelligence) gift). The synthetic location information that needs to be recognized includes the face and back. The host client starts to perform face recognition and background segmentation recognition.

S15. The host client packs the synthesized location information into the live video stream for transmission.

The host client packs the synthesized location information (which can be AI information) obtained by face recognition and background segmentation recognition into a live video stream, and transmits the live video together with the live video to the server through the live video stream.

S16. The server forwards the live video stream.

The server transmits the live video stream containing the synthesized location information to the audience client.

S17. The audience client obtains the synthesized location information, and performs virtual gift synthesis and display.

The audience client decodes the synthesized location information from the live video stream, combines the synthesized location information with the virtual gift, and plays the special effect of angel wings: the angel wings grow behind the anchor.

Scenario 2: The audience presents a three-dimensional special effects gift "pet bird" to the anchor, and the corresponding identification is ID1649, then the main process can be as follows:

S21. The audience client sends a gift-giving request to the server.

The audience user Q sends a gift-giving request to the server through the audience client, where the virtual gift is ID1649.

S22. The server performs business processing;

After the server receives the gift-giving request, it does the corresponding business processing (such as deduction, etc.).

S23. The server broadcasts gift-giving information.

Broadcast the gift-giving message that the viewer user Q presents ID1649 gifts to the anchor to all users in the channel, including the anchor client and the audience client.

S24. After receiving the gift-giving information, the host client queries the virtual gift to identify the synthesized location information.

After receiving the broadcast of the gift information, the host client queries the gift configuration according to the virtual gift ID 1649 and obtains that the virtual gift is a three-dimensional special effect gift (such as an AI (Artificial Intelligence) gift). The synthetic location information that needs to be recognized includes the face and the outline of the human body. Then the host client starts to perform face recognition and human contour recognition.

S25. The host client packs the synthesized location information into the live video stream for transmission.

The host client packs the synthesized location information (which can be AI information) obtained by face recognition and human contour recognition into a live video stream, and transmits the live video together with the live video to the server through the live video stream.

S26. The server forwards the live video stream.

The server transmits the live video stream containing the synthesized location information to the audience client.

S27. The audience client obtains the synthesized location information, and performs virtual gift synthesis and display.

The viewer client decodes the synthesized location information from the live video stream, combines the synthesized location information with the virtual gift, and plays the special effect of "pet bird": the bird flies over the shoulder of the anchor from the area outside the video.

The above examples are only used to assist in explaining the technical solutions of the present application, and the illustrated content and specific processes involved therein do not constitute a limitation on the use scenarios of the technical solutions of the present application.

The following describes in detail related embodiments of the device for processing virtual gift special effects.

FIG. 12 is a schematic structural diagram of an apparatus for processing virtual gift special effects provided by an embodiment. As shown in FIG. 12, the apparatus 100 for processing virtual gift special effects may include: a feature acquisition module 110, an information determination module 120, and an information sending module 130.

Wherein, the feature obtaining module 110 is configured to receive a gift instruction of a virtual gift, obtain a corresponding target special effect gift according to the gift instruction, and determine a characteristic area of the target special effect gift;

The information determining module 120 is configured to determine the synthesized location information of the target special effect gift on the live video according to the characteristic area;

The information sending module 130 is configured to send the live video and the synthesized location information to the audience client, so that the audience client adds the target special effect gift to the live video for synthesis according to the synthesized location information And show it.

The device for processing virtual gift special effects provided in this embodiment is applied to a host client, and the feature acquisition module 110 receives a virtual gift giving instruction sent by the viewer client, obtains the corresponding target special effect gift according to the gift instruction, and determines the target special effect gift. Feature area; the information determining module 120 determines the composite location information of the target special effect gift on the live video according to the feature area; the information sending module 130 sends the live video and the composite location information to the client, so that the audience client can perform the target special effect according to the composite location information The gift is added to the live video for synthesis and display. In this solution, the synthesized location information is sent to the audience client along with the live video. Compared with the host client directly synthesizes the target special effect gift into the live video, and then sends it to each viewer client to play the virtual gift special effect in the video area of the viewer client, this embodiment uses the host client to synthesize location information outside the live video Encoding and encapsulation makes the synthesized location information independent of the live video, and is transmitted with the live video, so that the audience client can edit the effect of the virtual special effect gift according to the synthesized location information combined with the audience client, which is beneficial to the audience client Realize layered special effect processing and special effect display across the live video playback area to improve the effect of special effect display.

In an embodiment, the feature acquisition module 110 includes: an identification acquisition unit and a feature determination unit;

Wherein, the identification acquisition unit is used to acquire the target special effect gift identification; the feature determination unit is used to search for the target special effect gift according to the target special effect gift identification, and determine the characteristic area corresponding to the target special effect gift.

In an embodiment, the information determination module 120 includes: a frame image acquisition unit, a key point extraction unit, and a target position determination unit;

Among them, the frame image acquisition unit is used to obtain the current video frame image of the live video; the key point extraction unit is used to extract the key points of the outline of the person in the current video frame image; the target position determining unit is used to obtain the current video frame image of the live video; The key points of the outline of the person determine the target position corresponding to the characteristic area on the current video frame image, so as to synthesize the target special effect gift at the target position.

In an embodiment, the information sending module 120 is configured to encode and encapsulate the live video and the synthesized location information into live video stream data, and forward the live video stream data to the viewer client through the server.

In one embodiment, the target special effect gift is a special effect gift in the form of a three-dimensional display.

In an embodiment, the synthesized position information includes at least one of face information, human contour information, gesture information, and human bone information.

FIG. 13 is another schematic structural diagram of a device for processing virtual gift special effects provided by an embodiment. The device for processing virtual gift special effects in this embodiment is applied to a server, such as a server. As shown in FIG. 13, the processing device for virtual gift special effects The device 400 includes: an instruction sending module 410, a data receiving module 420, and a data forwarding module 430.

Wherein, the instruction sending module 410 is configured to send a virtual gift giving instruction to the host client; wherein, the host client obtains the corresponding target special effect gift according to the donation instruction and determines the characteristic area of the target special effect gift, according to Determining, by the characteristic area, synthetic location information of the target special effect gift on the live video;

The data receiving module 420 is configured to receive live video stream data sent by the host client; wherein the live video stream data includes the combined location information of the live video and the target special effect gift;

The data forwarding module 430 is configured to forward the live video stream data to the audience client; wherein the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesis location information .

The device for processing virtual gift special effects provided above can be used to execute the method for processing virtual gift special effects provided by any of the foregoing embodiments, and has corresponding functions and beneficial effects.

An embodiment of the present application also provides a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor. When the processor executes the program, the implementation is as in any of the above embodiments. The processing method of virtual gift special effects.

Optionally, the computer device may be a mobile terminal, a tablet computer, a computer computer, or a server. When the computer device provided above executes the method for processing virtual gift special effects provided by any of the above embodiments, it has corresponding functions and beneficial effects.

An embodiment of the present application also provides a storage medium containing computer-executable instructions, when the computer-executable instructions are executed by a computer processor, a method for processing a virtual gift special effect, including:

Receiving a gifting instruction of a virtual gift, obtaining a corresponding target special effect gift according to the gifting instruction, and determining a characteristic area of the target special effect gift;

Determining, according to the characteristic area, synthetic location information of the target special effect gift on the live video;

The live video and the synthesized location information are sent to the audience client, so that the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesized location information.

Alternatively, the computer-executable instructions are used to execute a virtual gift special effect processing method when executed by a computer processor, including:

Send a virtual gift giving instruction to the host client; wherein, the host client obtains the corresponding target special effect gift according to the gift instruction and determines the characteristic area of the target special effect gift, and determines the target special effect gift according to the characteristic area Synthesized location information on the live video;

Receiving live video stream data sent by the host client; wherein the live video stream data includes the combined location information of the live video and the target special effect gift;

The live video stream data is forwarded to a viewer client; wherein, the viewer client adds the target special effect gift to the live video according to the combined location information to synthesize and display.

Of course, the storage medium containing computer-executable instructions provided by the embodiments of the present application is not limited to the above-mentioned virtual gift special effects processing method operations, and can also execute the operations provided by any embodiment of the present application. Related operations in the processing method of virtual gift special effects, and have corresponding functions and beneficial effects.

Claims (13)

1. A method for processing virtual gift special effects, including the following steps:

   Receiving a gifting instruction of a virtual gift, obtaining a corresponding target special effect gift according to the gifting instruction, and determining a characteristic area of the target special effect gift;

   Determining, according to the characteristic area, synthetic location information of the target special effect gift on the live video;

   The live video and the synthesized location information are sent to the audience client, so that the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesized location information.
2. The method for processing virtual gift special effects according to claim 1, wherein the step of obtaining the corresponding target special effect gift according to the gift instruction and determining the characteristic area of the target special effect gift comprises:

   Obtain the target special effect gift ID;

   The target special effect gift is searched and obtained according to the target special effect gift identifier, and the characteristic area corresponding to the target special effect gift is determined.
3. The method for processing virtual gift special effects according to claim 1, wherein the step of determining the synthetic location information of the target special effect gift on the live video according to the characteristic area comprises:

   Acquiring the current video frame image of the live video;

   Extracting key points of the outline of the person in the current video frame image;

   The target position corresponding to the characteristic area on the current video frame image is determined according to the key points of the person contour, so as to synthesize the target special effect gift at the target position.
4. The method for processing virtual gift special effects according to claim 1, wherein the step of sending the live video and the synthesized location information to the audience client includes:

   The live video and the synthesized location information are encoded and packaged into live video stream data, and the live video stream data is forwarded to the viewer client through a server.
5. According to the method for processing virtual gift special effects according to any one of claims 1 to 4, the target special effect gift is a special effect gift in a three-dimensional display form.
6. The method for processing virtual gift special effects according to any one of claims 1 to 4, wherein the synthesized position information includes at least one of face information, human contour information, gesture information, and human bone information.
7. A method for processing virtual gift special effects, including the following steps:

   Send a virtual gift giving instruction to the host client; wherein, the host client obtains the corresponding target special effect gift according to the gift instruction and determines the characteristic area of the target special effect gift, and determines the target special effect gift according to the characteristic area Synthesized location information on the live video;

   Receiving live video stream data sent by the host client; wherein the live video stream data includes the combined location information of the live video and the target special effect gift;

   The live video stream data is forwarded to a viewer client; wherein, the viewer client adds the target special effect gift to the live video according to the combined location information to synthesize and display.
8. 8. The method for processing virtual gift special effects according to claim 7, wherein the step of adding the target special effect gift to the live video according to the synthetic location information to synthesize and display it comprises:

   Acquiring the current video frame image of the live video;

   Adding the target special effect gift to the current video frame image according to the combined position information to obtain a special effect frame image;

   The special effect frame image is rendered to the special effect display area for display.
9. A device for processing virtual gift special effects, including:

   The feature acquisition module is configured to receive a virtual gift giving instruction, obtain a corresponding target special effect gift according to the gift instruction, and determine the characteristic area of the target special effect gift;

   An information determining module, configured to determine the combined location information of the target special effect gift on the live video according to the characteristic area;

   The information sending module is configured to send the live video and the synthesized location information to the audience client, so that the audience client adds the target special effect gift to the live video for synthesis and synthesis according to the synthesized location information To show.
10. A device for processing virtual gift special effects, including:

    The instruction sending module is used to send a virtual gift giving instruction to the host client; wherein, the host client obtains the corresponding target special effect gift according to the gift instruction and determines the characteristic area of the target special effect gift, according to the characteristic The area determines the synthesized location information of the target special effect gift on the live video;

    The data receiving module is configured to receive live video stream data sent by the host client; wherein, the live video stream data includes the combined location information of the live video and the target special effect gift;

    The data forwarding module is configured to forward the live video stream data to an audience client; wherein, the audience client adds the target special effect gift to the live video for synthesis and display according to the synthesis location information.
11. A live broadcast system includes an anchor client, an audience client, and a server. The anchor client communicates with the audience client via the server through a network;

    The server is configured to receive a virtual gift giving instruction sent by the viewer client, and send the gift instruction to the anchor client;

    The anchor client is configured to receive the gift instruction and obtain a target special effect gift identifier; find the target special effect gift according to the target special effect gift identifier, and determine the characteristic area corresponding to the target special effect gift; according to the characteristic area Determine the combined location information of the target special effect gift on the live video; encode the combined location information and the live video into live video stream data and send it to the server;

    The server is also used to forward the live video stream data to the viewer client;

    The audience client is configured to receive live video stream data and target special effect gifts, and obtain the combined location information of the live video and the target special effect gifts from the live video stream data; combine the target with the combined location information The special effect gift is added to the live video for synthesis and display.
12. A computer device, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor implements the virtual gift according to any one of claims 1-8 when the processor executes the program Steps of special effects processing methods.
13. A storage medium containing computer-executable instructions, when the computer-executable instructions are executed by a computer processor, are used to execute the steps of the method for processing virtual gift special effects according to any one of claims 1-8.

Images