WO2022017201A1

WO2022017201A1 - Livestream motion sensing project interaction method and apparatus

Info

Publication number: WO2022017201A1
Application number: PCT/CN2021/105588
Authority: WO
Inventors: 张晓波
Original assignee: 北京达佳互联信息技术有限公司
Priority date: 2020-07-24
Filing date: 2021-07-09
Publication date: 2022-01-27
Also published as: CN111866535A; CN111866535B

Abstract

A livestream motion sensing project interaction method and apparatus. The method comprises: determining, according to an acquired user image of a current user, motion sensing information corresponding to a motion sensing action in a user image; obtaining an interaction result of a processing performed on the basis of the motion sensing information of the current user and motion sensing information of at least one associated user, wherein the associated user is a user matched with the current user; displaying the interaction result on a livestream interface of the image of the current user, such that the user can play a motion sensing project in a livestream room, thus enriching the user interaction form, and the interaction between multiple users can be achieved, thus enriching user interaction scenes in the livestream room.

Description

A kind of interactive method and device for live broadcast somatosensory project

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure claims priority to Chinese Patent Application No. "202010725851.8" filed on Jul. 24, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of computer technologies, and in particular, to a method and device for interacting with live broadcast motion sensing items.

Background technique

With the development of live broadcast technology, live broadcast through various live broadcast applications or watching other people's live broadcast has become one of the ways for people to enjoy leisure and entertainment. In the process of live broadcast, how to enhance the interactivity of live broadcast and let users have a better experience has become one of the important research directions.

SUMMARY OF THE INVENTION

Embodiments of the present disclosure provide a method and device for interacting with live somatosensory items. The technical solutions of the present disclosure are as follows:

According to some embodiments of the present disclosure, a method for interacting with a live broadcast somatosensory item is provided, and the method is applied to a client, including:

According to the collected user screen of the current user, determine the somatosensory information corresponding to the somatosensory action in the user screen;

acquiring an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein the associated user is a user matched with the current user;

The interactive result is displayed in combination with the live interface to which the current user screen belongs.

In a possible implementation manner, acquiring an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user includes: acquiring the somatosensory information based on the current user and the somatosensory information of at least one associated user. The scoring result determined after the somatosensory information is scored for the somatosensory action is used as the interaction result.

In a possible implementation manner, a scoring result determined after somatosensory action scoring is performed based on the somatosensory information of the current user and the somatosensory information of at least one associated user is obtained, and the interaction result includes: The information is compared with at least one preset somatosensory information to determine the target preset somatosensory information that matches the somatosensory information of the current user; the score corresponding to the target preset somatosensory information is used as the scoring result of the current user; The rating result of the associated user sent by the associated user; the rating result of the current user and the rating result of at least one associated user are used as the interaction result.

In a possible implementation manner, acquiring the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user includes: acquiring the somatosensory information based on the current user and the somatosensory information of at least one associated user The somatosensory action image obtained after processing is used as the interaction result.

In a possible implementation manner, acquiring the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user includes: linking game information between the respective clients of the current user and the associated user Bridge, which transmits user somatosensory information and/or interaction results.

In a possible implementation manner, the method further includes: performing interactive processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain an interactive result.

In a possible implementation manner, the processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain the interaction result includes: the somatosensory information of the current user and the transmitted somatosensory information of the associated user. The somatosensory information is processed to determine the item information of the current user and the associated user, wherein the item information includes a scoring result and a somatosensory action image; the item information of the current user and the associated user is taken together as an interaction result.

In a possible implementation manner, the method further includes: reporting the somatosensory information to a server; correspondingly, acquiring an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user The method includes: acquiring an interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.

In a possible implementation manner, the method further includes: in response to the operation of the current user opening the live room and selecting the somatosensory item duel, sending an opponent matching request to the server; receiving at least one matching feedback from the server that matches the current user Associate users, and interaction start instructions.

In a possible implementation manner, according to the collected user screen of the current user, determining the somatosensory information corresponding to the somatosensory action in the user screen includes: in response to an interaction start instruction sent by the server, collecting data including the somatosensory action of the user. User screen; input the user screen into the somatosensory information acquisition model, and obtain the somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model.

In a possible implementation manner, the somatosensory information includes at least one piece of motion information among the user's head motion, facial motion, and limb motion.

According to some embodiments of the present disclosure, there is provided an interactive device for live broadcast somatosensory items, the device comprising:

a somatosensory information determining module, configured to determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user;

an interaction result acquisition module configured to perform acquisition of an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein the associated user is a user matched with the current user;

The interactive result display module is configured to display the interactive result in combination with the live interface to which the current user screen belongs.

In a possible implementation manner, the interactive result acquisition module includes:

The first interaction result obtaining unit is configured to execute a scoring result determined after performing a somatosensory action scoring based on the somatosensory information of the current user and the somatosensory information of at least one of the associated users, as the interaction result.

In a possible implementation manner, the first interaction result obtaining unit is further configured to execute:

Compare the somatosensory information of the current user with at least one preset somatosensory information, and determine the target preset somatosensory information that matches the somatosensory information of the current user;

Taking the score corresponding to the preset somatosensory information of the target as the scoring result of the current user;

receiving the scoring result of the associated user sent by at least one of the associated users;

The rating result of the current user and the rating result of at least one of the associated users are used as the interaction result.

In a possible implementation, the interactive result acquisition module is also configured to execute:

A somatosensory action image obtained by processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user is acquired as the interaction result.

The user somatosensory information and/or the interaction result is transmitted through the game information link bridge between the respective clients of the current user and the associated user.

In a possible implementation manner, the interactive result acquisition module further includes:

The second interaction result obtaining unit is configured to perform interaction processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user, so as to obtain an interaction result.

In a possible implementation manner, the second interaction result obtaining unit is further configured to execute:

Process the somatosensory information of the current user and the transmitted somatosensory information of the associated user, and determine the item information of the current user and the associated user, wherein the item information includes a scoring result and a somatosensory action image;

The item information of the current user and the associated user is taken together as an interaction result.

In a possible implementation manner, the interactive device for live broadcast of somatosensory items further includes:

an information reporting module, configured to perform reporting of the somatosensory information to the server;

Correspondingly, the interactive result acquisition module is configured to execute:

Obtain an interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.

The request sending module is configured to perform the operation of opening the live room and selecting the somatosensory item duel in response to the current user, and send an opponent matching request to the server;

The instruction receiving module is configured to receive at least one associated user that is fed back by the server and matched with the current user, and an interaction start instruction.

In a possible implementation manner, the somatosensory information determination module includes:

a user image acquisition unit, configured to execute an interaction start instruction sent by the server to collect user images including user somatosensory actions;

The somatosensory information acquisition unit is configured to execute inputting the user screen into a somatosensory information acquisition model, and acquire somatosensory information corresponding to the user's somatosensory action output from the somatosensory information acquisition model.

According to some embodiments of the present disclosure, there is provided an electronic device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to achieve the following Step: determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user;

In a possible implementation manner, the processor is configured to further implement the following step when executing the instruction: after obtaining a somatosensory action score based on the somatosensory information of the current user and the somatosensory information of at least one associated user The determined scoring result is used as the interaction result.

In a possible implementation manner, the processor is configured to further implement the following steps when executing the instruction: compare the somatosensory information of the current user with at least one preset somatosensory information, and determine the somatosensory information of the current user The matching target preset somatosensory information; take the score corresponding to the target preset somatosensory information as the scoring result of the current user; receive the scoring result of the associated user sent by at least one of the associated users; The rating result, and the rating result of at least one of the associated users are used as the interaction result.

In a possible implementation manner, the processor is configured to further implement the following step when executing the instruction: acquiring a somatosensory action obtained after processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user image, as a result of said interaction.

In a possible implementation manner, the processor is configured to further implement the following steps when executing the instructions: through the game information link bridge between the respective clients of the current user and the associated user, perform user somatosensory information and /or the transmission of interactive results.

In a possible implementation manner, the processor is configured to further implement the following step when executing the instruction: perform interactive processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain Interactive results.

In a possible implementation manner, the processor is configured to further implement the following steps when executing the instruction: process the somatosensory information of the current user and the transmitted somatosensory information of the associated user, determine the current user and all and the item information of the associated user, wherein the item information includes a scoring result and a somatosensory action image; the item information of the current user and the associated user is taken together as an interaction result.

In a possible implementation manner, the processor is configured to further implement the following steps when executing the instruction: reporting the somatosensory information to a server; correspondingly, acquiring somatosensory information based on the current user and at least An interaction result processed by the somatosensory information of an associated user includes: acquiring an interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.

In a possible implementation manner, the processor is configured to further implement the following steps when executing the instruction: in response to the current user's operation of opening the live broadcast room and selecting a somatosensory item duel, sending an opponent matching request to the server; at least one associated user that matches the current user fed back by the server, and an interaction start instruction.

In a possible implementation manner, the processor is configured to further implement the following steps when executing the instruction: in response to the interaction start instruction sent by the server, collect a user picture including the user's somatosensory action; input the user picture into Go to the somatosensory information acquisition model, and acquire the somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model.

According to some embodiments of the present disclosure, a computer-readable storage medium is provided. When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device can perform the following steps: according to the collected user of the current user a screen, to determine the somatosensory information corresponding to the somatosensory action in the user screen;

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can further perform the following steps: acquiring the somatosensory information based on the current user and at least one of the associations The scoring result determined after the somatosensory action is scored on the user's somatosensory information is used as the interaction result.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can further perform the following step: compare the current user's somatosensory information with at least one preset somatosensory information Yes, determine the target preset somatosensory information that matches the somatosensory information of the current user; use the score corresponding to the target preset somatosensory information as the scoring result of the current user; Scoring result; use the current user's scoring result and at least one associated user's scoring result as the interaction result.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can further perform the following steps: acquiring the somatosensory information based on the current user and the information of at least one associated user. The somatosensory action image obtained after the somatosensory information is processed is used as the interaction result.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is enabled to further perform the following steps: through the game between the current user and the associated user's respective clients An information link bridge, which transmits user somatosensory information and/or interaction results.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can further perform the following steps: based on the somatosensory information of the current user and the transmitted associated user The somatosensory information is interactively processed to obtain interactive results.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can further perform the following steps: the somatosensory information of the current user and the transmitted somatosensory information of the associated user The information is processed to determine the item information of the current user and the associated user, wherein the item information includes a scoring result and a somatosensory action image; the item information of the current user and the associated user is taken together as an interaction result.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can further perform the following steps: reporting the somatosensory information to the server; correspondingly, obtaining the information based on The interaction result processed by the somatosensory information of the current user and the somatosensory information of at least one associated user includes: acquiring the interactive result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can further perform the following steps: in response to the current user's operation of opening the live room and selecting a somatosensory item duel, Send an opponent matching request to the server; receive at least one associated user matched with the current user fed back by the server, and an interaction start instruction.

In a possible implementation manner, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further able to perform the following steps: in response to the interaction start instruction sent by the server, collect data including the user's somatosensory action. User screen; input the user screen into the somatosensory information acquisition model, and obtain the somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model.

According to some embodiments of the present disclosure, there is provided a computer program product for use in conjunction with an electronic device, the computer program product comprising a computer-readable storage medium and a computer program mechanism embedded therein, the program being loaded via a computer And after the execution, the following steps can be performed: according to the collected user screen of the current user, determine the somatosensory information corresponding to the somatosensory action in the user screen;

In a possible implementation manner, after the computer program is loaded and executed on a computer, the following steps can be performed: obtaining a somatosensory action score based on the somatosensory information of the current user and the somatosensory information of at least one associated user, and then determining , as the interactive result.

In a possible implementation manner, after the computer program is loaded and executed by a computer, the following steps can be performed: comparing the somatosensory information of the current user with at least one preset somatosensory information, and determining that it matches the somatosensory information of the current user target preset somatosensory information; take the score corresponding to the target preset somatosensory information as the scoring result of the current user; receive the scoring result of the associated user sent by at least one of the associated users; A result, and a rating result of at least one of the associated users are used as the interaction result.

In a possible implementation manner, the computer program can perform the following steps after being loaded and executed by a computer: acquiring a somatosensory action image obtained by processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user , as a result of the interaction.

In a possible implementation manner, after the computer program is loaded and executed by a computer, the following steps can be performed: through the game information link bridge between the respective clients of the current user and the associated user, perform user somatosensory information and/or or transmission of interactive results.

In a possible implementation manner, after the computer program is loaded and executed by a computer, the following steps can be performed: perform interactive processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user, so as to obtain interactive result.

In a possible implementation manner, after the computer program is loaded and executed on a computer, the following steps can be performed: process the somatosensory information of the current user and the transmitted somatosensory information of the associated user, determine the current user and the somatosensory information of the associated user. The item information of the associated user, wherein the item information includes the scoring result and the somatosensory action image; the item information of the current user and the associated user is taken together as the interaction result.

In a possible implementation manner, the computer program can perform the following steps after being loaded and executed by a computer: reporting the somatosensory information to a server; correspondingly, acquiring somatosensory information based on the current user and at least one The interaction result processed by the somatosensory information of the associated user includes: acquiring the interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.

In a possible implementation manner, the computer program can perform the following steps after being loaded and executed by the computer: in response to the current user's operation of opening the live room and selecting a somatosensory item duel, sending an opponent matching request to the server; receiving the The server feeds back at least one associated user that matches the current user, and an interaction start instruction.

In a possible implementation manner, after the computer program is loaded and executed on a computer, the following steps can be performed: in response to an interaction start instruction sent by the server, collecting a user image including the user's somatosensory actions; inputting the user image into the A somatosensory information acquisition model, which acquires somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model.

The embodiment of the present disclosure enriches the interactive form between the anchor and the audience by performing a somatosensory game in the live broadcast room, and can realize the interaction between multiple anchors, enhance the interactivity of the live broadcast, and enrich the scene of the interaction between the live broadcasters.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated into and constitute a part of this specification, illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the principles of the present disclosure and do not unduly limit the present disclosure.

Fig. 1 is a flow chart of a method for interacting with a live broadcast somatosensory item according to an exemplary embodiment.

Fig. 2a is a flow chart of a method for interacting with a live somatosensory item according to an exemplary embodiment.

Fig. 2b is a schematic diagram showing the interaction of a live somatosensory item according to an exemplary embodiment.

Fig. 3a is a flow chart of a method for interacting with a live broadcast somatosensory item according to an exemplary embodiment.

Fig. 3b is a schematic diagram showing interactive result transmission through a game information connection bridge according to an exemplary embodiment.

Fig. 4a is a flow chart of a method for interacting with a live somatosensory item according to an exemplary embodiment.

Fig. 4b is a schematic diagram showing opponent matching of a live somatosensory project according to an exemplary embodiment.

Fig. 5 is a block diagram of an interactive device for a live somatosensory item according to an exemplary embodiment.

FIG. 6 is a schematic structural diagram of an electronic device according to an exemplary embodiment.

detailed description

In order to make those skilled in the art better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first", "second" and the like in the description and claims of the present disclosure and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances so that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims. It should be noted that, all the embodiments of the present disclosure may be executed independently or in combination with other embodiments, which are not limited in the present disclosure.

When using magic expressions in the existing live broadcast rooms, they usually superimpose some accessories or cartoon characters on the user's head. Although this increases the richness and interest of the anchor's content, it is still limited to the richness of visual effects and does not enhance The live broadcast is interactive, and there is no interaction between multiple users, and the embodiments of the present disclosure may be applicable to the case of interacting in the form of live broadcast somatosensory items in the live broadcast room. The embodiment of the present disclosure determines the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user, and then obtains the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein , the associated user is the user who matches the current user, and finally the interaction results are displayed in the live broadcast interface to which the current user screen belongs, which enriches the interaction between users, and can realize the interaction between multiple users, which enriches the user interaction in the live broadcast room. scene.

Fig. 1 is a flow chart of a method for interacting with live somatosensory items according to an exemplary embodiment. As shown in Fig. 1 , the method for interacting with live somatosensory items is used in an electronic device and executed by a processor configured in the electronic device , the method includes the following steps.

S11: Determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user.

The user picture is a picture collected by the client that contains the user's somatosensory actions, and is used to obtain the user's somatosensory information. For example, the user picture may be the picture collected by the client's camera when the user blinks or shakes his head; the somatosensory information is obtained from the user's head Information that can characterize the current user's somatosensory action extracted from the somatosensory movement of the body, face, or limbs, for example, the somatosensory information includes shaking head movement, the amplitude of shaking the head, and the frequency of shaking the head and other information that can characterize the user's current somatosensory movement.

In the embodiment of the present disclosure, the client collects the user picture of the current user through the camera, then identifies the user picture, extracts the features of the somatosensory action in the user picture, and constitutes the user's somatosensory information by at least one somatosensory action feature. For example, the front camera of the client collects the current user's user screen in real time, performs image recognition on the user screen, and obtains the current user's body movement as a blink. Information such as "twice per second" is encapsulated as somatosensory information corresponding to somatosensory actions on the user screen.

In one implementation of the embodiment of the present disclosure, the somatosensory information includes at least one piece of motion information among the user's head motion, facial motion, and limb motion.

In the above possible embodiments, the somatosensory information includes at least one motion information of the user's head movement, facial movement, and limb movement. For example, the somatosensory information may be shaking his head left and right or nodding, and the amplitude and frequency of shaking his head or nodding, and also It can be facial movements such as the user's mouth opening and blinking, and motion features such as eye blinking frequency, or the user's action of raising an arm and the characteristics of the action, such as the magnitude of the raised arm and the angle between the arm and the body.

S12: Acquire an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, where the associated user is a user matched with the current user.

The interaction result is the result obtained by separately processing the current user and the somatosensory information corresponding to at least one associated user, and performing an interactive operation on the processing result, and the interactive operation may be comparing and calculating the processing results corresponding to each user. Or simply superimposed, for example, a somatosensory action score may be performed with respect to the somatosensory information of each user, and the set of scoring results of each user may be used as the interaction result.

In the embodiment of the present disclosure, in order to increase the interaction scene between users, the client obtains the interaction result between the current user and at least one associated user. The interactive result may be obtained by the client performing interactive processing on the somatosensory information of the current user and at least one associated user, or may be obtained by processing the somatosensory information of the current user and receiving the result of processing the respective somatosensory information by at least one associated user , and finally the processing results of each user's somatosensory information are used as the interactive result. Of course, the current user and each associated user can also report their somatosensory information to the server, and finally obtain the somatosensory information based on the current user and at least one association from the server. The user's somatosensory information is processed to obtain an interactive result.

In a specific implementation of the embodiment of the present disclosure, the client, according to the somatosensory information of the current user, according to the set project rules, scores the somatosensory actions of the current user, and obtains a corresponding scoring result, for example, 85 points, and simultaneously receives and The rating result sent by the associated user matched by the current user is 80 points. In the end, the somatosensory action rating of each user can be used as the interactive result. Here, the interaction method can be to compare the ratings of each user, and the user with the highest rating will win the project. By.

S13, combine the interaction result in the live broadcast interface to which the current user screen belongs to be displayed.

In the embodiment of the present disclosure, after obtaining the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, the interactive result is displayed on the live interface to which the current user's user screen belongs. For example, if the interaction result is the item ratings of the current user and at least one associated user, the item ratings of the current user and associated users are displayed on the current user screen at the same time. The word "Winner" is displayed for the location.

According to the technical solutions of the embodiments of the present disclosure, the electronic device can determine the somatosensory information corresponding to the somatosensory action in the user screen, obtain the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, and finally combine the interaction results It is displayed in the live interface to which the current user screen belongs, so as to realize the interaction in the form of somatosensory items in the live broadcast room. Therefore, the present disclosure enriches the interaction form between users, realizes the interaction between multiple users, and enriches the live broadcast room. User interaction scenarios.

Fig. 2a is a flowchart illustrating a method for interacting with a live somatosensory item according to an exemplary embodiment. The embodiment of the present disclosure is a refinement of the above technical solution. The technical solution in the embodiment of the present disclosure may be combined with one or more of the above-mentioned technical solutions. The various alternatives in the embodiments are combined. As shown in Fig. 2a, the interactive method of the live somatosensory item includes the following steps.

S21 , according to the collected user screen of the current user, determine somatosensory information corresponding to the somatosensory action in the user screen.

S22: Acquire a scoring result determined by scoring a somatosensory action based on the somatosensory information of the current user and the somatosensory information of at least one associated user, as an interaction result.

In the embodiment of the present disclosure, a method for obtaining an interaction result is provided, respectively obtaining a scoring result determined after performing a somatosensory action score based on the somatosensory information of the current user, and a score determined after performing a somatosensory action scoring based on the somatosensory information of at least one associated user. As a result, the rating results of each user are collectively used as the interactive result. Obtain the scoring result based on the somatosensory information of each user, which can be for the somatosensory information of the current user, according to the scoring rules of the live broadcast somatosensory item, to score the somatosensory actions of the current user, obtain the scoring result of the current user, and then receive at least one associated user. The respective scoring results of the current user and at least one associated user are finally used as the interactive result; of course, to obtain the scoring results based on the somatosensory information of each user, it is also possible to obtain the somatosensory information of the current user while receiving at least one The somatosensory information sent by the associated user that matches each associated user, and then according to the scoring rules of the live somatosensory item, the somatosensory actions of each user are scored, and finally the set of obtained scoring results of each user is used as the interactive result.

In a specific implementation of the embodiment of the present disclosure, the specific operation mode of the live broadcast somatosensory item is to control the beating of the cartoon characters displayed on the screen by blinking. , specifically, for every blink, the cartoon character jumps forward once, and gets 1 point. In response to the client's acquisition of the current user's somatosensory information, blinking at a frequency of 2 times per second, the user's somatosensory actions are scored according to the number of blinks of the user's eyes. 15 seconds after the project starts, the current user's score is 30 points. , and the client will receive the real-time scoring result sent by the associated user. 15 seconds after the project starts, if the scoring result sent by the associated user is 25 points, the current user and associated user's rating at that moment will be used as the interactive result.

In an implementation of the embodiment of the present disclosure, obtaining a scoring result determined after performing somatosensory action scoring based on the somatosensory information of the current user and the somatosensory information of at least one associated user, as the interaction result includes:

In the above-mentioned optional embodiment, there is provided a scoring result determined after obtaining a somatosensory action score based on the somatosensory information of the current user and the somatosensory information of at least one associated user. Comparing with multiple preset somatosensory information, in response to the current user somatosensory information matching a certain preset somatosensory information, the preset somatosensory information is used as the target preset somatosensory information, and then according to the correspondence between the preset somatosensory information and the score relationship, determine the score corresponding to the target preset somatosensory information, and finally use the corresponding score of the target preset somatosensory information as the scoring result of the current user, and at the same time, receive the scoring result of the associated user sent by at least one associated user, wherein each associated user The scoring result is obtained by processing the somatosensory information of each associated user at the corresponding client of each associated user and sent to the current client, and finally the scoring result of the current user and at least one associated user is used as the interactive result.

For example, the specific operation method of the live somatosensory project is to swing the head left and right following the marked position displayed on the client screen, and take pictures at random moments, and score according to the matching degree between the user's head position and the marked position at the time of taking the photo, the higher the matching degree , the higher the score of the user's somatosensory action, the corresponding relationship between each preset somatosensory information (corresponding to multiple preset positions) and the score is preset in the live somatosensory project, and the obtained somatosensory information of the current user includes the user's head position information and mark location information, compare the user somatosensory information with multiple preset somatosensory information, take the preset somatosensory information that matches the current user somatosensory information as the target preset somatosensory information, and use the score corresponding to the target preset somatosensory information as the target preset somatosensory information. The current user's rating results.

In another specific example of the embodiment of the present disclosure, after the somatosensory information corresponding to the somatosensory action in the user screen is determined, the somatosensory action obtained after processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user may also be obtained image, as a result of interaction.

The somatosensory action image is an image obtained based on the user's somatosensory information and includes the user's somatosensory action and other information related to the somatosensory information. For example, the somatosensory action image may include the current user's somatosensory action, and superimpose a magic expression on the user's somatosensory action. obtained image.

In this embodiment of the present disclosure, the current client can process the acquired somatosensory information of the current user to obtain a somatosensory action image, and process the received somatosensory action sent by at least one associated user to obtain a somatosensory action image that matches the associated user , and finally use the somatosensory action image of the current user and at least one associated user as the interaction result; the current client can also process only the somatosensory action of the current user to obtain the somatosensory action image, and then receive the somatosensory action image sent by at least one associated user, and The somatosensory motion image of the current user and at least one associated user is used as the interaction result.

S23, combine the interaction result in the live broadcast interface to which the current user screen belongs to be displayed.

The technical solution of the embodiment of the present disclosure is to determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user, and obtain the somatosensory action score based on the somatosensory information of the current user and the somatosensory information of at least one associated user. The rating results determined later are used as the interactive results, and the interactive results are finally displayed in the live broadcast interface to which the current user screen belongs. You can interact in the form of somatosensory items in the live broadcast room, and finally display the scores of multiple users, enriching the users of the live broadcast room. interactive scene.

Fig. 3a is a flowchart illustrating a method for interacting with a live somatosensory item according to an exemplary embodiment. The embodiment of the present disclosure is a refinement of the above technical solution. The technical solution in the embodiment of the present disclosure may be combined with one or more of the above-mentioned technical solutions. The various alternatives in the embodiments are combined. As shown in Fig. 3a, the interactive method for live broadcast somatosensory items includes the following steps.

S31: Determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user.

S32 , transmit the user somatosensory information and/or the interaction result through the game information link bridge between the current user and the associated user's respective clients.

Among them, the Game Information Bridge (GIB) technology is a data exchange service technology based on the extension of the UDP protocol. Packet, and according to the type of data broadcast, will do corresponding processing, such as anti-packet loss type data, the receiver will send the corresponding response data packet (Acknowledge character, ACK), in response to the sender does not receive the ACK packet, Retransmission and other behaviors will be performed. The game information link bridge service has the characteristics of reliability and low latency.

In the embodiment of the present disclosure, information is transmitted through the game information link bridge between the respective clients of the current user and the associated user, and the transmitted information may be user somatosensory information and/or interaction results. For example, the current client can send the current user's somatosensory information to at least one associated user through the game information link bridge, and at the same time receive the user somatosensory information sent by at least one associated user through the game information link bridge. The information is processed to obtain the interaction result; the current client can also directly transmit the interaction result through the game connection bridge, as shown in Figure 3b, the interaction result of the current user, such as the rating result, is sent to at least one associated user, At the same time, through the game information link bridge, the scoring result corresponding to each associated user sent by at least one associated user is received, and the scoring result of each user is finally used as the final interactive result.

S33: Perform interactive processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain an interactive result.

In the embodiment of the present disclosure, after the current client transmits the user's somatosensory information through the game information link bridge, it performs interactive processing on the somatosensory information of the current user and the somatosensory information of the associated user to obtain a final interactive result. For example, according to the user's somatosensory information of the current user and associated users, the client uses preset scoring rules for live-streaming somatosensory items to calculate the scores of the current user and associated users' somatosensory actions, and uses the scoring results of all users as the interactive results.

In an implementation manner of the embodiment of the present disclosure, processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain the interaction result includes:

In the above-mentioned optional embodiment, a specific method for processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain the interactive result is provided. First, the somatosensory information of the current user and the associated user are linked through the game information. The somatosensory information of the associated user transmitted by the bridge is processed, for example, the somatosensory action of each user is scored according to the somatosensory information, or the somatosensory action image displayed on the client terminal is controlled according to the somatosensory information, and finally the item information of the current user and the associated user is obtained, and the The user's item information is collectively used as an interaction result, wherein the item information may include scoring results and somatosensory action images.

In a possible implementation manner, after determining the somatosensory information corresponding to the somatosensory action in the user screen, the method further includes:

reporting the somatosensory information to the server;

Correspondingly, acquiring the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user includes:

In the above-mentioned optional embodiment, a specific method for obtaining an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user is also provided. The information is reported to the server, and the server processes the somatosensory information reported by the current user and the somatosensory information reported by at least one associated user to obtain interactive results and feed them back to the client corresponding to each user. For example, the server scores the somatosensory information reported by each user according to a preset scoring rule, obtains the scoring result of each user, and feeds back the scoring result of each user to each user.

S34, combine the interaction result in the live broadcast interface to which the current user screen belongs to be displayed.

According to the technical solutions of the embodiments of the present disclosure, the somatosensory information corresponding to the somatosensory actions in the user screen is determined according to the collected user screen of the current user, and through the game information link bridge between the current user and the associated user's respective clients, the user Transmission of somatosensory information and/or interaction results, after the user somatosensory information is transmitted, interactive processing is performed based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain the interactive result, and finally the interaction result is combined with the current user's screen For display in the live broadcast interface, you can interact in the form of somatosensory items in the live broadcast room, which enriches the user interaction scene in the live broadcast room.

Fig. 4a is a flowchart showing a method for interacting with a live somatosensory item according to an exemplary embodiment. The embodiment of the present disclosure is a refinement of the above technical solution. The technical solution in the embodiment of the present disclosure may be combined with one or more of the above-mentioned technical solutions. The various alternatives in the embodiments are combined. As shown in Fig. 4a, the interactive method of the live somatosensory item includes the following steps.

S41 , in response to the current user's operation of opening the live broadcast room and selecting a somatosensory item to compete, sending an opponent matching request to the server.

In the embodiment of the present disclosure, the live broadcast somatosensory item is in the form of multiple user interactions. Therefore, after the user opens the live broadcast room and selects the somatosensory item duel option, the client sends an opponent matching request to the server, wherein the opponent matching request includes the current user's ID, and identification information of the somatosensory item currently selected by the user. The server may determine the somatosensory item selected by the current user according to the somatosensory item identification information contained in the opponent matching request, then obtain all users who have selected the somatosensory item, and randomly select one or more users from all users to match the current user, and the number of selected It is related to the somatosensory item confrontation mode selected by the user. In response to the user selecting a two-person confrontation, only one user needs to be selected to match the current user, and in response to the user selecting a multi-person confrontation, multiple users are selected to be matched with the current user. Before the client receives the associated user fed back by the server, the display screen displays the word "matching" to the user, as shown in Figure 4b, this method enables the user to obtain the loading status of the current item.

S42: Receive at least one associated user fed back by the server that matches the current user, and an interaction start instruction.

In the embodiment of the present disclosure, the client terminal receives at least one associated user matched with the current user fed back by the server for the opponent matching request, and simultaneously receives the interaction start instruction fed back by the server, and starts the live broadcast of the somatosensory item in response to the instruction. For example, the client receives the ID of at least one associated user fed back by the server, determines one or more other users that compete with the current user, displays the relevant information of the associated user in the corresponding position on the screen, and starts the countdown after receiving the live somatosensory item fed back by the server. , and a countdown is displayed on the screen to prompt the user to start the live broadcast of the somatosensory project.

S43, in response to the interaction start instruction sent by the server, collect a user screen including the user's somatosensory action.

In the embodiment of the present disclosure, after the server sends the interaction start instruction, the client starts to collect the user screen of the current user, and the user screen contains the somatosensory actions of the current user, which are used to determine the interaction results between multiple users according to the somatosensory actions of the user .

S44 , input the user screen into the somatosensory information acquisition model, and acquire the somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model.

In the embodiments of the present disclosure, an implementation manner of determining the somatosensory information corresponding to the somatosensory action in the user screen according to the user screen is provided, the collected user screen is input into the somatosensory information acquisition model, and finally the somatosensory information input by the somatosensory information acquisition model is input. The information is the somatosensory information corresponding to the current user's somatosensory action. The somatosensory information acquisition model may be a model capable of recognizing the input user screen and obtaining the user's somatosensory motion characteristics. For example, when the user shakes his head, the user's somatosensory motion type can be determined as shaking his head, and the amplitude and frequency of shaking his head can be obtained.

S45: Acquire an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, where the associated user is a user matched with the current user.

S46, combine the interaction result in the live broadcast interface to which the current user screen belongs to be displayed.

According to the technical solution of the embodiment of the present disclosure, in response to the current user's operation of opening the live broadcast room and selecting a somatosensory item duel, an opponent matching request is sent to the server, and then in response to an interaction start instruction sent by the server, the user screen containing the user's somatosensory action is started to be collected, Input the user screen into the somatosensory information acquisition model, obtain the somatosensory information output by the somatosensory information acquisition model corresponding to the user's somatosensory action, and finally obtain the interactive result of processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user, and The interactive results are displayed in the live interface to which the current user's user screen belongs, and can interact in the form of somatosensory items in the live broadcast room, which enriches the user interaction scene in the live broadcast room.

Fig. 5 is a block diagram of an interactive device for a live somatosensory item according to an exemplary embodiment. Referring to FIG. 5 , the apparatus includes a somatosensory information determination module 510 , an interaction result acquisition module 520 and an interaction result display module 530 .

The somatosensory information determining module 510 is configured to determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user;

The interaction result acquisition module 520 is configured to perform acquisition of an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein the associated user is a user matched with the current user;

The interactive result display module 530 is configured to display the interactive result in combination with the live interface to which the current user screen belongs.

In one implementation of the embodiment of the present disclosure, the interaction result obtaining module 520 includes:

In an implementation of the embodiment of the present disclosure, the first interaction result obtaining unit is further configured to execute:

In one implementation of the embodiment of the present disclosure, the interaction result obtaining module 520 is further configured to execute:

In one implementation of the embodiment of the present disclosure, the interaction result obtaining module 520 further includes:

In one implementation of the embodiment of the present disclosure, the second interaction result obtaining unit is further configured to execute:

In an implementation of the embodiments of the present disclosure, the interactive device for live broadcasting of somatosensory items further includes:

Correspondingly, the interaction result obtaining module 520 is further configured to execute:

In one implementation of the embodiment of the present disclosure, the somatosensory information determination module 510 includes:

The somatosensory information acquisition unit is configured to execute inputting the user screen into a somatosensory information acquisition model, and acquire somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model.

In an implementation manner of the embodiment of the present disclosure, the somatosensory information includes at least one piece of motion information among the user's head motion, facial motion, and limb motion.

Regarding the device for interacting with live somatosensory items in the foregoing embodiments, the specific manner in which each unit performs operations has been described in detail in the embodiments of the method, and will not be described in detail here.

Fig. 6 is a schematic structural diagram of an electronic device shown according to an exemplary embodiment. As shown in Fig. 6, the electronic device includes:

processor 610,

A processor 610 is taken as an example in FIG. 6;

memory 620;

The processor 610 and the memory 620 in the device may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 6 .

As a non-transitory computer-readable storage medium, the memory 620 can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules (for example, program instructions/modules corresponding to a live somatosensory item interaction method in the embodiments of the present disclosure). Figure 5 shows the somatosensory information determination module 510, the interaction result acquisition module 520 and the interaction result display module 530). The processor 610 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the memory 620, that is, a method for interacting with a live somatosensory item of the above method embodiment, namely:

The interactive result is displayed in the live interface to which the current user screen belongs.

The memory 620 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the computer equipment, and the like. Additionally, memory 620 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 620 may optionally include memory located remotely from the processor 610, and these remote memories may be connected to the terminal device through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

In an exemplary embodiment, a storage medium including instructions, such as a memory 620 including instructions, is also provided, and the above-mentioned instructions can be executed by the processor 610 of the electronic device to complete the above-mentioned method. The storage medium may be a non-transitory computer-readable storage medium such as ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

In some embodiments, there is also provided a computer program product for use in conjunction with an electronic device, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the program being loaded via a computer And after execution, the interactive method for live broadcast somatosensory items as described in any embodiment of the present disclosure can be realized.

Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common general knowledge or techniques in the technical field not disclosed by this disclosure . The specification and examples are to be regarded, for example, only, with the true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

A method for interacting with a live somatosensory item, applied to a client, the method includes:

According to the collected user screen of the current user, determine the somatosensory information corresponding to the somatosensory action in the user screen;

acquiring an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein the associated user is a user matched with the current user;

The interactive result is displayed in combination with the live interface to which the current user screen belongs.
The method for interacting with a live broadcast somatosensory item according to claim 1, wherein the obtaining an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user comprises:

A scoring result determined after performing somatosensory action scoring based on the somatosensory information of the current user and the somatosensory information of at least one associated user is obtained as the interaction result.
The method for interacting with a live broadcast somatosensory item according to claim 2, wherein the obtaining a scoring result determined after somatosensory action scoring based on the somatosensory information of the current user and the somatosensory information of at least one of the associated users is used as the interaction Results include:

Compare the somatosensory information of the current user with at least one preset somatosensory information, and determine the target preset somatosensory information that matches the somatosensory information of the current user;

Taking the score corresponding to the preset somatosensory information of the target as the scoring result of the current user;

receiving the scoring result of the associated user sent by at least one of the associated users;

The rating result of the current user and the rating result of at least one of the associated users are used as the interaction result.
The method for interacting with a live broadcast somatosensory item according to claim 1, wherein the obtaining an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user comprises:

A somatosensory action image obtained by processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user is acquired as the interaction result.
The method for interacting with a live broadcast somatosensory item according to claim 1, wherein the acquiring an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user comprises:

The user somatosensory information and/or the interaction result is transmitted through the game information link bridge between the respective clients of the current user and the associated user.
The method for interacting with live somatosensory items according to claim 5, wherein the method further comprises:

Interactive processing is performed based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain an interactive result.
The method for interacting with a live broadcast somatosensory item according to claim 6, wherein the processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain an interaction result comprises:

Process the somatosensory information of the current user and the transmitted somatosensory information of the associated user, and determine the item information of the current user and the associated user, wherein the item information includes a scoring result and a somatosensory action image;

The item information of the current user and the associated user is taken together as an interaction result.
The method for interacting with live somatosensory items according to claim 1, wherein the method further comprises:

reporting the somatosensory information to the server;

Correspondingly, acquiring the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user includes:

Obtain an interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.
The method for interacting with live somatosensory items according to claim 1, wherein the method further comprises:

In response to the current user's operation of opening the live broadcast room and selecting the somatosensory item duel, send an opponent matching request to the server;

Receive at least one associated user that matches the current user fed back by the server, and an interaction start instruction.
The method for interacting with a live somatosensory item according to claim 1, wherein, according to the collected user screen of the current user, determining the somatosensory information corresponding to the somatosensory action in the user screen comprises:

In response to the interaction start instruction sent by the server, collect the user screen including the user's somatosensory action;

The user screen is input into the somatosensory information acquisition model, and the somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model is acquired.
The method for interacting with a live broadcast somatosensory item according to any one of claims 1-10, wherein the somatosensory information includes at least one piece of motion information among a user's head motion, facial motion, and limb motion.
An interactive device for live broadcast somatosensory projects, comprising:

a somatosensory information determining module, configured to determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user;

an interaction result acquisition module configured to perform acquisition of an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein the associated user is a user matched with the current user;

The interactive result display module is configured to display the interactive result in combination with the live interface to which the current user screen belongs.
The device for interacting with live somatosensory items according to claim 12, wherein the interaction result acquisition module comprises:

The first interaction result obtaining unit is configured to execute a scoring result determined after performing a somatosensory action scoring based on the somatosensory information of the current user and the somatosensory information of at least one of the associated users, as the interaction result.
The device for interacting with live somatosensory items according to claim 13, wherein the first interaction result obtaining unit is further configured to execute:

Compare the somatosensory information of the current user with at least one preset somatosensory information, and determine the target preset somatosensory information that matches the somatosensory information of the current user;

Taking the score corresponding to the preset somatosensory information of the target as the scoring result of the current user;

receiving the scoring result of the associated user sent by at least one of the associated users;

The rating result of the current user and the rating result of at least one of the associated users are used as the interaction result.
The device for interacting with live somatosensory items according to claim 12, wherein the interaction result acquisition module is further configured to execute:

A somatosensory action image obtained by processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user is acquired as the interaction result.
The device for interacting with live somatosensory items according to claim 12, wherein the interaction result acquisition module is further configured to execute:

The user somatosensory information and/or the interaction result is transmitted through the game information link bridge between the respective clients of the current user and the associated user.
The device for interacting with live somatosensory items according to claim 16, wherein the interaction result acquisition module further comprises:

The second interaction result obtaining unit is configured to perform interaction processing based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user, so as to obtain an interaction result.
The device for interacting with live somatosensory items according to claim 17, wherein the second interaction result obtaining unit is further configured to execute:

Process the somatosensory information of the current user and the transmitted somatosensory information of the associated user, and determine the item information of the current user and the associated user, wherein the item information includes a scoring result and a somatosensory action image;

The item information of the current user and the associated user is taken together as an interaction result.
The interactive device for live broadcast somatosensory items according to claim 12, wherein the interactive device for live broadcast somatosensory items further comprises:

an information reporting module, configured to perform reporting of the somatosensory information to the server;

Correspondingly, the interaction result obtaining module is further configured to execute:

Obtain an interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.
The interactive device for live broadcast somatosensory items according to claim 12, wherein the interactive device for live broadcast somatosensory items further comprises:

The request sending module is configured to perform the operation of opening the live room and selecting the somatosensory item duel in response to the current user, and send an opponent matching request to the server;

The instruction receiving module is configured to receive at least one associated user that is fed back by the server and matched with the current user, and an interaction start instruction.
The interactive device for live broadcast somatosensory items according to claim 12, wherein the somatosensory information determination module comprises:

a user image acquisition unit, configured to execute an interaction start instruction sent by the server to collect user images including user somatosensory actions;

The somatosensory information acquisition unit is configured to execute inputting the user screen into a somatosensory information acquisition model, and acquire somatosensory information corresponding to the user's somatosensory action output from the somatosensory information acquisition model.
The interactive device for live broadcast somatosensory items according to claims 12-21, wherein the somatosensory information includes at least one piece of motion information among the user's head motion, facial motion, and limb motion.
An electronic device comprising:

processor;

memory for storing instructions executable by the processor;

Wherein, the processor is configured to execute the command to implement the following steps: determine the somatosensory information corresponding to the somatosensory action in the user screen according to the collected user screen of the current user;

acquiring an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein the associated user is a user matched with the current user;

The interactive result is displayed in combination with the live interface to which the current user screen belongs.
The electronic device of claim 23, wherein the processor is configured to further implement the following steps when executing the instructions:

A scoring result determined after performing somatosensory action scoring based on the somatosensory information of the current user and the somatosensory information of at least one associated user is obtained as the interaction result.
24. The electronic device of claim 24, wherein the processor is configured to further implement the following steps when executing the instructions:

Compare the somatosensory information of the current user with at least one preset somatosensory information, and determine the target preset somatosensory information that matches the somatosensory information of the current user;

Taking the score corresponding to the preset somatosensory information of the target as the scoring result of the current user;

receiving the scoring result of the associated user sent by at least one of the associated users;

The rating result of the current user and the rating result of at least one of the associated users are used as the interaction result.
23. The electronic device of claim 23, wherein the processor is configured to further implement the following steps when executing the instructions:

A somatosensory action image obtained by processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user is acquired as the interaction result.
23. The electronic device of claim 23, wherein the processor is configured to further implement the following steps when executing the instructions:

The user somatosensory information and/or the interaction result is transmitted through the game information link bridge between the respective clients of the current user and the associated user.
28. The electronic device of claim 27, wherein the processor is configured to further implement the following steps when executing the instructions:

Interactive processing is performed based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain an interactive result.
28. The electronic device of claim 28, wherein the processor is configured to execute the instructions to further implement the following steps:

Process the somatosensory information of the current user and the transmitted somatosensory information of the associated user, and determine the item information of the current user and the associated user, wherein the item information includes a scoring result and a somatosensory action image;

The item information of the current user and the associated user is taken together as an interaction result.
23. The electronic device of claim 23, wherein the processor is configured to further implement the following steps when executing the instructions:

reporting the somatosensory information to the server;

Correspondingly, acquiring the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user includes:

Obtain an interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.
23. The electronic device of claim 23, wherein the processor is configured to further implement the following steps when executing the instructions:

In response to the current user's operation of opening the live broadcast room and selecting the somatosensory item duel, send an opponent matching request to the server;

Receive at least one associated user that matches the current user fed back by the server, and an interaction start instruction.
23. The electronic device of claim 23, wherein the processor is configured to further implement the following steps when executing the instructions:

In response to the interaction start instruction sent by the server, collect the user screen including the user's somatosensory action;

The user screen is input into the somatosensory information acquisition model, and the somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model is acquired.
The electronic device according to any one of claims 23-32, wherein the somatosensory information includes at least one movement information of the user's head movement, facial movement and limb movement.
A non-volatile computer-readable storage medium, when a command in the storage medium is executed by a processor of an electronic device, the electronic device can perform the following steps: according to the collected user screen of the current user, determine a Describe the somatosensory information corresponding to the somatosensory action in the user screen;

acquiring an interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user, wherein the associated user is a user matched with the current user;

The interactive result is displayed in combination with the live interface to which the current user screen belongs.
The storage medium according to claim 34, wherein when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further enabled to perform the following steps:

A scoring result determined after performing somatosensory action scoring based on the somatosensory information of the current user and the somatosensory information of at least one associated user is obtained as the interaction result.
The storage medium of claim 35, wherein when the instructions in the storage medium are executed by a processor of the electronic device, the electronic device is further enabled to perform the following steps:

Compare the somatosensory information of the current user with at least one preset somatosensory information, and determine the target preset somatosensory information that matches the somatosensory information of the current user;

Taking the score corresponding to the preset somatosensory information of the target as the scoring result of the current user;

receiving the scoring result of the associated user sent by at least one of the associated users;

The rating result of the current user and the rating result of at least one of the associated users are used as the interaction result.
The storage medium according to claim 34, wherein when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further enabled to perform the following steps:

A somatosensory action image obtained by processing based on the somatosensory information of the current user and the somatosensory information of at least one associated user is acquired as the interaction result.
The storage medium according to claim 34, wherein when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further enabled to perform the following steps:

The user somatosensory information and/or the interaction result is transmitted through the game information link bridge between the respective clients of the current user and the associated user.
The storage medium of claim 38, wherein, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further enabled to perform the following steps:

Interactive processing is performed based on the somatosensory information of the current user and the transmitted somatosensory information of the associated user to obtain an interactive result.
The storage medium according to claim 39, wherein when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further able to perform the following steps:

Process the somatosensory information of the current user and the transmitted somatosensory information of the associated user, and determine the item information of the current user and the associated user, wherein the item information includes a scoring result and a somatosensory action image;

The item information of the current user and the associated user is taken together as an interaction result.
The storage medium according to claim 34, wherein when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further enabled to perform the following steps:

reporting the somatosensory information to the server;

Correspondingly, acquiring the interaction result processed based on the somatosensory information of the current user and the somatosensory information of at least one associated user includes:

Obtain an interaction result processed by the server based on the somatosensory information of the current user and the somatosensory information of at least one associated user.
The storage medium of claim 34, wherein when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further enabled to perform the following steps:

In response to the current user's operation of opening the live broadcast room and selecting the somatosensory item duel, send an opponent matching request to the server;

Receive at least one associated user that matches the current user fed back by the server, and an interaction start instruction.
The storage medium according to claim 34, wherein when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is further enabled to perform the following steps:

In response to the interaction start instruction sent by the server, collect the user screen including the user's somatosensory action;

The user screen is input into the somatosensory information acquisition model, and the somatosensory information corresponding to the user's somatosensory action output by the somatosensory information acquisition model is acquired.
The storage medium according to any one of claims 34-43, wherein the somatosensory information includes at least one piece of motion information among a user's head motion, facial motion, and limb motion.