WO2024087814A1

WO2024087814A1 - Method for implementing range communication in virtual conference, and display device and mobile terminal

Info

Publication number: WO2024087814A1
Application number: PCT/CN2023/113270
Authority: WO
Inventors: 栗军涛; 董鹏; 杜永花
Original assignee: 聚好看科技股份有限公司
Priority date: 2022-10-25
Filing date: 2023-08-16
Publication date: 2024-05-02
Also published as: WO2024087814A9

Abstract

The present application discloses a method for implementing range communication in a virtual conference, and a display device and a mobile terminal. The display device receives an operation of the current conference participant for joining a target virtual conference and sends a conference participation request to a server, and the server adds the conference participant to a cluster discussion group corresponding to a virtual conference. A virtual conference interface presented by the display device comprises a virtual communication room and virtual images corresponding to all conference participants that are added to the target virtual conference. The display device generates a range communication discussion group on the basis of current position information of the current virtual image in a virtual communication room and on the basis of the current conference participant in the cluster discussion group and at least one target conference participant that meets a preset distance range. A range communication message generated by the current conference participant is sent to each target conference participant end in the range communication discussion group, so that in a certain social range, a conference participant can freely communicate with other conference participants anywhere and at any time, and thus the user experience is good.

Description

A method for realizing range communication in a virtual meeting, a display device, and a mobile terminal

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to the Chinese patent applications filed with the China Patent Office on October 25, 2022, with application number 202211313577.9, and with application number 202310244721.6 filed with the China Patent Office on March 14, 2023, the entire contents of which are incorporated by reference into this application.

Technical Field

The present application relates to the field of computer technology, and in particular to a method for implementing range communication in a virtual conference, a display device, and a mobile terminal.

Background technique

With the rapid development of display devices, the functions of display devices will become more and more abundant and the performance will become more and more powerful. At present, display devices include smart TVs, smart phones, computers, and products with smart display screens. In different scenarios implemented by display devices, virtual conference systems can be configured in display devices. Use virtual conference systems to create virtual conferences and allow multiple participants to join virtual conferences for communication.

In virtual conferences, participants can only speak to the whole audience or establish a one-on-one private communication with a certain participant. This fixed communication mode cannot achieve free communication. For example, the current participant cannot participate in the private free discussion between other participants at any time, and other participants cannot participate in the private free discussion between the current participant and other participants at any time, which leads to poor user experience.

Summary of the invention

The present application provides a display device, comprising: a display configured to display an image and/or a user interface; a memory configured to store computer instructions and data related to the display; and at least one processor connected to the display and the memory, the processor being configured to execute computer instructions so that the display device: receives an operation of a current participant joining a target virtual conference, requests a server to join the current participant to a group discussion group corresponding to the target virtual conference, and displays a virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants joining the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and a virtual conference room corresponding to the group discussion group. and the virtual images corresponding to all the participants in the group discussion group, the virtual images corresponding to all the participants are displayed in the virtual communication room; based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image is the virtual image of the current participant, and the target virtual image is the virtual image of the target participant in the group discussion group; if there is at least one target virtual image within the preset distance range of the current virtual image, then filtering out the target participant corresponding to the current participant and the at least one target virtual image from the group discussion, and generating a range communication discussion group;

Receive the communication message generated by the current participant, and send the communication message to each target participant terminal in the range communication discussion group.

The present application also provides a server, including: a processor, configured to: in response to a conference participation request sent by a display device, add a designated participant corresponding to the display device to a group discussion group corresponding to a target virtual conference, the group discussion group including all participants joining the target virtual conference; receive a communication message generated by the designated participant sent by the display device, the communication message carrying a communication identifier; if the communication identifier is a range communication identifier, send the communication message generated by the designated participant to at least one target participant end in a range communication discussion group with the same range communication identifier, the range communication discussion group including the designated participant and at least one target participant that meets a preset distance range with the designated participant; if the communication identifier is a full-field communication identifier, send the communication message generated by the designated participant to all participant ends of the group discussion group corresponding to the full-field communication identifier.

The present application also provides a method for implementing range communication in a virtual conference, which is applied to a display device, and the method includes: receiving an operation of a current participant to join a target virtual conference, requesting a server to add the current participant to a group discussion group corresponding to the target virtual conference, and displaying a virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual images corresponding to all participants in the group discussion group, and the virtual images corresponding to all participants are displayed in the virtual communication room; based on the current virtual image in the group discussion group, The current position information in the virtual communication room is detected, and whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image is the virtual image of the current participant, and the target virtual image is the virtual image of the target participant in the group discussion group; if there is at least one target virtual image within the preset distance range of the current virtual image, the target participant corresponding to the current participant and the at least one target virtual image is screened out from the group discussion, and a range communication discussion group is generated; the communication message generated by the current participant is received, and the communication message is sent to each target participant end in the range communication discussion group.

The present application also provides a method for implementing range communication in a virtual conference, which is applied to a server, and the method includes: in response to a conference participation request sent by a display device, adding a designated participant corresponding to the display device to a group discussion group corresponding to a target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference; receiving a communication message generated by the designated participant sent by the display device, wherein the communication message carries a communication identifier; if the communication identifier is a range communication identifier, sending the communication message generated by the designated participant to at least one target participant end in the range communication discussion group having the same range communication identifier, wherein the range communication discussion group includes the designated participant and at least one target participant who meets a preset distance range with the designated participant; if the communication identifier is a full-field communication identifier, sending the communication message generated by the designated participant to all participant ends of the group discussion group corresponding to the full-field communication identifier.

The present application also provides a computer non-volatile readable storage medium, which can store a program, and when the program is executed, it can implement some or all of the steps in each embodiment of the method for implementing range communication in a virtual meeting provided by the present application.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram showing an operation scenario between a display device and a control apparatus according to some embodiments;

FIG2 shows a flow chart of a method for creating a virtual meeting according to some embodiments;

FIG3 illustrates a timing diagram for creating a virtual conference according to some embodiments;

FIG4 shows a schematic diagram of a conference creation interface according to some embodiments;

FIG5 is a flowchart showing a method for implementing a range communication in a virtual meeting performed by a display device according to some embodiments;

FIG6 illustrates a timing diagram of participants joining a virtual conference according to some embodiments;

FIG7 shows a schematic diagram of a virtual conference selection interface according to some embodiments;

FIG8 shows a schematic diagram of a virtual conference interface according to some embodiments;

FIG9 shows a schematic diagram of an interface for joining a target virtual conference through a conference password according to some embodiments;

FIG10 shows a timing diagram of implementing range communication in a virtual communication room according to some embodiments;

FIG11 shows a schematic top view of a range communication area division according to some embodiments;

FIG12 is a flowchart showing a method for generating a range exchange discussion group according to some embodiments;

FIG13( a ) shows a schematic diagram of a virtual conference interface at a host end according to some embodiments;

FIG13( b ) shows another schematic diagram of a virtual conference interface at the host end according to some embodiments;

FIG14 is a schematic diagram showing a speech type dialog box displayed on a participant end according to some embodiments;

FIG15 shows another timing diagram for implementing range communication in a virtual communication room according to some embodiments;

FIG16 shows another schematic top view of the range communication area division according to some embodiments;

FIG17 is a flowchart showing a method for implementing range communication according to some embodiments;

FIG18 shows a flow chart of a method for implementing range communication in a virtual conference performed by a server according to some embodiments;

FIG19 shows another flow chart of a method for implementing range communication in a virtual conference performed by a server according to some embodiments;

FIG. 20 shows a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG21 shows a hardware configuration block diagram of a mobile terminal 300 according to some embodiments;

FIG. 22 shows a schematic diagram of software configuration in the display device 200 or the mobile terminal 300 according to some embodiments;

FIG23 shows a software interaction diagram of a page display method based on device performance according to some embodiments;

FIG24 is a schematic flow chart showing a method for displaying a page based on device performance according to some embodiments;

FIG25 is a flowchart showing another method for displaying a page based on device performance according to some embodiments;

FIG26 shows a schematic diagram of a skeleton point composition graph according to some embodiments;

FIG. 27 shows a schematic diagram of a scene for displaying a training page according to some embodiments;

FIG28 is a schematic diagram showing a scene of displaying a virtual human training screen according to some embodiments;

FIG29 is a schematic diagram showing a prompt scenario of a follow-up training page according to some embodiments;

FIG30 shows an interactive schematic diagram of a method for displaying a page based on device performance according to some embodiments.

Detailed ways

In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart television, a computer, a laser projection device, a monitor, an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), etc. FIG1 is a specific implementation of the display device of the present application.

Fig. 1 is a schematic diagram showing an operation scenario between a display device and a control apparatus according to some embodiments. As shown in Fig. 1 , a user 100 can operate a display device 200 via a terminal device 300, or the user 100 can directly operate the display device 200.

In some embodiments, the terminal device 300 may be, for example, a mobile terminal, a tablet computer, a computer, a laptop computer, etc. For example, the display device 200 is controlled using an application program running on the terminal device.

In some embodiments, the display device 200 may not use the above-mentioned terminal device to receive instructions, but may receive user control through touch or gestures, etc. The display device 200 may also directly receive the user's voice command control through a module for obtaining voice commands configured inside the display device 200, or may receive the user's voice command control through a voice control device provided outside the display device 200.

In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

In some embodiments, a virtual conference system is configured in the display device 200, and the virtual conference system may exist in the form of an application. A virtual conference is created using the virtual conference system, and multiple participants are allowed to join the virtual conference for communication.

In real-life scenarios, when a user approaches a group of people who are talking or discussing, the user can naturally hear what the group is talking about. The user can choose to pass by them, stop and listen, or join the discussion with the group at any time.

In virtual conferences, participants can only speak to the whole audience or establish a one-on-one conversation with a certain participant. This fixed communication mode is quite different from the real communication scene and cannot achieve free communication.

In order to give participants a better experience, that is, to be able to have private and free discussions with other participants at any time, just like attending a real meeting, the embodiment of the present application provides a display device 200, and is configured to perform a method for implementing range communication in a virtual meeting. In the virtual meeting provided in the embodiment of the present application, the participants are presented in the virtual meeting scene (virtual communication room) in the form of virtual images, and the virtual images can roam in the virtual meeting scene. When entering a certain social range, the conversation voices of other virtual images corresponding to the participants within this range can be heard by the current participant, and the current participant’s speech can also be heard by other participants within the range, that is, as in the real scene, within a certain social range, participants can communicate freely.

FIG2 shows a flow chart of a method for creating a virtual meeting according to some embodiments; FIG3 shows a timing chart of creating a virtual meeting according to some embodiments. The present application embodiment provides a display device 200, including: a display configured to display a user interface, the user interface including but not limited to the virtual meeting interface, virtual meeting selection interface and meeting creation interface shown herein; a processor connected to the display, when executing the method for creating a virtual meeting shown in FIG2 and FIG3, the processor is configured to perform the following steps:

S01. Display a conference creation interface, where the conference creation interface includes a creation button and at least one parameter input box, where the at least one parameter input box is used for a user to input different types of parameters.

S02. Receive a trigger of a create button by a user, obtain different types of parameters input by the user based on at least one parameter input box, and generate a create request carrying create request parameters, where the create request parameters include different types of parameters.

S03: Send a creation request carrying creation request parameters to the server, where the creation request is used to instruct the server to create a virtual conference based on the creation request parameters.

The timing flow of creating a virtual conference shown in FIG3 specifically includes the following steps:

S301, the administrator creates a meeting (meeting name, meeting start and end time, meeting scene ID, maximum number of participants, etc.) to the business server;

S302, the business server verifies parameters;

S303, the business server generates a conference number;

S304, the business server creates a group discussion group to the instant messaging server;

S305, the instant messaging server notifies the business server of successful creation and returns the group code;

S306, the business server saves the meeting information to the database;

S307, the business server receives the notification of successful database saving, and further notifies the administrator end that the meeting is successfully saved;

S308, the business server background starts a scheduled scanning task to scan the newly created meeting;

S309: The business server reaches the conference start time and generates conference cache information;

S310, the business server saves the conference cache information to the cache server;

S311. The business server receives a notification of successful saving sent by the cache server.

In some embodiments, the subject who creates the virtual conference may be an administrator, and the conference creation interface is displayed on the display of the display device 200. On the administrator side, the user 100 in FIG1 may be the administrator who creates the virtual conference, and the administrator side may be a display device operated by the administrator.

FIG4 shows a schematic diagram of a conference creation interface according to some embodiments. In some embodiments, as shown in FIG4 , the conference creation interface includes at least one parameter input box. The at least one parameter input box includes at least one or more combinations of a conference name input box, a conference time input box, a conference cover input box, a maximum number of people input box, a conference scene input box, a public display input box, a participation restriction input box, a host input box, a create button, and a cancel button.

The Meeting Name input box is used to determine the name of the virtual meeting. The Meeting Time input box is used to determine the start and end time of the virtual meeting. The Meeting Cover input box is used to determine the cover of the virtual meeting. This parameter is not required. The Maximum Number of Participants input box is used to determine the maximum number of participants in the virtual meeting. The Meeting Scene input box is used to determine the background pattern of the virtual communication room corresponding to the virtual meeting. The background pattern defaults to the meeting cover. The pattern on the screen can also be changed; select a meeting scene pattern to determine the meeting scene ID. The public display input box is used to determine whether the virtual meeting is publicly displayed. The participation restriction input box is used to determine whether a password verification is required to join the virtual meeting. The public display input box is associated with the participation restriction input box. When the public display input box is in the public state, the unlimited items and password verification items provided by the participation restriction input box are both in a triggerable state; if the administrator triggers the unlimited item, it means that there is no need to enter a password to join the virtual meeting; if the administrator triggers the password verification item, it means that a password is required to join the virtual meeting. When the public display input box is closed, the unlimited items and password verification items provided by the participation restriction input box are both in an untriggerable state. The host input box determines the host of the virtual meeting. The create button is used to determine the creation process of the virtual meeting after the administrator sets the corresponding type of parameters. The cancel button is used to cancel the creation process of the virtual meeting.

The administrator provides various parameter input boxes based on the conference creation interface to set different types of parameters, and triggers the creation button. The display device 200 operated by the administrator generates a creation request carrying creation request parameters, and the creation request parameters include different types of parameters. The display device 200 operated by the administrator sends the creation request carrying the creation request parameters to the server, so that the server requests the instant messaging server to create a virtual conference and its group discussion group based on the creation request parameters. The group discussion group is used to realize the transmission of instant messages of all participants who join the virtual conference to realize communication.

Exemplarily, when password verification is required, the creation request parameters include at least one of the meeting name, meeting password, meeting start time, meeting end time, meeting scene ID and the maximum number of participants; when password verification is not required, the creation request parameters include at least one of the meeting name, meeting start time, meeting end time, meeting scene ID and the maximum number of participants.

It should be noted that the server described in this article may be a business server. The process of the business server creating a virtual conference based on a creation request from the display device may refer to the contents of subsequent server embodiments and will not be described in detail here.

FIG5 shows a flowchart of a method for implementing a range communication in a virtual meeting performed by a display device according to some embodiments. A display device 200 provided in an embodiment of the present application is applied to a participant display device. When executing the method for implementing a range communication in a virtual meeting shown in FIG5 , the processor of the participant display device 200 is configured to perform the following steps:

S11. Receive an operation of the current participant to join the target virtual conference, request the server to add the current participant to the group discussion group corresponding to the target virtual conference, and display the virtual conference interface of the target virtual conference.

The group discussion group includes all participants who join the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual images corresponding to all participants in the group discussion group. The virtual images corresponding to all participants are displayed in the virtual communication room.

In some embodiments, a virtual meeting corresponds to a group discussion group, and the group discussion group is used to achieve full communication among all participants joining the virtual meeting. The virtual communication room can be regarded as a visual presentation of the group discussion group of the virtual meeting. Therefore, the group code of the group discussion group can be equivalent to the group code used to characterize the virtual communication room. The group discussion group can be created by the business server based on the creation request of the administrator side, and then requesting the instant messaging server to create it. The process of the business server and the instant messaging server creating the group discussion group of the target virtual meeting can refer to the content of the subsequent server embodiment, which will not be repeated here.

The virtual image is displayed in the virtual communication room, which means that the participant corresponding to the virtual image has joined the group discussion group of the virtual meeting. The virtual image is a visual representation of the participant in the virtual communication space. When conducting a virtual meeting, the participants are displayed in a visual form, which can enhance the participants' sense of participation and experience. In addition, the participants can control the movement of their corresponding virtual images in the virtual communication room, so that participants can communicate freely with other participants anywhere and at any time, just like in a real meeting scene.

After the administrator requests the business server to complete the creation of the virtual conference, when the current time reaches the meeting start time of the target virtual conference, the participant can join the target virtual conference, and then the virtual conference interface of the target virtual conference is displayed on the display of the participant. The participant end can be a display device operated by the participant. In this scenario, the user 100 in Figure 1 can be a participant.

FIG. 6 shows a timing diagram of participants joining a virtual conference according to some embodiments. As shown in FIG6 , the processor of the participant display device 200 is further configured to perform the following steps when performing the operation of receiving the current participant to join the target virtual conference and displaying the virtual conference interface of the target virtual conference:

Step 1: Display a virtual conference selection interface, where the virtual conference selection interface includes at least one virtual conference selection item.

Step 2: receiving a trigger of a selection item of a target virtual conference from a current participant, and generating a conference request carrying conference request parameters.

Step 3: Send a conference request carrying conference request parameters to the server, where the conference request is used to instruct the server to verify the user ID and the conference number of the target virtual conference.

Step 4: receiving the meeting details information of the target virtual meeting corresponding to the meeting number sent by the server after verification, and displaying the virtual meeting interface of the target virtual meeting based on the meeting details information.

The participant triggers the virtual conference system configured in the display device 200 to display the virtual conference selection interface on the display.

The time sequence flow of a participant joining a virtual conference shown in FIG6 specifically includes the following steps:

S601, the participant terminal S1 applies to the business server to join the conference (conference number + user ID + joining password);

S602: The business server receives the conference joining request and verifies the parameters;

S603, the business server queries the conference details information from the cache;

S604: The business server receives the conference details information returned by the cache server;

S605, the business server verifies the meeting password;

S606, the participant terminal S1 receives a notification of failure to join the conference sent by the business server;

S607: The participant S1 ends the process.

S608, the business server passes the verification;

S609, the business server adds the participant to the participant list;

S610, the business server sends a successful conference joining notification to the participant terminal S1 and returns conference details;

S611, the business server sends a meeting joining notification to the instant messaging server;

S612, the instant messaging server sends a joining notification to other participants S2-Sn who have joined the meeting;

S613, other participants S2-Sn who have joined update the local participant list;

S614, the participant terminal S1 joins the group discussion group based on the group code;

S615, the participant terminal S1 queries the business server for a list of participants who have attended the conference;

S616, the participant terminal S1 receives the participant list (user ID, user name and location information, etc.) returned by the business server;

S617. The participant terminal S1 saves the participant list locally.

FIG7 shows a schematic diagram of a virtual meeting selection interface according to some embodiments. As shown in FIG7 , the virtual meeting selection interface displays the selection items of at least one virtual meeting that the participant is about to participate in, and the selection items of at least one virtual meeting are sorted in order from early to late according to the meeting start time of each virtual meeting. Exemplarily, the virtual meeting selection interface displays the selection items of two virtual meetings held today (October 10, 2022) and the selection items of two virtual meetings held on October 12, 2022.

The options for the virtual meeting present at least one of the following: meeting cover, meeting name, status, number of participants, number of participants allowed, access method, and meeting number. The status may include types such as not started, in progress, and ended. The number of participants is used to characterize the number of people who have currently joined the virtual meeting. The number of participants allowed is the maximum number of participants for the virtual meeting. The access method is used to determine whether a password is required to join the corresponding virtual meeting. The meeting number is used to uniquely characterize the virtual meeting. The meeting number can be 11 characters long. The first digit is used to distinguish between multi-environment deployments (1-online environment, 2-test environment, etc.), the middle 6 digits are the year and date, and the following are 4 random numbers.

For example, participant P1 (current participant) joins the ongoing virtual conference A (target virtual conference). The name of virtual conference A is "2022 XX New Product Launch Conference", the access method is password-free, the number of participants is 2590, the number of participants is limited to 3000, and the conference number is 1221010xxxx. The current participant P1 triggers the selection of virtual conference A, and the display device S1 of participant P1 generates a conference request carrying the conference request parameters. The conference request parameters include the user ID and the conference number of the target virtual conference. The user ID is used to represent the identity of the current participant P1.

In response to the conference request sent by the display device S1, the business server verifies the legitimacy of the conference request parameters carried in the conference request, namely the user ID and the conference number of the target virtual conference. If the verification passes, the business server obtains the conference details information of the virtual conference A corresponding to the conference number (1221010xxxx) from the cache server. The business server sends the conference details information of the virtual conference A to the display device S1, and then the display device S1 displays the virtual conference interface of the virtual conference A on the display based on the conference details information.

Among them, the meeting details information includes at least one of the meeting name, meeting start time, meeting end time, meeting scene ID, meeting number, group code and maximum number of participants. The group code is used to identify the group discussion group of the target virtual meeting (equivalent to the virtual communication room), and the meeting scene ID is used to characterize the meeting scene.

FIG8 shows a schematic diagram of a virtual conference interface according to some embodiments. In some embodiments, as shown in FIG8 , the virtual conference interface includes a virtual communication room and virtual images (P1'...Pn') corresponding to all participants (P1...Pn) who join the target virtual conference, and the virtual images corresponding to all participants are displayed in the virtual communication room. Among them, the maximum value of n is the value of the limited number of people (maximum number of participants).

The virtual communication room can be regarded as a full-court communication area, and each virtual image in the virtual communication room can move within the full-court communication area.

In some embodiments, to improve the display effect of the virtual communication room, the processor of the participant display device obtains the meeting scene ID from the meeting details information, and obtains the meeting scene corresponding to the meeting scene ID. Next, the meeting scene is displayed in the background of the virtual communication room corresponding to the virtual meeting, so that the participants can experience the atmosphere of participating in the new product launch conference in the real scene, and the user experience is good.

In some embodiments, the processor of the participant display device is further configured to perform the following steps:

Step 5: Receive the successful meeting notification returned by the server after verification.

Step 6: In response to the notification of successful participation in the meeting, obtain the virtual image corresponding to the current participant.

Step 7: Based on the group code, the current participant is added to the group discussion group corresponding to the group code, and the virtual image of the current participant is displayed in the virtual communication room through the instant messaging server.

After verifying that the participation request of the participant display device is passed, the business server adds participant P1 to the participant list of virtual conference A based on the conference number. The participant list includes all participants who have joined the target virtual conference; the business server stores the participant list in the cache server. At the same time, the business server can also return a successful participation notification to the display device S1 of participant P1, and send the participation notification of participant P1 to other participant display devices through the instant messaging server. The other participant display devices respond to the participation notification, which updates the local participant list of the other participant display devices. The specific implementation content of the business server executing this process can refer to the content provided in the subsequent server embodiments, which will not be repeated here.

In some embodiments, the participant list and the group discussion group have in common that both contain all participants of the same virtual meeting. The difference between the two is that the group discussion group is created by the instant messaging server to enable the transmission of messages between participants; the participant list is statistically generated by the business server to count the relevant information of the participants. The group discussion group includes information such as the user ID and user name of each participant, and the group discussion group may not include location information; the participant list includes the user ID, user name and location information of each participant, and the location information refers to the coordinate position of the participant's virtual image in the virtual communication room.

The display device S1 of participant P1 responds to the successful participation notification returned by the business server, adds participant P1 to the group discussion group corresponding to the group code of virtual conference A through the instant messaging server, and displays the virtual image P1' of participant P1 in the virtual communication room corresponding to virtual conference A.

In some embodiments, the display device S1 of the participant P1 sends a query request to the service server, so that the service server obtains from the cache server a list of participants currently joining the virtual conference A. The display device S1 updates the participant list stored locally on the display device S1 based on the latest participant list returned by the service server.

In some embodiments, if the target virtual conference is accessed in a password-protected manner, it means that when the administrator creates a virtual conference, the creation request parameter includes a conference password. When subsequent participants perform a conference joining operation, the participant The request parameters include user ID, meeting password and meeting number of the target virtual meeting, etc., and meeting details include at least one of the meeting name, meeting password, meeting start time, meeting end time, meeting scenario ID, meeting number, group code and maximum number of participants. Among them, the meeting password refers to the meeting password entered by the participant when applying to join the target virtual meeting. The subsequent business server needs to verify the consistency of the meeting password with the meeting password set by the administrator when the virtual meeting is created.

In some embodiments, referring to Figure 7 again, the virtual meeting selection interface includes a selection item for virtual meeting B, the name of virtual meeting B is "XXXX Ultra-Large Screen New Product Launch Conference", the meeting start time is 10:23 this morning, the access method is password-protected, the number of members is 2310, the limit is 6000, and the meeting number is 1221010yyyy.

When the current time is 9:30 am, the status of virtual conference B is not started. When the current time reaches 10:23, the status of virtual conference B switches to ongoing. Next, the current participant P1 triggers the selection item of virtual conference B, and a password input interface pops up in the virtual conference selection interface.

FIG9 shows a schematic diagram of an interface for joining a target virtual conference by using a conference password according to some embodiments. As shown in FIG9(a), the password input interface includes a password input box, a confirmation control, and a cancel control. Participant P1 enters a password in the password input box and clicks the cancel control to cancel joining virtual conference B; clicks the confirmation control to confirm the joining password, and the processor determines whether the current number of participants has reached the maximum number of participants.

If the current number of participants reaches the maximum number of participants, as shown in (b) of FIG9 , the processor switches to display the prompt interface in the virtual conference selection interface. The prompt interface includes prompt information and a confirmation control. The prompt information is used to inform the current participant P1 that the number of participants in virtual conference B is full and prompt the next operation to be performed; click the confirmation control to cancel the display of the prompt interface and return to the virtual conference selection interface.

If the current number of participants does not reach the maximum number of participants, as shown in (c) of FIG9 , the processor switches to display the joining meeting prompt interface in the virtual meeting selection interface, and the joining meeting prompt interface is used to prompt the information that the participant P1 is joining the virtual meeting B. After the processor joins the participant P1 to the virtual meeting B, the display of the joining meeting prompt interface is canceled, and the virtual meeting interface of the virtual meeting B is switched to be displayed (as shown in FIG8 ).

When a participant triggers the option of a target virtual meeting that does not require a password, and when a participant triggers the option of a target virtual meeting that requires a password and enters the password and clicks the OK control, in the background, the processor generates a request to join the meeting and sends it to the business server. The processor and the business server execute the corresponding contents of steps one to seven and related steps above, which are not repeated here. The processor receives the meeting details information of the target virtual meeting returned by the business server, and the display device starts to render the meeting scene and displays the virtual meeting interface. At the same time, the processor displays the virtual image of the participant in the virtual communication room in the virtual meeting interface.

S12. Based on the current position information of the current virtual image in the virtual communication room, detect whether there is a target virtual image within a preset distance range of the current virtual image.

The position information refers to the coordinate position of the virtual image in the virtual communication room. The current virtual image is the virtual image of the current participant, and the target virtual image is the virtual image of the target participant in the group discussion group.

Referring again to FIG8 , a two-dimensional coordinate system is established in the virtual communication room, with the coordinate origin 0 located on the virtual floor of the virtual communication room, the X-axis direction being from the left side to the right side of the virtual floor, and the Y-axis direction being from the inside to the outside of the virtual floor. The position information of the virtual image can be represented by the coordinate position of the bottom of the virtual image on the virtual floor, such as the coordinate position of the virtual image P1' of the participant P1 is displayed as (x1, y1).

FIG10 shows a timing diagram for implementing range communication in a virtual communication room according to some embodiments. In some embodiments, as shown in FIG10 , the virtual communication room includes virtual images of all participants who join the target virtual meeting, and each participant can operate the corresponding virtual image to move the position in the virtual communication room on their respective display devices. The method in which the participant operates the movement of the virtual image may include clicking the mouse or triggering the keyboard arrow keys, which is not specifically limited in this application.

Each display device sends its own virtual image information to other display devices through the instant messaging server in real time. At the same time, the instant messaging server sends the virtual image information sent by each display device to the business server, and the business server updates the participant list based on the latest virtual image information. The virtual image (equivalent to the participant) information includes user identification, user name and the latest location information.

The business server stores the latest information of each participant's virtual image, and the business server can send the latest participant list to the cache server for storage. The cache server has a fast response speed, and when the display device needs to obtain data from the cache server, it can be sent quickly and efficiently.

After receiving the virtual image information of the corresponding participant from other terminals, each display device updates the local participant user list of each terminal. To achieve range communication, it is necessary to determine whether the virtual images of other participants meet the range communication conditions with the virtual image of the current participant based on the current location information of the virtual image of the current participant. The participant operates the virtual image to move in the virtual communication room, triggering the range perception detection of the display device terminal, which is based on the latest local participant list.

The timing flow of implementing range communication in the virtual communication room shown in FIG10 specifically includes the following steps:

S1001, the participant S1 controls the virtual image to move in the virtual communication room;

S1002, the participant terminal S1 reports real-time location information (user ID, user name, latest location information) to the instant messaging server during movement;

S1003, other participants S2~Sn receive the changed location information sent by the instant messaging server;

S1004, the business server system receives the changed location information sent by the instant messaging server;

S1005. The business server updates the location information of the corresponding participant in the participant list to the cache server;

S1006, other participant terminals S2~Sn update local participant lists;

S1007, the participant terminal S1 performs a virtual image movement trigger range perception detection;

S1008, the participant terminal S1 saves other participants within a range of x meters centered on the current participant into a range communication list;

S1009, the participant terminal S1 displays the user name in the range communication list on the corresponding virtual image;

S1010, the current participant clicks to speak, and the participant end S1 determines whether the conference has enabled the range communication function;

S1011, the participant terminal S1 creates a range communication discussion group to the instant messaging server;

S1012, the participant terminal S1 sends a message of joining the temporary discussion group to the participants in the range communication list through the instant messaging server;

S1013, the participant terminal S1 receives the message of joining the temporary discussion group sent by the instant messaging server, and joins the range communication discussion group;

S1014, participant terminal S1 subscribes to the voice streams of other participants in the group from the instant messaging server;

S1015, participant terminal S1 subscribes to the voice streams of other participants in the group from the instant messaging server;

S1016, participant S1 starts speaking and starts streaming;

S1017, participant S1 receives the streaming data and plays the audio;

S1018, participant S1 starts speaking and starts streaming;

S1019, participant S1 receives the streaming data and plays the audio;

S1020, the participant end S1 continues to operate the virtual image to move.

FIG11 shows a schematic top view of the range communication area division according to some embodiments. As shown in FIG11 , taking the virtual image P1' of the participant P1 as an example, the virtual images of other participants within a preset distance range centered on the virtual image P1' are detected. Exemplarily, the preset distance range may be 1 meter.

Based on the coordinate position (x, y) of each virtual image, the distance between other virtual images and virtual image P1' is calculated. If the calculated distance is within 1 meter, the corresponding participant meets the range communication condition; if the calculated distance is greater than 1 meter, the corresponding participant does not meet the range communication condition. In other words, the participant corresponding to the virtual image within a range of 1 meter around virtual image P1' meets the range communication condition with participant P1, while other participants outside 1 meter do not meet the range communication condition with participant P1.

S13. If there is at least one target virtual image within the preset distance range of the current virtual image, the target participants corresponding to the current participant and the at least one target virtual image are screened out from the group discussion, and a range communication discussion group is generated.

Within 1 meter of the virtual image P1', if the virtual images P3' and P5' meet the range communication conditions, the corresponding participants P3 and P5 will be used as the objects of range communication with the current participant P1. The information of participants P1, P3 and P5 is included. The information of participants in the scope communication includes user identification, user name and the latest location information of the corresponding virtual image, etc. The scope communication discussion group includes P1, P3 and P5.

In some embodiments, the range communication area is smaller than or equal to the full-field communication area. The range communication limited by the central participant is realized in the range communication area, and the full-field communication of all participants in the virtual communication room is realized in the full-field communication area.

The members of the scope communication discussion group are members of the group discussion group, but not all members of the group discussion group are members of the scope communication discussion group. Each participant in the group discussion group can generate at least one scope communication discussion group corresponding to each other. The scope communication discussion group and each group discussion group are relatively isolated, and each scope communication discussion group is also relatively isolated from each other. Isolation means that messages in different discussion groups are usually not intercommunication, and intercommunication can only be achieved when allowed.

FIG12 shows a flow chart of a method for generating a range communication discussion group according to some embodiments. In some embodiments, as shown in FIG12, the processor of the participant display device is further configured to:

S131. Add the current participants in the group discussion and at least one target participant corresponding to the target virtual image to a range communication list.

S132: Receive a trigger of a speech button in the virtual conference interface by the current participant, and determine whether a range communication switch corresponding to the target virtual conference is turned on.

S133. If the range communication switch is in the on state, a speech type dialog box is displayed in the virtual conference interface, and the speech type dialog box includes a range communication option.

S134: receiving a trigger of a scope communication option by the current participant, and creating a scope communication discussion group corresponding to the scope communication list through an instant messaging server, wherein the scope communication discussion group is used to implement scope communication between each participant in the scope communication list.

The current participant creates a corresponding range communication list based on the current participant, and the range communication list includes the information of the current participant and the information of at least one target participant that meets the preset distance range with the current participant. The information includes the user ID, user name and the latest location information of the corresponding virtual image.

Whether each virtual meeting has the range communication function is controlled by the range communication switch. The range communication switch is configured in the virtual meeting interface of the host side of the target virtual meeting. The host is the host set by the administrator when creating the virtual meeting. The host can be one of all the participants who join the target virtual meeting. The host performs global meeting control.

FIG13(a) shows a schematic diagram of a host-side virtual conference interface according to some embodiments. In some embodiments, as shown in FIG13(a), the difference between the host-side virtual conference interface and the participant-side virtual conference interface is that the host-side virtual conference interface also includes management controls and list controls, and the rest of the interface content is the same. The host-side refers to the display device 200 used by the host, and the participant-side refers to the display device 200 used by the participant.

In response to the host triggering the management control, the host side displays the management interface in the host side virtual conference interface. The management interface includes managing a single user item and managing all user items. In the interface for managing a single user item (not shown in the figure), the rights of each participant to attend the meeting can be individually controlled, such as mute operations, prohibition of applause, and other operations; in the interface for managing all user items, the rights of all participants to attend the meeting can be globally controlled. For example, if the microphone is turned off, all participants cannot speak, and if it is turned on, they can speak. If the screen sharing function is turned off, all participants are not allowed to share the screen, and if it is turned on, they can share the screen. If the applause conference function is turned off, all participants cannot applaud, and if it is turned on, they can applaud. If the all-seated function is turned off, all participants can control the movement of the virtual image in the virtual communication room and can communicate in a range; if it is turned on, the virtual images of all participants remain stationary and are not allowed to move, that is, they cannot communicate in a range.

FIG13( b) shows another schematic diagram of a virtual conference interface on the host side according to some embodiments. In some embodiments, as shown in FIG13( b), the host side displays a participant list interface in the virtual conference interface on the host side in response to the host triggering the list control. The participant list interface displays a participant list, and the visualized information includes user avatars and user names.

In some embodiments, the participant P1 triggers the speech button (microphone) in the virtual conference interface of the participant end to determine whether the range communication switch corresponding to the target virtual conference is turned on, that is, whether the full seating function of the host end is in the off state. If the full seating function is in the off state, it is determined that the range communication switch is in the on state, and the participant end displays the speech type dialog box in the virtual conference interface.

FIG14 is a schematic diagram showing a speech type dialog box displayed on the participant side according to some embodiments. In some embodiments, as shown in FIG14 , the virtual conference interface on the participant side includes a speech button, such as a “microphone” control. In the scenario of range communication, if the current participant needs to communicate, the speech button is triggered, and a speech type dialog box is displayed in the virtual conference interface to communicate with other target participants in the range communication list. Based on the detection result of whether the range communication switch is turned on, different contents are displayed in the speech type dialog box.

If the range communication switch is on, the speech type dialog box includes the range communication option and the full communication option. If the range communication switch is off, the speech type dialog box includes the full communication option.

Taking the range communication of participants P1, P3 and P5 as an example, if the range communication switch is in the on state, the speech type dialog box displayed on the participant end S1 includes the range communication option and the full-field communication option. The current participant triggers the range communication option, which enables the current participant P1 to conduct range communication with each target participant (P3 and P5) in the range communication list. Triggering the full-field communication option enables the current participant P1 to conduct full-field communication with all participants in the participant list (P2~Pn). If the range communication switch is off, the speech type dialog box displayed on the participant end only includes the full-field communication option, but not the range communication option. At this time, only full-field communication can be performed.

In response to the current participant P1 selecting the range communication option, the participant end S1 calls the instant messaging server to create a temporary discussion group for the participants in the current range, namely the range communication discussion group, which includes P1, P3 and P5. At the same time, the participant end S1 sends an instant message to the target participants (P3 and P5) in the range communication discussion group through the instant messaging server to notify participants P3 and P5 to join the range communication discussion group. After joining, each end subscribes to the voice streams of other target participants in the range communication discussion group to achieve range communication.

In some embodiments, in the virtual communication room where the virtual conference interface is presented at the current participant end, only the user name is displayed on the virtual image of the current participant, while the corresponding user names are not displayed on the virtual images of other participants. In range communication, the user name of the target participant can be displayed on the target virtual image to show the current participant P1 which participants are within a 1-meter range.

The processor of the display device S1 of the participant P1 obtains the user name of each target participant in the range communication list, and displays the user name of each target participant on each target avatar in the virtual communication room. For example, the user name "User 1" is displayed on the avatar P1, the user name "User 3" is displayed on the avatar P3, and the user name "User 5" is displayed on the avatar P5.

It should be noted that the participant information corresponding to the range communication list is only displayed on the participant side conducting the range communication, and not on the other participant sides of the virtual communication room, so as to achieve the purpose of private free communication.

Figure 15 shows another timing diagram for implementing range communication in a virtual communication room according to some embodiments. In some embodiments, as shown in Figure 15, the processor of the participant display device is further configured to:

Receive the preset operation triggered by the current participant, and control the corresponding current virtual image to move in the virtual communication room.

Based on the position information of the current virtual image after movement, a new target virtual image within the preset distance range is obtained, and the original target participants outside the preset distance range are screened out from all the original target participants corresponding to the range communication discussion group.

The new target participant corresponding to the new target virtual image is added to the range communication discussion group, and the original target participant in the range communication discussion group that is outside the preset distance range is removed to update the range communication discussion group.

The virtual image corresponding to the current participant P1 can be moved to any position in the virtual communication room at any time. As the virtual image corresponding to the current participant P1 moves in the virtual communication room, the processor again determines whether there is a new target virtual image within the preset distance range of the current participant P1. If so, the range communication list and the range communication discussion group are updated. In addition, the processor also determines whether the original target participant originally located in the range communication list (discussion group) is still within the range, and if not, it is removed.

Specifically, another sequential process for implementing range communication in a virtual communication room as shown in FIG15 includes the following steps:

S1501, the participant terminal S1 adds the new participant who has entered the range of x meters to the range communication list and displays the user name;

S1502, other participant terminals S2-Sn participant terminal S1 adds the new participant who has entered the range of x meters to the range communication list and displays the user name;

S1503, the participant terminal S1 sends a message of joining the temporary discussion group to the participants in the new communication list through the instant messaging server;

S1504, other participant terminals S2-Sn receive the message of joining the temporary discussion group, and join the range exchange discussion group;

S1505, other participants S2-Sn subscribe to the voice streams of other participants in the group from the instant messaging server;

S1506, the participant terminal S1 subscribes to the voice stream of the new participant from the instant messaging server;

S1507, participant S1 starts speaking and starts streaming;

S1508, the participant terminal S1 receives the streaming data sent by the instant messaging server and plays the voice;

S1509, other participants S2-Sn start to speak and start streaming;

S1510, other participants S2-Sn receive the streaming data sent by the instant messaging server and play the voice;

S1511, the participant terminal S1 removes the participants who leave the range of x meters from the range communication list, and cancels displaying the user names;

S1512, other participant terminals S2-Sn remove participants who have left the range of x meters from the range communication list and cancel display of user names;

S1513, the participant ends S1 and moves it out of the range of the discussion group;

S1514. Other participant terminals S2-Sn receive a notification of ending the range communication.

Figure 16 shows another top view schematic diagram of the range communication area division according to some embodiments. As shown in Figure 16, taking the virtual image P1' of participant P1 moving to another position as an example, at this time, by judging that the target virtual images within the range of 1 meter centered on the virtual image P1' are P3' and P8', the updated range communication list (discussion group) includes P1, P3 and P8, that is, participant P1 conducts range communication with participants P3 and P8, and the original target participant P5 is not within the range of 1 meter centered on P1', then participant P5 can no longer conduct range communication with participant P1.

The display device S1 of participant P1 notifies participant P8 to join the range communication discussion group through the instant messaging server, and at the same time removes participant P5 who has left the range from the range communication discussion group (list), and returns the end of range communication notification to the display device of participant P5. In order to facilitate the prompting of the current participant P1 that the participant with whom the range communication has changed, the processor displays the user name of each target participant on each target virtual image in the virtual communication room, and cancels the display of the user name on the target virtual image corresponding to the original target participant removed from the range communication list (discussion group). Exemplarily, the processor displays the corresponding user name of participant P8 who has newly entered the range of 1 meter, and removes the user name display of participant P5 who has left the range, and continues to display the user names of participants P1 and P3.

Based on this, as participant P1 moves in the virtual communication room, the range communication list (discussion group) is updated in real time, and the user names of the virtual images of each participant who meets the range communication conditions are refreshed and displayed in real time. The current participant and some participants enter the social range of each other, and at this time, each other's user names are displayed to each other. When they leave the social range, the user names are no longer displayed to each other. At the same time, the size of the social range can be configured by changing the preset distance range to provide a better user experience. Every time the virtual image of participant P1 goes to a location, it can communicate with participants who meet the range communication conditions, realizing free communication anytime and anywhere.

S14. Receive the communication message generated by the current participant, and send the communication message to each target participant in the range communication discussion group.

After establishing the scope communication centered on the current participant, each target participant in the scope communication discussion group can communicate in real time. The communication methods include real-time voice, text messages, etc., and the communication messages can include voice messages and text messages, etc.

FIG. 17 shows a flow chart of a method for implementing range communication according to some embodiments. As shown in FIG. 17 , the processor of the participant terminal S1 is further configured to receive the communication message generated by the current participant and send the communication message to each target participant terminal in the range communication list:

S141. Receive a scope communication message generated by the current participant, the scope communication message carries the scope communication identifier of the scope communication discussion group, and each participant in the same scope communication discussion group carries the same scope communication identifier.

S142. Send the scope communication message of the current participant to each target participant end in the scope communication discussion group with the same scope communication identifier through the instant messaging server, and do not send it to other participant ends in the group discussion group that do not have the same scope communication identifier.

In the same scope communication discussion group, each participant (P1, P3 and P5) has the same scope communication identifier. After the current participant P1 triggers the scope communication option, he starts to speak and generates scope communication information. The participant end S1 sends the scope communication message of the current participant P1 to the participants P3 and P5 with the same scope communication identifier through the instant messaging server. Participants who are located in the virtual communication room (group discussion group) but not in the corresponding scope communication list (scope communication discussion group) do not have the scope communication identifier, so the participant end S1 does not send the communication message of participant P1 to the participants (P2, P4, P6~Pn) ends.

In this way, taking voice communication as an example, when a participant in the range communication discussion group starts to speak, the participant terminal detects the microphone information, starts to push the stream, and sends the voice message to other participant terminals in the same range communication discussion group through the instant messaging server. Other participant terminals receive the voice stream and start playing, thus realizing range communication. However, the participant terminals in the group discussion group but not in the range communication discussion group will not receive the voice stream.

In some embodiments, the current participant can communicate freely with some of the participants in real time. If there is a participant in the virtual communication room for full-time communication at this time, the participants in the range communication can also listen to the full-time speech of the participant.

In this process, the processor at the participant end is further configured as follows:

Step 151: When a specific participant who joins the target virtual conference generates specific communication information, a specific communication reminder is displayed in the virtual communication interface corresponding to the current participant.

Step 152: receiving a trigger of a specific communication reminder from the current participant, and receiving specific communication information generated by the specific participant.

Among them, a specific participant refers to a participant who is in the virtual communication room (group discussion group) and is not in the same scope communication list (scope communication discussion group) as the current participant. For example, the specific participant is one of the participants (P2, P4, P6~Pn), and the specific participant can also be the host.

When participant P1 is communicating in a group, if a specific participant P2 starts speaking in the whole room, the display device S2 of participant P2 sends a specific communication reminder to all other participants (P1, P3~Pn) through the instant messaging server. The specific communication reminder is used to indicate that a specific participant in the virtual communication room is communicating in the whole room. The specific communication reminder includes user identification, user name, user role type, etc. The user role type is used to indicate whether the user who is currently speaking in the whole room is a participant or a host.

The display device S1 of participant P1 receives a specific communication reminder to start full-court speech, obtains the user ID of the speaker from the specific communication reminder, and then subscribes to the speaker's voice stream. At this time, participant P1 can hear the speech of P3 and P5 in the range communication, and can also hear the speech of participant P2 in the full-court communication.

In some embodiments, when participant P1 wants to have a full-field communication, the processor of participant S1 is further configured to:

Step 161: When the current participant is conducting a full-court communication in the virtual communication room, a triggering of a speech button in the virtual conference interface by the current participant is received, and a full-court communication option is displayed in a speech type dialog box that pops up in the virtual conference interface.

Step 162: receiving a trigger of the full-field communication option from the current participant, and sending a full-field communication request to the specific participant via the instant messaging server. The full-field communication request is used to instruct the specific participant to determine whether to allow the current participant to conduct full-field communication.

Step 163: respond to the received permission for full-field communication returned by the specific participant via the instant messaging server. Instruction, receiving the full-field communication message generated by the current participant, the full-field communication message carries the full-field communication identifier of the group discussion group, and each participant in the group discussion group carries the same full-field communication identifier.

Step 164: Send the full-field communication information generated by the current participant to all participant terminals in the group discussion group corresponding to the full-field communication identifier through the instant messaging server.

The controller who decides whether the participants can communicate with the whole audience is the host. In this scenario, the specific participant is the host. When participant P1 wants to communicate with the whole audience, participant P1 triggers the speech button in the virtual conference interface of participant end S1 and triggers the full communication option in the pop-up speech type dialog box. Next, participant end S1 generates a full communication request and sends it to the host end through the instant messaging server.

At this time, a message reminder pops up in the virtual conference interface of the host side, and the microphone permission of participant P1 is enabled. At the same time, the host side sends a full communication notification of participant P1 to all other participants in the virtual communication room. All other participant sides receive the full communication notification of participant P1 and subscribe to the voice stream of full communication participant P1. After participant side S1 receives the instruction to allow full communication returned by the host side, participant P1 starts to speak, and the full communication message of participant P1 is sent to all other participant sides through the instant messaging server. At this time, the current participant P1 can be heard by all participants (P2~Pn) in the meeting.

The embodiment of the present application provides a display device 200, which receives the operation of the current participant to join the target virtual meeting when executing the implementation method of the virtual conference range communication. The virtual conference interface includes a virtual communication room and virtual images corresponding to all participants who join the target virtual meeting. Based on the current position information of the current virtual image in the virtual communication room, it is detected whether there is a target virtual image within a preset distance range of the current virtual image. If there is at least one target virtual image, a range communication group discussion group is generated based on the current participant and the target participant corresponding to the at least one target virtual image; the communication message generated by the current participant is received, and the communication message is sent to each target participant end in the range communication group discussion group to realize range communication. It can be seen that the display device 200 can realize that within a certain social range, participants can freely communicate with other participants anywhere and at any time, and the user experience is good.

FIG18 shows a flow chart of a method for implementing a range communication in a virtual meeting executed by a server according to some embodiments. A server provided in an embodiment of the present application is applied to a business server, including: a processor, when executing the method for implementing a range communication in a virtual meeting shown in FIG18, the processor is configured to execute the following steps:

S21. In response to a creation request carrying creation request parameters sent by a display device, a virtual conference is created based on the creation request parameters, where the creation request parameters include at least one of a conference name, a conference start time, a conference end time, a conference scenario ID, and a maximum number of participants.

Referring again to the timing diagram of creating a virtual conference shown in FIG3 and the schematic diagram of the conference creation interface shown in FIG4, the administrator sets various types of parameters of the virtual conference based on the conference creation interface, and generates a creation request and sends it to the business server. The implementation content of the administrator setting various types of parameters of the virtual conference can refer to the content provided by the aforementioned display device end, which will not be repeated here.

In some embodiments, the processor of the service server is further configured to:

Step 211: In response to receiving the creation request, verify the creation request parameters carried in the creation request.

Step 212: If the creation request parameter verification passes, a meeting number is generated based on a preset rule.

Step 213: Send a message group creation request carrying the conference number to the instant messaging server, where the message group creation request is used to instruct the instant messaging server to create a virtual conference based on the conference number, where the virtual conference includes a group discussion group with a group code.

Step 214, receive the group code of the group discussion group sent by the instant messaging server, and generate the meeting information of the virtual meeting in combination with at least one of the meeting number, meeting name, meeting start time, meeting end time, meeting scene ID and the maximum number of participants, and store the meeting information of the virtual meeting in the database.

The business server performs a validity check on the creation request parameters carried in the creation request sent by the manager. If the check passes, a meeting number is generated based on a preset rule.

In some embodiments, the conference number can be an 11-digit string, and the preset rule for generating the conference number is ${1}${yyMMdd}${four digits}. The first digit is the system environment identifier, which is used to distinguish multi-environment deployments (1-online environment, 2-test environment, etc.). The middle 6 digits are the year and date, followed by a 4-digit random number. According to this rule, the system environment identifier, the current year and date, and the multi-digit random number are used in order to generate the meeting number to be verified. The meeting number to be verified is compared with the meeting number of the historical virtual meeting. If the meeting number to be verified is consistent with the meeting number of one of the historical virtual meetings, a preset character is added to the last digit of the meeting number to be verified to generate the meeting number. If the meeting number to be verified is inconsistent with the meeting number of any historical virtual meeting, the meeting number to be verified is used as the meeting number. In this way, a unique meeting number can be obtained.

The business server requests the instant messaging server to create a group discussion group based on the conference number to obtain a virtual conference, and the virtual conference includes a group discussion group with a group code. The group discussion group is displayed in the virtual conference interface of the participant end in the form of a virtual communication room, and all participants participating in the target virtual conference can communicate through the virtual communication room (group discussion group).

When password verification is not required, the business server generates the meeting information of the virtual meeting based on at least one of the meeting number, meeting name, group code, meeting start time, meeting end time, meeting scenario ID and the maximum number of participants. When password verification is required, the business server generates the meeting information of the virtual meeting based on at least one of the meeting number, meeting name, meeting password, group code, meeting start time, meeting end time, meeting scenario ID and the maximum number of participants.

Finally, the business server stores the meeting information of the virtual meeting in the database. At the same time, the business server returns a successful meeting creation notification to the administrator.

In some embodiments, the processor of the server is further configured to:

Step 215: Start a scheduled scanning task, which is used to monitor the status of the virtual conference.

Step 216: In response to the scheduled scanning task scanning that the current time reaches the meeting start time, the state of the virtual meeting is set to an ongoing state, and meeting details information of the virtual meeting is generated based on the meeting information.

Step 217: Store the meeting details information of the virtual meeting in the cache server.

Wherein, when a password is required to join the meeting, the meeting details information includes at least one of the meeting name, meeting start time, meeting end time, meeting scenario ID, meeting number, group code and the maximum number of participants. Where a password is not required to join the meeting, the meeting details information includes at least one of the meeting name, meeting password, meeting start time, meeting end time, meeting scenario ID, meeting number, group code and the maximum number of participants.

Different virtual conferences have different meeting start times. In order to change the status of each virtual conference in a timely manner, the business server monitors through a scheduled scanning task.

If the scheduled scanning task scans to the current time but the meeting start time has not yet arrived, the status of the virtual meeting is set to the not started state; if the scheduled scanning task scans to the current time but the meeting start time has arrived, the status of the virtual meeting is set to the ongoing state; if the scheduled scanning task scans to the current time but the meeting end time has arrived, the status of the virtual meeting is set to the ended state.

For ongoing virtual conferences, in order to facilitate the participants to quickly obtain information about the virtual conference, the business server saves the meeting information of the ongoing virtual conference to the cache server to obtain meeting details. The cache server has the characteristic of fast response speed. Therefore, when the participant requests the business server to join the target virtual conference, the business server can quickly obtain the meeting details of the target virtual conference from the cache server and send it to the participant, which is more efficient.

S22. In response to the conference joining request carrying the conference joining request parameter sent by the display device, add the participant corresponding to the display device to the participant list corresponding to the virtual conference.

The participant list includes all participants who have joined the virtual conference, and all participants in the participant list are displayed in the form of virtual images in the virtual communication room corresponding to the virtual conference presented by the display device 200. At the same time, all participants who have joined the virtual conference are added to the group discussion group corresponding to the target virtual conference through the instant messaging server for communication.

Referring again to the sequence diagram of the participant joining the virtual conference shown in FIG6 and the interface diagram of the process of joining the target virtual conference through the conference password shown in FIG9, when the participant applies to join the target virtual conference in the virtual conference interface, The conference joining interface of the business server is called, and after the business server verifies the conference joining request parameters in the conference joining request, the participant is added to the target virtual conference.

When no password is required to join the meeting, the meeting request parameters include at least one of the user ID and the meeting number of the virtual meeting. When password verification is required to join the meeting, the meeting request parameters include at least one of the user ID, the joining password and the meeting number of the virtual meeting.

In some embodiments, the processor of the server is further configured to:

Step 221: In response to receiving the conference joining request, verify the conference joining request parameters carried in the conference joining request, where the conference joining request parameters also include a conference joining password.

Step 222: If the conference request parameter verification passes, the conference details of the virtual conference are obtained from the cache server based on the conference number, and it is verified whether the conference password generated by the participant is entered correctly.

Step 223: If the password generated by the participant is entered correctly, the participant is added to the participant list of the virtual meeting, and a successful joining notification and meeting details of the virtual meeting are sent to the participant's display device 200, so that the participant's display device 200 displays a corresponding virtual meeting interface based on the meeting details of the virtual meeting in response to the successful joining notification. The virtual meeting interface includes a virtual communication room and virtual images of all participants located in the virtual communication room.

The business server first checks whether the parameters of the conference request are legal. If not, it will not continue to respond to the conference request and the participant will not join the target virtual conference. If it is legal, the business server obtains the conference details of the target virtual conference from the cache server based on the conference number.

Next, the business server verifies whether the password entered by the participant is correct, that is, it compares the password with the meeting password set by the administrator when creating the virtual meeting. If the comparison is inconsistent, the password verification is wrong, the business server will not join the participant to the target virtual meeting, and return a notification of failed joining to the participant. If the comparison is consistent, the password verification is correct, the business server will join the participant to the target virtual meeting, and return the successful joining and meeting details to the participant. At the same time, the business server sends the current participant's joining notification to other participants who have also joined the target virtual meeting through the instant messaging server.

Referring again to FIG. 10 , a timing diagram for implementing range communication in a virtual communication room is shown. After the business server adds the participant to the participant list of the target virtual conference, the virtual image of the participant is displayed in the virtual conference interface of the participant. The business server obtains the location information of the participant in the virtual communication room and sends the location information to the cache server for storage. In order to facilitate other participant terminals to synchronously render the virtual image of the participant in their respective virtual conference interfaces, the business server obtains the location information of the participant from the cache server and generates the joining notification in combination with the user ID and user name.

The joining notification is generated by the business server based on the user identification, user name and location information corresponding to the participant. The other participant display device 200 responds to the joining notification, updates the local participant list of the other participant display device, and renders the virtual image of the participant in the virtual conference interface presented by the other participant display device 200.

The business server adds the participant to the participant list based on the participant's request and after verification, all participants corresponding to all participant terminals are displayed in the virtual communication room corresponding to the virtual conference presented by their respective display devices 200 in the form of virtual images. Each participant can communicate with other participants who meet the preset distance range based on the current position information of the virtual image of the main body in the virtual communication room. The content of the participant terminal implementing the range communication can refer to the corresponding content provided by the aforementioned display device 200 embodiment, which is not repeated here.

The embodiment of the present application provides a server, which responds to a creation request with creation request parameters sent by display device 200, creates a virtual conference based on the creation request parameters; responds to a conference request with conference request parameters sent by display device 200, adds the participant corresponding to display device 200 to the participant list (group discussion group) corresponding to the virtual conference, and the participant list (group discussion group) includes all participants who have joined the virtual conference. All participants in the participant list are displayed in the virtual communication room corresponding to the virtual conference presented by display device 200 in the form of virtual images, and each participant can communicate with the virtual communication room based on the current location information of the virtual image of the main body in the virtual communication room. Other participants who meet the preset distance range can communicate within the range, so that participants can communicate freely with other participants anywhere and at any time within a certain social range, providing a good user experience.

FIG19 shows another flow chart of a method for implementing a range communication in a virtual meeting executed by a server according to some embodiments. A server provided in an embodiment of the present application is applied to an instant messaging server, comprising: a processor, when executing the method for implementing a range communication in a virtual meeting shown in FIG19, the processor is configured to execute the following steps:

S31. In response to a conference participation request sent by a display device, a designated participant corresponding to the display device is added to a group discussion group corresponding to the target virtual conference.

The group discussion group includes all participants who join the target virtual conference. The designated participants refer to the current participants used in the display device embodiment and the business server embodiment.

Referring again to the sequence diagram of the participant joining the virtual conference shown in FIG6 , after the business server allows the designated participant to join the target virtual conference, the display device uses the group code to join the designated participant to the group discussion group corresponding to the target virtual conference through the instant messaging server. The process of the instant messaging server creating the group discussion group corresponding to the target virtual conference can refer to the content disclosed in the aforementioned business server embodiment, which will not be repeated here.

S32: Receive a communication message generated by a designated participant and sent by a display device, where the communication message carries a communication identifier.

Designated participants can communicate based on the virtual conference interface presented by the display device they use, and the communication methods may include range communication methods and full-field communication methods. Then, the communication message generated by the display device may carry a range communication identifier or a full-field communication identifier. Based on the communication message sent by the designated participant, the instant messaging server identifies the communication identifier type carried in the communication message, and sends the communication message to the corresponding other participant terminals based on different communication identifier types.

S33: If the communication identifier is a range communication identifier, the communication message generated by the designated participant is sent to at least one target participant terminal in the range communication discussion group having the same range communication identifier.

The range communication discussion group includes a designated participant and at least one target participant who is within a preset distance range from the designated participant.

Referring again to a timing diagram of implementing range communication in a virtual communication room shown in FIG10, if the instant messaging server recognizes the range communication identifier in the communication message sent by the display device, it means that the designated participant is a member of the range communication, and the communication message is a range communication message. Then, the instant messaging server sends the range communication message to other participant terminals in the same range communication discussion group as the designated participant, but not to the participant terminals that are not in the same range communication discussion group as the designated participant.

S34. If the communication identifier is a full-field communication identifier, the communication message generated by the designated participant is sent to all participant terminals of the group discussion group corresponding to the full-field communication identifier.

If the instant messaging server recognizes the full-field communication identifier in the communication message sent by the display device, it means that the designated participant is a member of the full-field communication and the communication message is a full-field communication message. Then, the instant messaging server sends the full-field communication message to all participants in the same group discussion group as the designated participant.

The implementation process of specifying the participant end to generate a range communication discussion group and generate communication messages carrying different communication identifiers can refer to the contents disclosed in the aforementioned display device embodiment and business server embodiment, which will not be repeated here.

In some embodiments, the business server and the instant messaging server can be two relatively independent servers, or the business server and the instant messaging server can be the same main server. The main server can implement the process of creating a virtual meeting, realizing conference communication, etc., which can refer to the contents disclosed in the above business server embodiment and instant messaging server embodiment, and will not be repeated here.

The embodiment of the present application provides a server, which responds to the conference participation request sent by the display device 200, adds the designated participant corresponding to the display device to the group discussion group corresponding to the target virtual conference, receives the communication message generated by the designated participant sent by the display device, and if the communication message carries a range communication identifier, sends the communication message to at least one target participant in the range communication discussion group with the same range communication identifier; if the communication message carries a full-field communication identifier, sends the communication message to all participant terminals of the group discussion group corresponding to the full-field communication identifier. It can be seen that the instant messaging server can implement communication messages based on different communication identifiers carried in the communication message. The information is sent to the corresponding participant end to realize the full-field communication and/or range communication of the participants, and to realize that within a certain social scope, the participants can communicate freely with other participants anywhere and at any time, and the user experience is good.

FIG5 shows a flow chart of a method for implementing a range communication in a virtual meeting performed by a display device according to some embodiments. As shown in FIG5 , the present application also provides a method for implementing a range communication in a virtual meeting, which is applied to a display device 200, and the method includes:

S11, receiving an operation of the current participant to join the target virtual conference, requesting the server to add the current participant to the group discussion group corresponding to the target virtual conference, and displaying the virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual images corresponding to all participants in the group discussion group, and the virtual images corresponding to all participants are displayed in the virtual communication room;

S12, based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image being the virtual image of the current participant, and the target virtual image being the virtual image of the target participant in the group discussion group;

S13, if there is at least one target virtual image within the preset distance range of the current virtual image, screening out the target participants corresponding to the current participant and the at least one target virtual image from the group discussion, and generating a range communication discussion group;

Figure 18 shows a flow chart of a method for implementing a range communication in a virtual meeting executed by a server according to some embodiments. As shown in Figure 18, the present application also provides a method for implementing a range communication in a virtual meeting, which is applied to a business server, and the method includes:

S21, in response to a creation request carrying creation request parameters sent by the display device, creating a virtual conference based on the creation request parameters, wherein the creation request parameters include at least one of a conference name, a conference start time, a conference end time, a conference scenario ID, and a maximum number of participants;

S22. In response to a conference request carrying conference request parameters sent by a display device, a participant corresponding to the display device is added to a participant list corresponding to the virtual conference, wherein the conference request parameters include at least one of a user identifier and a conference number of the virtual conference, and the participant list includes all participants who have joined the virtual conference. All participants in the participant list are displayed in the form of virtual images in a virtual communication room corresponding to the virtual conference presented by the display device, and each of the participants can communicate with other participants who meet a preset distance range based on the current position information of the virtual image of the entity in the virtual communication room.

Figure 19 shows another flow chart of a method for implementing a range communication in a virtual meeting executed by a server according to some embodiments. As shown in Figure 19, the present application also provides a method for implementing a range communication in a virtual meeting, which is applied to an instant messaging server, and the method includes:

S31, in response to a conference joining request sent by a display device, adding a designated participant corresponding to the display device to a group discussion group corresponding to a target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference;

S32, receiving a communication message generated by a designated participant and sent by the display device, wherein the communication message carries a communication identifier;

S33, if the communication identifier is a range communication identifier, sending the communication message generated by the designated participant to at least one target participant terminal in a range communication discussion group having the same range communication identifier, wherein the range communication discussion group includes the designated participant and at least one target participant that meets a preset distance range with the designated participant;

In a specific implementation, the present application also provides a computer non-volatile readable storage medium, wherein the computer The non-volatile readable storage medium may store a program, and when the program is executed, it may include some or all of the steps in each embodiment of the method for implementing range communication in a virtual meeting provided by the present application. The storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present application can essentially be embodied in the form of a software product, which can be stored in a computer non-volatile readable storage medium.

In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the implementation method embodiment of range communication in a virtual conference, since it is basically similar to the display device and server embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the display device and server embodiment.

In addition to the above embodiments, the present application also provides some other embodiments to realize that in the scenario of joint screen training between the terminal device and the display device, the display device sends performance parameters to the mobile terminal, and receives the training video data matched by the mobile terminal according to the performance parameters of the display device, so that the display device can play the training video and the training video normally under the performance of the current device, thereby preventing the video played by the display device from being stuck or stopped. The specific description is as follows:

FIG20 shows a hardware configuration block diagram of a display device 200 in an exemplary embodiment. As shown in FIG20 , the display device 200 includes: a tuner 210, a communication interface 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, etc. Among them, the processor 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input/output. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner 210 receives broadcast television signals by wired or wireless reception, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as and EPG data signals. The detector 230 is used to collect signals of the external environment or interact with the outside. The processor 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box.

In some embodiments, the processor 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The processor 250 controls the overall operation of the display device 200. The user can input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

An output interface (display 260 and/or audio output interface 270 ) configured to output user interaction information;

The communication interface 220 is used to communicate with the server 400 or other devices.

In some embodiments, the display 260 is configured to display a user interface; the processor 250 is configured to: obtain a training video identifier and a follow-up training page identifier; determine the follow-up training page data corresponding to the follow-up training page identifier, and obtain the corresponding training video data from the server according to the training video identifier; obtain the target performance parameters of the display device, the target performance parameters include: CPU occupancy rate, and/or memory occupancy rate; control the communication interface to send the target performance parameters to the mobile terminal; receive the follow-up training video data sent by the mobile terminal that matches the target performance parameters, the follow-up training video data includes: the target video data collected by the mobile terminal, and/or or, obtaining first human skeleton point information from the target video data; controlling the display 260 to display a follow-up practice page based on the follow-up practice page data, the training video data and the follow-up practice video data, wherein the follow-up practice page includes a first window and a second window, wherein the training video data is displayed in the first window, and the follow-up practice video data is displayed in the second window; a communication interface 220 is configured to send the target performance parameter to the mobile terminal; receiving the follow-up practice video data sent by the mobile terminal and matching the target performance parameter, wherein the follow-up practice video data includes: the target video data collected by the mobile terminal, and/or, obtaining The first human skeleton point information obtained.

In some embodiments, when the target performance parameter is less than or equal to the first preset performance parameter, the follow-up video data includes: the target video data collected by the mobile terminal, and, the first human skeleton point information obtained from the target video data, the processor 250 is further configured to: obtain second human skeleton point information from the training video data; generate evaluation information according to the matching parameters between the first human skeleton point information and the second human skeleton point information; and display the target video data and the evaluation information in the second window.

In some embodiments, when the target performance parameter is greater than a second preset performance parameter, the follow-up training video data includes: first human skeleton point information obtained from the target video data, excluding the target video data processor 250, and is also configured to: generate virtual follow-up training video data based on the first human skeleton point information, the virtual follow-up training video data including a virtual human follow-up training screen; and display the virtual follow-up training video data in the second window.

In some embodiments, the processor 250 is further configured to: obtain second human skeleton point information from the training video data; generate evaluation information based on matching parameters between the first human skeleton point information and the second human skeleton point information; and display the virtual follow-up video data and the evaluation information in the second window.

FIG21 shows a hardware configuration block diagram of a mobile terminal 300 in an exemplary embodiment. As shown in FIG21 , the mobile terminal 300 includes: a processor 110, a detector 120, a communication interface 130, a user input/output interface (also referred to as a user interface) 140, a display 150, and a memory, a power supply, etc. Among them, the communication interface 130 is used to communicate with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module. The user interface 140 includes at least one of a microphone, a speaker, a touchpad, a sensor, a camera or an alternative module. Among them, the display 150 is used to display a user interface.

As an optional implementation of the embodiment of the present application, the detector 120 is configured to: collect target video data; the processor 110 is configured to: control the communication interface to send follow-up video data matching the target performance parameters to the display device, the follow-up video data includes: the target video data collected by the mobile terminal, and/or, the first human skeleton point information obtained from the target video data; the communication interface 130 is configured to: receive the target performance parameters sent by the display device, the target performance parameters include: CPU occupancy rate, and/or, memory occupancy. As an optional implementation of the embodiment of the present application, the user interface 140 is configured to: receive the user's joint screen follow-up operation for the training video;

As an optional implementation of the embodiment of the present application, the processor 110 is configured to: when the target performance parameter is less than or equal to the first preset performance parameter, control the communication interface 130 to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device;

When the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, control the communication interface 130 to send the target video data collected by the mobile terminal to the display device without sending the first human skeleton point information; the second preset performance parameter is greater than the first preset performance parameter;

In the case where the target performance parameter is greater than the second preset performance parameter, the communication interface 130 is controlled to send the first human skeleton point information to the display device, and the target video data is not sent.

As an optional implementation of the embodiment of the present application, the processor 110 is further configured to: obtain the remaining power of the mobile terminal; control the communication interface 130 to send the follow-up video data matching the target performance parameters and the remaining power to the display device.

As an optional implementation of the embodiment of the present application, the processor 110 is configured to: when the target performance parameter is less than or equal to the first preset performance parameter, and the remaining power is greater than or equal to the first preset power parameter, control the communication interface 130 to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device;

When the target performance parameter is less than or equal to the second preset performance parameter and greater than or equal to the first preset performance parameter, and the remaining power is less than the first preset power parameter and greater than or equal to the second preset power parameter In the case of a number, controlling the communication interface 130 to send the target video data collected by the mobile terminal to the display device, and the second preset power parameter is less than the first preset power parameter;

When the target performance parameter is greater than the second preset performance parameter and the remaining power is less than the second preset power parameter, the communication interface 130 is controlled to send the first human skeleton point information to the display device.

As an optional implementation of an embodiment of the present application, the follow-up video data includes the first human skeleton point information and does not include the target video data collected by the mobile terminal. The processor 110 is also configured to: control the display screen to display the target video data, and control the brightness of the display screen to be greater than a first preset brightness.

The follow-up video data includes target video data collected by the mobile terminal, and the processor 110 is further configured to: control the brightness of the display screen to be less than or equal to a second preset brightness, or control the display screen to be off.

As shown in FIG. 22, FIG. 22 is a schematic diagram of the software configuration of the display device 200 or the mobile terminal 300 according to one or more embodiments of the present application. As shown in FIG. 22, the system is divided into four layers, from top to bottom, respectively, the application layer (Applications) (referred to as "application layer"), the application framework layer (Application Framework) (referred to as "framework layer"), the Android runtime (Android runtime) and the system library layer (referred to as "system runtime library layer"), and the kernel layer. The kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc. The display device, mobile terminal and page display method based on device performance provided in the embodiments of the present application can be implemented based on the above software configuration. Among them, the system can be an Android system.

As shown in Figure 23, a software interaction diagram of the mobile terminal and display device provided in the embodiment of the present application to implement the page display method based on device performance in the embodiment of the present application is shown. The application framework, system library layer and kernel layer in the mobile terminal can be collectively referred to as the Android system layer, which can be represented as a mobile terminal APP in Figure 23. The mobile terminal APP includes an APP application layer and a software development kit (Software Development Kit, SDK) layer, wherein the SDK layer includes a playback SDK and an interactive SDK, wherein the playback SDK encapsulates some common playback logic to decouple the upper-level application from the playback, the interactive SDK is responsible for the communication data transmission between the mobile terminal and the display device, and supports the mobile terminal to control the display device, the APP application layer is responsible for completing the user interface (User Interface, UI) display of the follow-up service in the mobile terminal and various interactive operations, and reading the system power from the Android system layer to obtain the power data of the mobile terminal. The application framework, system library layer and kernel layer in the display device can be collectively referred to as the display device platform layer (which is an android system customized based on the display device, which may be different from the android system of the mobile terminal). In the embodiment of the present application, the application layer can run an application (Application, APP) that provides multimedia resources in the display device, which is represented as a display device APP in FIG23. The display device APP includes an APP application layer and a software development kit (Software Development Kit, SDK) layer, wherein the SDK layer includes a playback SDK and an interactive SDK, wherein the playback SDK encapsulates some common playback logic to decouple the upper-layer application from the playback, the interactive SDK is responsible for the communication data transmission between the display device and the mobile terminal, and the APP application layer is responsible for completing the display of the user interface (User Interface, UI) of the follow-up training business on the display device. It can be seen that the interactive SDK in the APP application layer in the mobile terminal can read from the Android system layer and match the follow-up training video data of the mobile terminal according to the performance parameters of the display device, as well as the training video identification triggered by the user, to the interactive SDK in the APP application layer in the display device, so that the display device can display the follow-up training page based on these data after receiving them.

In order to explain the present solution in more detail, the following will be explained in an exemplary manner in conjunction with Figure 24. It can be understood that the steps involved in Figure 24 may include more steps, or fewer steps in actual implementation, and the order of these steps may also be different, so as to implement the page display method based on device performance provided in the embodiment of the present application.

As shown in FIG. 24, a process diagram of a page display method based on device performance provided in an embodiment of the present application is shown. It is intended that the method may include but is not limited to the following steps:

2401. The mobile terminal receives a user's screen-linked training operation for a training video.

The above training video may be a fitness video or a dance video, etc.

In an embodiment of the present application, the linked screen follow-up operation refers to an operation that triggers the display device to enter the linked screen follow-up mode. In the linked screen follow-up mode, the media resources selected in the media resource platform (an application that provides multimedia resources) can be played in the display device, and the follow-up video data can be obtained through the mobile terminal and played in the display device, wherein the display device is a device that is on the same WiFi network as the mobile terminal.

In some embodiments, the mobile terminal may be installed with an application that provides multimedia resources, and correspondingly, the display device may also be installed with the application that provides multimedia resources. The training video may be displayed on a page of the application.

The user can trigger a joint screen follow-up operation for the training video through an application that provides multimedia resources installed on the mobile terminal. In some embodiments, a joint screen follow-up details page for the training video can be set on the application, and after the user clicks the "Start" control on the page, the mobile terminal receives the user's joint screen follow-up operation for the training video.

In the embodiment of the present application, the mobile terminal and the display device can be connected through the same WiFi network.

2402. The mobile terminal determines a training video identifier and a training page identifier corresponding to the training video in response to the received linked-screen training operation.

In an embodiment of the present application, each multimedia resource can be set with an identifier, and the above-mentioned training video identifier (Video ID) is used to uniquely identify the above-mentioned training video.

The above-mentioned follow-up practice page identifier is used to indicate the follow-up practice page set based on the training video. The follow-up practice page identifier is a page number (Type Code), and the page number can indicate a follow-up practice playback mode page, wherein the follow-up practice playback mode page can be a full-screen follow-up practice playback mode page or a non-full-screen follow-up practice playback mode page.

In some embodiments, in response to the joint screen follow-up operation received by the user interface, the mobile terminal can determine the media ID corresponding to the training video in addition to the training video ID and the follow-up page ID corresponding to the training video. The media ID can indicate the media information corresponding to the training video, and the media information can include the title, poster and other media information of the training video.

In some embodiments, the mobile terminal may generate an operation instruction in response to the linked-screen training operation received by the user interface and send it to the display device. The operation instruction includes the above-mentioned training video identifier and the training page identifier.

In some embodiments, the operation instruction may include the training video identifier, the training page identifier and the media asset identifier. In some embodiments, the operation instruction may include the Video ID, Type Code, Media ID and the execution operation (Action).

Among them, Action is used to indicate the execution of page jump, jumping to the follow-up practice page corresponding to the training video.

In the case where the above-mentioned operation instruction includes the above-mentioned media resource identifier, after receiving the operation instruction, the display device can display some media resources of the training video while displaying the training video when displaying the follow-up training page.

2403. The mobile terminal sends the training video identifier and the follow-up training page identifier to the display device.

In some embodiments, when the mobile terminal sends the training video identifier and the follow-up training page identifier to the display device, the mobile terminal may send them to the display device together through the same message, or may send them to the display device separately.

In some embodiments, the display device may obtain a training video identifier and a follow-up training page identifier sent by a mobile terminal.

In some embodiments, the mobile terminal may first send the training video identifier, the follow-up practice page identifier, and the target video data collected by the mobile terminal to the display device, so that the display device first displays the follow-up practice page according to the training video identifier, the follow-up practice page identifier, and the target video data, and notifies the mobile terminal that the follow-up practice page is successfully displayed. After the mobile terminal receives the notification, the terminal device obtains the target performance data of the display device, and then sends the follow-up practice video data that matches the target performance parameters to the display device.

In some embodiments, the mobile terminal can also be used only as a camera. In this scenario, An application that provides multimedia resources can be installed. Correspondingly, the application that provides multimedia resources can also be installed on the display device. The above-mentioned training video can be displayed in the page of this application. In this scenario, the display device can receive the user's joint screen follow-up operation for the training video, and determine the training video identifier, follow-up page identifier and media asset identifier corresponding to the training video, generate a target QR code based on the training video identifier, follow-up page identifier and media asset identifier, and display the target QR code. After the mobile terminal scans the target QR code, it can trigger the mobile terminal to obtain the target video data through the camera, and send these target video data to the display device. The display device can determine the follow-up page data corresponding to the follow-up page identifier, obtain the corresponding training video data from the server according to the training video identifier, and display the follow-up page based on the follow-up page data, training video data and follow-up video data.

In some embodiments, the mobile terminal sends a follow-up training video, a training video identifier, a follow-up training page identifier, and battery data of the mobile terminal to the display device.

In an embodiment of the present application, the terminal device and the display device establish a data transmission channel through the above-mentioned same WiFi network, and realize the transmission of training video identification, follow-up page identification, target video data, and power data of the mobile terminal through the data transmission channel.

In some embodiments, the follow-up video data is continuous video stream data sent in real time, so that the display device can display the local video screen on the local image window, and the power data can be sent periodically at a predetermined time interval to reduce the load of the mobile device and the display device. The preset time interval can be 3 minutes, 5 minutes, etc., which is much longer than the time between two frames of the follow-up video.

In some embodiments, the local video captured by the mobile terminal can be directly transmitted to the display device without being displayed on the mobile terminal.

In some embodiments, after the video transmission connection is established, the mobile terminal turns off the screen and enables the application that provides multimedia resources (such as a fitness APP) to work in the background, so as to reduce the power consumption of the mobile terminal while achieving local video capture and transmission.

In some embodiments, the transmission of the local video captured by the mobile terminal (i.e., the transmission of the above-mentioned target video data) and the transmission of the power data are two different transmission channels. For example, video transmission requires encoding and transmitting the video data according to the video format protocol, and the power data can be sent to the display device in the form of a broadcast message.

2404. The display device determines the follow-up practice page data corresponding to the follow-up practice page identifier, and obtains the corresponding training video data from the server according to the training video identifier.

The server can store various multimedia data corresponding to the multimedia resources in the application. The display device can determine the follow-up practice page data in the server according to the follow-up practice page identifier, and obtain the corresponding training video data from the server according to the video identifier.

In some embodiments, the display device may first determine the follow-up practice page data corresponding to the follow-up practice page identifier, and then obtain the corresponding training video data from the server according to the training video identifier, or the display device may first obtain the corresponding training video data from the server according to the training video identifier, and then determine the follow-up practice page data corresponding to the follow-up practice page identifier, or the display device may simultaneously perform the steps of determining the follow-up practice page data corresponding to the follow-up practice page identifier, and obtaining the corresponding training video data from the server according to the training video identifier, which is not limited in the embodiments of the present application. In some embodiments, determining the follow-up practice page data corresponding to the follow-up practice page identifier may include: different page identifiers are set for different pages, and after obtaining the follow-up practice page identifier (Type code), the display device may obtain the follow-up practice page data of the follow-up practice page set corresponding to the Type code, and the follow-up practice page data may include the format information of the follow-up practice page (for example, color, page size, window size in the page, window position, etc.), layout information of the follow-up practice page, etc. Among them, the layout information of the follow-up practice page may indicate the data source corresponding to the first window and the second window. In the embodiment of the present application, it may indicate that the first window is used to display the training video data obtained from the server, and the second window is used to display the follow-up practice video data. After obtaining the follow-up training page data, it can also be combined with the follow-up training video data obtained from the mobile terminal.

In some embodiments, in the case where the mobile terminal triggers the display device to display the follow-up training page, when the mobile terminal sends the follow-up training video data to the display device, the display device preferentially selects the follow-up training video data sent by the mobile terminal. The video data is displayed in the second window. If the display device does not receive the follow-up video data sent by the mobile terminal, the camera of the display device can be turned on to obtain the follow-up video data and display it in the second window.

Exemplarily, the situation in which a mobile terminal triggers a display device to display a follow-up practice page may include: for example, the mobile terminal receives a user's linked screen follow-up practice operation for a training video, and in response to the received linked screen follow-up practice operation, the mobile terminal collects follow-up practice video data and sends it to the display device; for another example, the display device may receive a user's linked screen follow-up practice operation for a training video, and determine the training video identifier, follow-up practice page identifier and media asset identifier corresponding to the training video, generate a target QR code based on the training video identifier, follow-up practice page identifier and media asset identifier, and display the target QR code. After the mobile terminal scans the target QR code, the mobile terminal may be triggered to obtain the follow-up practice video data through a camera, and send these follow-up practice video data to the display device.

In some embodiments, obtaining corresponding training video data from a server according to a training video identifier may include: different video identifiers and different video data are correspondingly stored in the server. After obtaining the training video identifier, the server can determine whether the training video identifier exists from the stored video identifiers. If so, further obtain the training video data stored corresponding to the training video identifier.

In some embodiments, the corresponding training video data can also be obtained from the server in combination with the media asset identifier and the training video identifier corresponding to the training video. The server also stores different media asset identifiers and media asset information in correspondence. The media asset information includes media information (for example, titles, posters and other media information) and multiple video data. After the server obtains the media asset identifier corresponding to the training video, it can first determine whether the media asset identifier corresponding to the training video exists in the stored media asset identifiers. If so, it can further determine the video data stored corresponding to the training video identifier from multiple video data as the training video data based on the training video identifier.

2405. The display device obtains target performance parameters.

The target performance parameters include: CPU occupancy rate, and/or memory occupancy rate. Among them, CPU is the abbreviation of Central Processing Unit. The central processing unit is a very large-scale integrated circuit, which is the computing core and control core of a computer. Its main function is to interpret computer instructions and process data in computer software. The central processing unit mainly includes an arithmetic unit and a cache memory and a data, control and status bus that realizes the connection between them. It is collectively called the three core components of an electronic computer together with the internal memory and input/output devices. The CPU relies on instructions from the calculation and control system. Each CPU specifies a series of instruction systems that match its hardware circuits when it is designed. The strength of instructions is also an important indicator of the CPU. The instruction set is one of the most effective tools to improve the efficiency of the microprocessor.

Memory is an important part of the computer, also known as internal memory and main memory. It is used to temporarily store the calculation data in the CPU and the data exchanged with external memory such as the hard disk. It is a bridge for the external memory to communicate with the CPU. All programs in the computer are run in the memory. The strength of the memory performance affects the overall performance of the computer. As long as the computer starts running, the operating system will transfer the data to be calculated from the memory to the CPU for calculation. When the calculation is completed, the CPU will transmit the result. The operation of the memory determines the overall operation speed of the computer. The memory bar is composed of memory chips, circuit boards, gold fingers and other parts.

In some embodiments, the display device obtains performance parameters based on the retrieval command (getprop) and the system grabber command (dumpsys) in the Android system, wherein the principle of the getprop command is very simple, that is, to read the configuration information and performance information in the file from various configuration files of the system. When the Android system is started, a large number of services will be started, so we can use the dumpsys command to view the operation status of each service, and determine the performance parameters of the display device according to the operation status of each service.

2406. The display device sends the target performance parameter to the mobile terminal.

In some embodiments, the display device obtains performance data once every preset collection time and sends it back to the mobile terminal. When the mobile terminal detects a change in the battery level or performance status of the display device, it dynamically adjusts the follow-up video data sent to the display device. The preset collection time can be 5s or 10s, which is not limited in the embodiments of the present application. The value of the preset collection time can be determined according to actual needs.

2407. The mobile terminal receives the target performance parameters sent by the display device.

2408. The mobile terminal sends the follow-up video data matching the target performance parameters to the display device.

In some embodiments, the mobile terminal determines the follow-up video data matching the target performance parameters according to the target performance parameters. In one case, the follow-up video data includes: the target video data collected by the mobile terminal and the first human skeleton point information obtained from the target video data; in another case, the follow-up video data includes: the target video data collected by the mobile terminal, and in another case, the follow-up video data includes: the first human skeleton point information obtained from the target video data.

In some embodiments, when the target performance parameter is less than or equal to the first preset performance parameter, it indicates that the current performance of the display device is relatively high. At this time, the control communication interface sends the target video data collected by the mobile terminal and the first human skeleton point information to the display device.

The first preset parameter is a performance threshold value configured for the mobile terminal, and the first preset performance parameter includes a preset CPU occupancy parameter and a memory occupancy parameter.

For example, if the first preset parameters set by the mobile terminal show that the CPU occupancy is 40% and the memory occupancy is 400MB, and the target performance parameters received by the mobile terminal show that the CPU occupancy is 30% and the memory occupancy is 300MB, it can be seen by comparison that the target performance parameters are less than the first preset performance parameters. At this time, the mobile terminal sends the target video and the first human skeleton point information to the display device.

In the above embodiment, when the target performance parameter is less than the first preset parameter, it means that the performance of the current display device is relatively high. At this time, the display device can normally display the follow-up video data containing a large amount of data information. Then the follow-up video data that matches the target performance parameter includes: target video data and the first human skeleton point information. In this way, while ensuring that the video picture played by the display device will not be stuck or stopped during the linked screen follow-up process, the integrity of the video picture can be guaranteed to the greatest extent. That is to say, in the subsequent linked screen follow-up page process, the picture generated based on the target video data can be played, and the picture generated based on the first human skeleton point information can also be played.

In some embodiments, when the target performance parameter is less than or equal to a second preset performance parameter and greater than a first preset performance parameter, the communication interface is controlled to send the target video data collected by the mobile terminal to the display device; wherein the second preset performance parameter is greater than the first preset performance parameter.

For example, if the second preset performance parameters set by the mobile terminal include a CPU occupancy of 50% and a memory occupancy of 500MB, and the target performance parameters received by the mobile terminal include a CPU occupancy of 45% and a memory occupancy of 450MB, it can be seen by comparison that at this time the target performance parameters are less than or equal to the second preset performance parameters, and the mobile terminal sends the target video data to the display device.

In the above embodiment, when the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, it means that the performance of the current display device is relatively medium. At this time, the display device can normally display the follow-up video data containing a large amount of data information, and the follow-up video data matching the target performance parameter includes: target video data. In this way, while ensuring that the video screen played by the display device will not freeze or stop during the joint screen follow-up training, the integrity of the video screen can also be guaranteed to the greatest extent.

In some embodiments, when the target performance parameter is greater than the second preset performance parameter, the communication interface is controlled to send the first human skeleton point information to the display device.

For example, if the third preset performance parameters set by the mobile terminal include a CPU occupancy rate of 60% and a memory occupancy rate of 600MB, and the target performance parameters received by the mobile terminal include a CPU occupancy rate of 85% and a memory occupancy rate of 700MB, it can be seen by comparison that the target performance parameters are greater than the third preset performance parameters. At this time, it can be considered that the performance of the display device is low, and the mobile terminal only sends the first human skeleton point information to the display device.

At this time, the display device can normally display the follow-up video data containing less data information, and the follow-up video data matching the target performance parameter includes: the first human skeleton point information. In this way, the integrity of the video image can be guaranteed to the greatest extent while ensuring that the video image played by the display device will not freeze or stop during the joint screen follow-up process.

In the above embodiment, when the target performance parameter is greater than the second preset performance parameter, it can be said that the current display device performance is insufficient. At this time, the display device can normally display the follow-up video data containing less data information. Then the follow-up video data matching the target performance parameter includes: the first human skeleton point information. In this way, the connection is ensured. During screen follow-up training, when the display device performance is insufficient, the video played by the display device will not be stuck or stopped.

In some embodiments, before sending the follow-up video data to the display device, the mobile terminal will also obtain the remaining power of the mobile terminal. The mobile terminal matches the follow-up video data according to the remaining power of the mobile terminal and the target performance parameters of the display device and sends it to the display device.

In some embodiments, the mobile terminal can obtain the power data of the mobile terminal through the battery management module (Battery Manager) in the Android system layer. The power data may include the remaining power and the remaining power percentage or the remaining power percentage. For example, the remaining power can be expressed as: 1000mA remaining power, and the remaining power percentage can be expressed as: 20% remaining power.

In some embodiments, when the target performance parameter is less than or equal to the first preset performance parameter and the remaining power of the mobile terminal is greater than or equal to the preset first power parameter, the communication interface is controlled to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device.

The first preset power parameter may be expressed as a percentage, such as 20%, which is not limited in the embodiment of the present application. The value of the first preset power parameter may be determined according to actual needs.

That is to say, in the above situation, it can be considered that the display device has high performance and the mobile phone has sufficient power, which means that the display device can receive follow-up video data containing a large amount of information. At this time, the mobile terminal can determine the follow-up video data to be sent to the display device based on the performance parameters of the current display device and the remaining power of the mobile terminal. The follow-up video data that matches the target performance parameters includes: target video data collected by the mobile terminal, and the first human skeleton point information. In this way, while ensuring that the video screen played by the display device will not be stuck or stopped during the joint-screen follow-up training process, the integrity of the video screen can be guaranteed to the greatest extent. That is to say, in the subsequent joint-screen follow-up page process, the screen generated based on the target video data can be played, and the screen generated based on the first human skeleton point information can also be played.

In some embodiments, when the target performance parameter is less than or equal to the second preset performance parameter, and the target performance parameter is greater than or equal to the first preset performance parameter, and the remaining power of the mobile terminal is greater than or equal to the second preset power parameter, the communication interface is controlled to send the target video data collected by the mobile terminal to the display device, wherein the second preset power parameter is less than the first preset power parameter.

That is to say, in the above case, it can be considered that the display device has medium performance and the mobile terminal has relatively sufficient power. The mobile terminal can determine the follow-up video data to be sent to the display device based on the current performance parameters of the display device and the power of the mobile terminal. At this time, the follow-up video data that matches the target performance parameters includes: target video data. This ensures that during the joint screen follow-up process, the display device receives the follow-up video data and displays the follow-up video data normally under the current performance parameters.

In some embodiments, when the target performance parameter is greater than a third preset performance parameter and the remaining power of the mobile terminal is less than or equal to a second preset power parameter, the communication interface is controlled to send the first human skeleton point information to the display device.

That is to say, in the above situation, it can be considered that the remaining power of the mobile terminal is insufficient and the performance of the display device is low. The mobile terminal can determine the follow-up video data to be sent to the display device based on the performance parameters of the current display device and the power of the mobile terminal. At this time, the follow-up video data only includes: the first human skeleton point information obtained from the target video data. The display device receives the follow-up video data and displays the follow-up video data normally under the current performance parameters. Thereby, the display device will not stop or freeze during the video playback process.

In some embodiments, when the follow-up video data sent by the mobile terminal to the display device only includes the first human skeleton point information and does not include the target video data collected by the mobile terminal, the display screen of the mobile terminal displays the target video data and controls the brightness of the display screen to be greater than the first preset brightness, wherein the first preset brightness is a screen brightness parameter set by the mobile terminal, and the embodiment of the present application is not limited thereto, and the value of the first preset brightness can be set and determined according to actual needs. In other words, when the target follow-up video data received by the display device only includes the human skeleton point information, the display device follow-up page displays the virtual person follow-up picture, the mobile terminal adjusts the screen brightness, and the user can watch the real person follow-up picture taken by the camera on the display screen of the mobile terminal.

In some embodiments, when the follow-up video data sent by the mobile terminal to the display device includes the target video data collected by the mobile terminal, the mobile terminal controls the brightness of the display screen to be less than or equal to the second preset brightness, or controls the display screen of the mobile terminal to be turned off, wherein the first preset brightness is greater than the second preset brightness. That is, in this case, the display device follow-up page displays the real person follow-up video data, the user watches the real person follow-up screen on the display device, and the mobile terminal reduces the screen brightness or turns off the screen to save power.

2409. The display device receives the follow-up training video data matching the target performance parameters sent by the mobile terminal.

In some embodiments, the follow-up video data includes target video data collected by the mobile terminal, and/or first human skeleton point information obtained from the target video data.

In some embodiments, when the follow-up video data received by the display device is obtained from the target video data and the first human skeleton point information, the display device generates real-person follow-up video data based on the target video data and the first human skeleton point information, wherein the real-person video data includes: the real-person follow-up picture taken by the camera and the evaluation information of the follow-up.

In some embodiments, when the follow-up video data received by the display device is target video data, the display device generates real-person follow-up video data based on the target video data, wherein the real-person follow-up video data is a real-person follow-up picture taken by a camera of a mobile terminal.

In some embodiments, when the follow-up video data received by the display device is first human skeleton point information obtained from the target video data, the display device generates virtual follow-up video data based on the first human skeleton point information, wherein the virtual follow-up video data includes a virtual human follow-up screen.

2410. The display device displays the follow-up practice page based on the follow-up practice page data, the training video data, and the follow-up practice video data.

The follow-up practice page includes a first window and a second window, the first window displays the training video data, and the second window displays the follow-up practice video data.

In some embodiments, the display device can first draw the frame part of the follow-up practice page according to the follow-up practice page data, the training video data and the follow-up practice video data in the process of displaying the follow-up practice page, including drawing the first window and the second window in the follow-up practice page, and then drawing the training video data in the first window, and drawing the follow-up practice video data in the second window, so that the complete follow-up practice page can be displayed. It should be noted that the training video data displayed in the first window of the follow-up practice page can be updated with the playback progress of the training video, and the content displayed in the second window of the follow-up practice page can be updated according to the follow-up practice video data obtained from the terminal device in real time. In other words, the display device needs to render the follow-up practice page in real time based on the follow-up practice page data, the training video data and the follow-up practice video data, and display the follow-up practice page.

In the above embodiment, the display device sends the target performance parameters to the mobile terminal, and receives the follow-up video data matched by the mobile terminal according to the target performance parameters, and determines whether the type of the follow-up video data is real-person follow-up video data or virtual follow-up video data based on the obtained follow-up video data, and the display device dynamically adjusts the follow-up screen based on the type of the follow-up video data, so that in the scenario of joint screen follow-up, when the received follow-up video data changes from real-person follow-up video data to virtual-person follow-up video data, at this time, the display device performance is insufficient, and the display device follow-up screen is dynamically switched from the real-person follow-up screen to the virtual-person follow-up screen, and when the received follow-up video data changes from virtual-person follow-up video data to real-person follow-up video data, at this time, the display device performance is high, and the display device follow-up screen is switched from the virtual-person follow-up screen to the real-person follow-up screen. Thereby, the display device can play the training video and the follow-up video at the same time, and prevent the occurrence of freezes or stops during the follow-up.

In some embodiments, after the mobile terminal obtains the target performance parameters of the display device, the application layer of the mobile terminal matches the follow-up video data with the target performance parameters according to the target performance parameters, and sends the follow-up data to the display device, while controlling the display of the screen brightness of the mobile terminal.

Exemplarily, an embodiment of the present application provides a method for displaying a page based on device performance, as shown in FIG. 25 , wherein the steps of the method include but are not limited to the following steps:

701. The mobile terminal receives a user's screen-joint training operation for a training video.

702. The mobile terminal determines the training video identifier and the training video corresponding to the training video in response to the received joint screen training operation. Follow-up practice page logo.

703. The mobile terminal sends the training video identifier and the follow-up training page identifier to the display device.

704. The display device determines the follow-up practice page data corresponding to the follow-up practice page identifier, and obtains the corresponding training video data from the server according to the training video identifier.

705. The display device obtains the target performance parameter.

706. The display device sends the target performance parameter to the mobile terminal.

707. The mobile terminal receives the target performance parameter sent by the display device.

For the description of the above steps 701 to 708, please refer to steps 2401 to 2408 in Figure 24, which will not be repeated here.

708. The mobile terminal determines the performance of the display device according to the target performance parameter.

In some embodiments, the mobile terminal may determine the performance level corresponding to the performance of the display device according to the target performance parameters of the display device, for example, high level, medium level, or low level.

Exemplarily, when the target performance parameter is less than or equal to the first preset performance parameter, and the mobile terminal sends the target video data collected by the mobile terminal and the first human skeleton point information to the display device, the corresponding performance level of the display device is advanced.

Exemplarily, when the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, the mobile terminal sends the target video data collected by the mobile terminal to the display device; when the second preset performance parameter is greater than the first preset performance parameter, the corresponding performance of the display device is intermediate.

Exemplarily, when the target performance parameter is greater than the second preset performance parameter, when the mobile terminal sends the first human skeleton point information to the display device, the corresponding performance of the display device is low.

709. The mobile terminal sends the target video data and the first human skeleton point information data to the display device.

In some embodiments, when the performance of the display device is determined to be advanced, the mobile terminal sends follow-up video data that matches the target parameters to the display device, that is, executes: Step S713: the display device receives the follow-up video data that matches the target performance parameters sent by the mobile terminal; and, Step S714: the display device displays the tracking page based on the tracking page data, training video data and tracking video data.

The training video data includes: target video data and first human skeleton point information data. The determination of the training video data can refer to the above step 2408, which will not be repeated here. After the mobile terminal sends the training video data matching the target parameters, step 712a is executed to reduce the screen brightness of the mobile terminal, thereby saving the power of the mobile terminal.

710. The mobile terminal sends target video data to the display device.

In some embodiments, when the performance of the display device is determined to be intermediate, the mobile terminal sends follow-up video data that matches the target parameters to the display device, that is, executes: Step S713: the display device receives the follow-up video data that matches the target performance parameters sent by the mobile terminal; and, Step S714: the display device displays the tracking page based on the tracking page data, training video data and tracking video data.

The follow-up video data includes: target video data. The determination of the follow-up video data refers to the above step 2408, which will not be repeated here.

711. The mobile terminal sends the first human skeleton point information to the display device.

In some embodiments, when the performance of the display device is determined to be low, the mobile terminal sends follow-up video data that matches the target parameters to the display device, that is, executes: step S713: the display device receives the follow-up video data that matches the target performance parameters sent by the mobile terminal; and step S714: the display device displays the tracking page based on the tracking page data, training video data and tracking video data.

Among them, the follow-up video data is the first human skeleton point information. For the determination of the follow-up video data, refer to the above step 2408 and will not be repeated here.

712. Determine the battery level of the mobile terminal.

In some embodiments, when the display device performance is determined to be intermediate, after the mobile terminal launches the training video data matching the target parameters, the power level of the mobile terminal is determined. When the remaining power of the mobile terminal is sufficient, Execute step 712b to control the screen of the mobile terminal to be always on. When the remaining power of the mobile terminal is insufficient, execute step 712a to control the mobile terminal to reduce the screen brightness, thereby saving power of the mobile terminal.

712a. Reduce the screen brightness of the mobile terminal.

712b. Control the mobile terminal screen to remain on.

In the above embodiment, the screen brightness of the mobile terminal is intelligently controlled according to the power of the mobile terminal and the performance of the display device, thereby realizing intelligent control of the mobile terminal screen, ensuring that when the follow-up video screen generated by the display device based on the first skeleton point information is a virtual person follow-up screen, the real person follow-up screen can be viewed through the mobile terminal, and when the follow-up screen in the follow-up window of the display device is a real person follow-up screen, the screen brightness of the mobile terminal is reduced, thereby saving power of the mobile terminal.

In some embodiments, after obtaining the corresponding training video data from the server according to the training video identifier, the second human skeleton point information is obtained from the training video screen. The display device generates evaluation information according to the matching parameters between the first human skeleton point information and the second human skeleton point information; wherein the evaluation information is used to evaluate the matching degree between the follow-up action and the character action in the training video, and the evaluation information can be a special effect or a percentage of the matching degree parameter, wherein the matching parameter can be expressed in percentage, and when the matching parameter between the character action in the training video data and the character action in the follow-up video is 90%, it can be considered that the follow-up action is standard, and the evaluation information is displayed in the second window of the follow-up video page.

In the above embodiment, through the interaction between the mobile terminal and the display device, when the follow-up practice page is displayed, the user can watch the displayed training video data and practice, and the mobile terminal will continue to collect the follow-up practice video data of the user and transmit it to the display device. The display device will display the follow-up practice video data and the training video data together in the display of the display device through different windows, so that the user can compare the training movements in the follow-up practice video data and the training video data, which is convenient for the user to correct the movements.

As shown in Figure 26, a schematic diagram of a skeleton point composition graph provided in an embodiment of the present application. The degree of matching in terms of the similarity of the skeleton points. As shown in Figure 26, assuming that the first human skeleton point information includes: head skeleton point 81, right arm and shoulder connection skeleton point 82, left arm and shoulder connection skeleton point 83, these three human skeleton points can form a triangle after being connected, and the second human skeleton point information includes: head skeleton point 84, right arm and shoulder connection skeleton point 85, left arm and shoulder connection skeleton point 86, these three human skeleton points can form another triangle after being connected, and the similarity of these two triangles can be calculated as a matching parameter. Exemplarily, Figure 26 is illustrated by taking the calculated similarity of 75% as an example, and the "75% accuracy" is displayed in the follow-up practice page as shown in Figure 26 80, to notify the user that the current follow-up action matches the standard action in the training video data by 75%.

In the above embodiment, the display device determines the matching parameters of the first human skeleton point information and the second human skeleton point information, and outputs the matching parameters, so that the user who is following the training can view the matching parameters on the screen of the display device, so as to know the degree of matching between himself and the standard movements in the training video data during the following training, thereby improving the human-computer interaction performance during the following training process.

As shown in Figure 27, a schematic diagram of a scene for displaying a follow-up practice page is provided in an embodiment of the present application. In Figure 27, the mobile terminal 92 collects the follow-up practice video data and sends it to the display device 91. After the display device 91 determines the follow-up practice page data and the training video data according to the training video identifier and the follow-up practice page identifier sent by the mobile terminal, the display device 91 can display the follow-up practice page on the display screen of the display device 91. The follow-up practice page includes two windows, one of which displays the training video data 911, and the other window displays the follow-up practice page data 912.

As shown in Figure 28, a scene schematic diagram of a virtual human practice screen is provided in an embodiment of the present application. In Figure 28, when the video practice data received by the display device is the first skeletal point information obtained from the target video collected by the mobile terminal, the performance of the display device is low at this time. The practice video in the second window of the practice page is a virtual human practice screen generated based on the first skeletal point information. At this time, the screen brightness can be increased on the mobile terminal to view the real person practice screen on the mobile terminal interface. The display device generates evaluation information based on the matching parameters between the first human skeletal point information and the second human skeletal point information. In Figure 28, the title bar 1001 is used to illustrate the video content of the current joint screen practice, the training video window 1002 is used to display the training video data, the practice video window 1003 is used to play the practice video data and the practice evaluation effects, and the prompt window 1004 is used to switch from the real person practice screen to the virtual The user is prompted when the human training screen appears, and the prompt message is "The current device performance is insufficient, and it has automatically switched to a virtual human for training."

In some embodiments, when the mobile terminal has sufficient power and the display device performance changes from low to high, the follow-up video data sent by the mobile terminal is switched from the first skeleton point information data to the target video data and the first human skeleton point information, and the follow-up data in the display device follow-up window is converted from virtual follow-up video data to real person follow-up video data. At this time, the follow-up screen of the display device is switched from the virtual person follow-up screen to the real person follow-up screen, and the user is prompted according to the content of the follow-up video switch. Exemplary, as shown in Figure 29, a prompt scene schematic diagram of a follow-up page, in which the title bar 1101 is used to explain the video content of the current joint screen follow-up, the training video window 1102 is used to display the training video data, the follow-up video window 1103 is used to play the follow-up video data and the evaluation effects of the follow-up, and the prompt window 1104 is used to prompt the user when the virtual person follow-up screen is switched to the real person follow-up screen, and the prompt information is "The current power is sufficient, and it has been automatically switched to real person follow-up for you". Among them, the prompt window can be manually clicked to cancel or automatically canceled after the preset prompt countdown based on the display device. Among them, the preset prompt countdown can be 10s. The embodiment is not limited thereto, and the value of the preset reminder countdown can be set and determined according to actual needs.

For example, assuming that the mobile terminal is a mobile phone and the display device is a television (television set), when interacting based on the software interaction diagram shown in Figure 23, it involves the interaction between the mobile phone application layer, the mobile phone interactive SDK, the television application layer and the television interactive SDK. The following is based on the interaction between the mobile phone application layer, the mobile phone interactive SDK, the television application layer and the television interactive SDK to illustrate the page display method based on device performance provided in an embodiment of the present application.

Figure 30 is an interactive schematic diagram of a page display method based on device performance provided by an embodiment of the present application. The method includes but is not limited to the following steps:

1. The mobile phone receives the user's click operation on the mobile APP to enter the linked screen fitness details page and initiates linked screen fitness.

In this embodiment, a fitness training scenario is used as an example for explanation. The mobile application layer and mobile interactive SDK are set for mobile APPs, and the TV application layer and TV interactive SDK are set for TV APPs.

2. After the mobile APP receives the user's operation, it notifies the mobile application layer (i.e. APP application layer). The mobile application layer calls the Send Data interface provided by the mobile interaction SDK to send the operation instruction to the mobile interaction SDK.

3. The mobile phone interactive SDK transmits operation instructions to the TV interactive SDK.

The content of the operation instruction includes: the above-mentioned Media ID, Video Id, Type Code (page number-full screen practice playback mode page), and Action (execute operation-page jump).

4. The TV interactive SDK transmits operation instructions to the TV application layer.

5. The application layer on the TV side receives the operation instruction and opens the practice page. At the same time, it collects target performance parameters such as the CPU occupancy rate and memory occupancy rate of the TV side at preset collection time intervals.

6. The TV application layer continuously transmits the target performance parameters to the TV interactive SDK. The phone interactive SDK receives the target performance parameters and transmits them to the mobile phone interactive SDK.

8. After receiving the target performance parameters, the mobile interactive SDK continuously transmits the target performance parameters back to the mobile application layer.

9. The mobile phone application layer collects the target video data captured by the camera and obtains the first human skeleton point information in the target video data.

10. The mobile application layer obtains the remaining power of the current mobile device through the Android battery management module.

11. The mobile application layer determines the performance of the TV device based on the target performance parameters received from the mobile interactive SDK layer.

12. After determining the performance of the TV, the mobile application layer intelligently adjusts the screen brightness of the mobile phone according to the remaining power of the mobile phone and/or the performance of the TV.

For the description of the above steps 9 to 12, please refer to steps 708 to 712, which will not be repeated here.

13. The mobile application layer determines the training video that matches the target performance parameters based on the target performance parameters and the mobile phone power. The training data can be collected and transmitted to the mobile interactive SDK in real time.

14. After the mobile interactive SDK receives the follow-up video data sent by the mobile application layer, it transmits the follow-up data to the TV interactive SDK in real time.

15. The TV interactive SDK receives the practice video data sent by the mobile interactive SDK, and determines whether to practice with a real person or a virtual person based on the type of the practice video data.

Among them, when the follow-up video data is data containing target video data and the first human skeleton point information collected by the mobile phone camera, or when the follow-up video data only contains target video data collected by the mobile phone camera, the follow-up mode is real-person follow-up; when the follow-up video data only contains the first human skeleton point information, the follow-up mode is virtual-human follow-up.

In some embodiments, when the follow-up training mode is real-person follow-up training, the mobile phone transmits the target video data and the first human skeleton point information to the TV end. The mobile phone encodes the target video data and transmits it to the TV end. The TV end needs to re-decode the target video data transmitted by the mobile phone and draw the target video data on the display. At this time, the CPU occupancy rate and memory occupancy of the TV end are relatively high.

In some embodiments, when the training mode is virtual human training, the mobile phone only transmits the first human skeleton point information to the TV end, and the TV end does not decode the target video data. It only draws a stickman image on the display based on the first human skeleton point information, and the drawing area is smaller than the target video data. At this time, the CPU occupancy rate and memory occupancy of the TV end are small. At the same time, compared with real-person training, virtual human training can reduce more than 90% of data transmission, and reduces the logic of encoding and transmitting target video data to the TV, which can reduce the power consumption of the mobile phone.

16. The TV application layer receives the practice mode command sent by the TV interactive SDK in real time, and displays the corresponding practice screen on the practice page according to the practice mode command, and prompts the user when the practice mode is switched.

In the above embodiment, in the scenario of joint screen follow-up training, the display device sends the target performance parameters to the mobile terminal and receives the follow-up training video data that matches the target performance parameters sent by the mobile terminal, so that the display device can play the training video and the follow-up training video normally under the performance of the current device, thereby preventing the video played by the display device from being stuck or stopped. Furthermore, during the follow-up training process, the mobile terminal intelligently adjusts the screen brightness to save mobile phone power. And the mobile terminal sends different follow-up training video data according to the performance of the display device, so that the display device can display different follow-up training pictures on the follow-up training page based on the received follow-up training video data that matches the target performance parameters under the current performance.

An embodiment of the present application provides a computer non-volatile readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the page display method based on device performance executed by the above-mentioned mobile terminal are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

An embodiment of the present application provides a computer non-volatile readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the page display method based on device performance executed by the above-mentioned display device are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

Among them, the computer non-volatile readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program runs on a computer, the computer implements the various processes of the page display method based on device performance executed by the above-mentioned mobile terminal, or implements the various processes of the page display method based on device performance executed by the above-mentioned display device.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the content of the embodiments of the present application, so that those skilled in the art can better use the embodiments.

Claims

A display device, comprising:

a display configured to display an image and/or a user interface;

a memory configured to store computer instructions and data associated with said display;

at least one processor connected to the display and the memory, the processor being configured to execute computer instructions to cause the display device to:

Receive an operation of the current participant joining the target virtual conference, request the server to add the current participant to the group discussion group corresponding to the target virtual conference, and display the virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual images corresponding to all participants in the group discussion group, and the virtual images corresponding to all participants are displayed in the virtual communication room;

Based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image being the virtual image of the current participant, and the target virtual image being the virtual image of the target participant in the group discussion group;

If there is at least one target virtual image within the preset distance range of the current virtual image, the target participants corresponding to the current participant and the at least one target virtual image are screened out from the group discussion, and a range communication discussion group is generated;

Receive the communication message generated by the current participant, and send the communication message to each target participant terminal in the range communication discussion group.
The display device according to claim 1, wherein the processor is further configured to execute computer instructions so that the display device:

Adding the current participant in the group discussion and the target participant corresponding to the at least one target virtual image to a range communication list;

receiving a triggering of a speech button in the virtual conference interface by the current participant, and determining whether a range communication switch corresponding to the target virtual conference is turned on;

If the range communication switch is in the on state, a speech type dialog box is displayed in the virtual conference interface, and the speech type dialog box includes a range communication option;

A trigger of the scope communication option by the current participant is received, and a scope communication discussion group corresponding to the scope communication list is created through an instant messaging server.
The display device according to claim 2, wherein the processor is further configured to execute computer instructions so that the display device:

Receiving a preset operation triggered by the current participant, and controlling the corresponding current virtual image to move in the virtual communication room;

Based on the position information of the current virtual image after the movement, a new target virtual image that enters the preset distance range is obtained, and original target participants that are outside the preset distance range are screened from all original target participants corresponding to the communication and discussion group within the range;

The new target participant corresponding to the new target virtual image is added to the range communication discussion group, and the original target participant in the range communication discussion group that is outside the preset distance range is removed to update the range communication discussion group.
The display device according to claim 3, wherein the processor is further configured to execute computer instructions so that the display device:

Obtain the user name of each target participant in the scope communication list;

The user name of each target participant is displayed on each target virtual image in the virtual communication room, and the user name on the target virtual image corresponding to the original target participant removed from the range communication list is canceled.
The display device according to claim 2, wherein the processor executes the receiving of the current participant The generated communication message is sent to each target participant terminal in the range communication discussion group, and the processor is further configured to execute computer instructions so that the display device:

receiving a range communication message generated by the current participant, wherein the range communication message carries a range communication identifier of the range communication discussion group, and each participant in the same range communication discussion group carries the same range communication identifier;

The scope communication message of the current participant is sent to each target participant end in the scope communication discussion group with the same scope communication identifier through the instant messaging server, and is not sent to other participant ends in the group discussion group that do not have the same scope communication identifier.
The display device according to claim 1, wherein the processor is further configured to execute computer instructions so that the display device:

When a specific participant who joins the target virtual conference generates specific communication information, a specific communication reminder is displayed in the virtual communication interface corresponding to the current participant, wherein the specific participant refers to a participant who is in the group discussion group and is not in the same communication discussion group as the current participant, and the specific communication reminder is used to indicate that the specific participant in the group discussion group is conducting a full-field communication;

Receive a trigger of the specific communication reminder by the current participant, and receive specific communication information generated by the specific participant.
The display device according to claim 6, wherein the processor is further configured to execute computer instructions so that the display device:

When the current participant is conducting a full-court communication in the virtual communication room, receiving a trigger of a speech button in the virtual conference interface by the current participant, and displaying a full-court communication option in a speech type dialog box that pops up in the virtual conference interface;

Receiving a trigger of the full-field communication option by the current participant, and sending a full-field communication request to a specific participant terminal through an instant messaging server, wherein the full-field communication request is used to instruct the specific participant to determine whether to allow the current participant to conduct full-field communication;

In response to receiving the instruction of allowing full-field communication returned by the specific participant through the instant messaging server, receiving a full-field communication message generated by the current participant, the full-field communication message carrying the full-field communication identifier of the group discussion group, and each participant in the group discussion group carries the same full-field communication identifier;

The full-field communication information generated by the current participant is sent to all participant terminals in the group discussion group corresponding to the full-field communication identifier through the instant messaging server.
According to the display device of claim 1, the processor is further configured to execute computer instructions so that the display device: obtains a training video identifier and a follow-up training page identifier;

Determine the follow-up training page data corresponding to the follow-up training page identifier, and obtain the corresponding training video data from the server according to the training video identifier;

Acquire target performance parameters of the display device, where the target performance parameters include: CPU occupancy rate and/or memory occupancy rate;

Controlling the communication interface to send the target performance parameter to the mobile terminal; receiving the follow-up training video data sent by the mobile terminal and matching the target performance parameter, wherein the follow-up training video data includes: the target video data collected by the mobile terminal, and/or the first human skeleton point information obtained from the target video data;

The display is controlled to display a follow-up training page based on the follow-up training page data, the training video data and the follow-up training video data, wherein the follow-up training page includes a first window and a second window, wherein the training video data is displayed in the first window and the follow-up training video data is displayed in the second window.
According to the display device of claim 8, when the target performance parameter is less than or equal to the first preset performance parameter, the follow-up video data includes: the target video data collected by the mobile terminal, and the first human skeleton point information obtained from the target video data;

The processor is further configured to execute computer instructions to cause the display device to: acquire second human skeleton point information from the training video data;

generating evaluation information according to matching parameters between the first human skeleton point information and the second human skeleton point information;

The target video data and the evaluation information are displayed in the second window.
According to the display device of claim 8, in the case where the target performance parameter is greater than the second preset performance parameter, the follow-up training video data includes: first human skeleton point information obtained from the target video data, excluding the target video data;

The processor is further configured to execute computer instructions to enable the display device to: generate virtual follow-up training video data based on the first human skeleton point information, wherein the virtual follow-up training video data includes a virtual human follow-up training picture;

The second window displays the virtual training video data.
According to the display device of claim 10, the processor is further configured to execute computer instructions so that the display device: obtains second human skeleton point information from the training video data;

generating evaluation information according to matching parameters between the first human skeleton point information and the second human skeleton point information;

The second window displays the virtual training video data and the evaluation information.
A mobile terminal, comprising:

The detector is configured to: collect target video data;

The processor is configured to: control the communication interface to receive a target performance parameter sent by the display device, wherein the target performance parameter includes: CPU occupancy rate and/or memory occupancy rate;

The control communication interface sends the follow-up video data matching the target performance parameters to the display device, wherein the follow-up video data includes: the target video data collected by the mobile terminal, and/or the first human skeleton point information obtained from the target video data.
According to the mobile terminal of claim 12, the processor is further configured to execute computer instructions so that the display device:

When the target performance parameter is less than or equal to the first preset performance parameter, controlling the communication interface to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device;

When the target performance parameter is less than or equal to the second preset performance parameter and greater than the first preset performance parameter, the communication interface is controlled to send the target video data collected by the mobile terminal to the display device without sending the first human skeleton point information; the second preset performance parameter is greater than the first preset performance parameter;

When the target performance parameter is greater than the second preset performance parameter, the communication interface is controlled to send the first human skeleton point information to the display device, and the target video data is not sent.
According to the mobile terminal of claim 13, the processor is further configured to execute computer instructions so that the display device:

Acquiring the remaining power of the mobile terminal;

The processor is specifically configured to: control the communication interface to send the follow-up video data matching the target performance parameter and the remaining power to the display device.
According to the mobile terminal of claim 14, the processor is further configured to execute computer instructions so that the display device:

When the target performance parameter is less than or equal to the first preset performance parameter, and the remaining power is greater than or equal to the first preset power parameter, controlling the communication interface to send the target video data collected by the mobile terminal and the first human skeleton point information to the display device;

In the case where the target performance parameter is less than or equal to the second preset performance parameter and greater than or equal to the first preset performance parameter, and the remaining power is less than the first preset power parameter and greater than or equal to the second preset power parameter,

Controlling the communication interface to send the target video data collected by the mobile terminal to the display device, the second preset power parameter being less than the first preset power parameter;

When the target performance parameter is greater than the second preset performance parameter and the remaining power is less than the second preset power parameter, the communication interface is controlled to send the first human skeleton point information to the display device.
The mobile terminal according to claim 12,

The training video data includes the first human skeleton point information, and does not include the target video data collected by the mobile terminal, and the processor is further configured to: control the display screen to display the target video data, and control the brightness of the display screen to be greater than a first preset brightness;

The training video data includes target video data collected by the mobile terminal, and the processor is further configured to:

The brightness of the display screen is controlled to be less than or equal to a second preset brightness, or the display screen is controlled to be off.
A method for implementing range communication in a virtual meeting, applied to a display device, the method comprising:

Receive an operation of the current participant joining the target virtual conference, request the server to add the current participant to the group discussion group corresponding to the target virtual conference, and display the virtual conference interface of the target virtual conference, wherein the group discussion group includes all participants who have joined the target virtual conference, and the virtual conference interface includes a virtual communication room corresponding to the group discussion group and virtual images corresponding to all participants in the group discussion group, and the virtual images corresponding to all participants are displayed in the virtual communication room;

Based on the current position information of the current virtual image in the virtual communication room, detecting whether there is a target virtual image within a preset distance range of the current virtual image, the current virtual image being the virtual image of the current participant, and the target virtual image being the virtual image of the target participant in the group discussion group;

If there is at least one target virtual image within the preset distance range of the current virtual image, the target participants corresponding to the current participant and the at least one target virtual image are screened out from the group discussion, and a range communication discussion group is generated;

Receive the communication message generated by the current participant, and send the communication message to each target participant terminal in the range communication discussion group.
A page display method based on device performance, applied to a display device, the method comprising:

Get the training video ID and follow-up training page ID;

Determine the follow-up training page data corresponding to the follow-up training page identifier, and obtain the corresponding training video data from the server according to the training video identifier;

Acquire target performance parameters of the display device, where the target performance parameters include: CPU occupancy rate and/or memory occupancy rate;

Sending the target performance parameter to a mobile terminal; receiving follow-up training video data sent by the mobile terminal and matching the target performance parameter, the follow-up training video data including: the target video data collected by the mobile terminal, and/or the first human skeleton point information obtained from the target video data;

The display is controlled to display a follow-up training page based on the follow-up training page data, the training video data and the follow-up training video data, wherein the follow-up training page includes a first window and a second window, wherein the training video data is displayed in the first window and the follow-up training video data is displayed in the second window.
A page display method based on device performance, applied to a mobile terminal, the method comprising:

Collect target video data;

Receiving a target performance parameter sent by a display device, the target performance parameter including: CPU occupancy rate and/or memory occupancy rate;

The control communication interface sends the follow-up video data matching the target performance parameters to the display device, wherein the follow-up video data includes: the target video data collected by the mobile terminal, and/or the first human skeleton point information obtained from the target video data.