CN113099159A

CN113099159A - Control method and device for teleconference

Info

Publication number: CN113099159A
Application number: CN202110323189.8A
Authority: CN
Inventors: 陈罡; 徐欣; 钱广璞; 杨顺超; 毕航
Original assignee: Shanghai Electric Group Corp
Current assignee: Shanghai Electric Group Corp
Priority date: 2021-03-26
Filing date: 2021-03-26
Publication date: 2021-07-09

Abstract

The application relates to the technical field of virtual reality, in particular to a control method and a control device for a teleconference, which are used for receiving control data sent by a network server, wherein the control data is searched by the network server according to a conference number sent by a playing client and returned to the playing client; generating dynamic human model information according to the control data and the pre-generated human model information; and establishing a three-dimensional Virtual Reality (VR) scene according to the human body dynamic model information and three-dimensional model information which is acquired from a third-party platform and generated based on the target operation object, so that a user can carry out a teleconference in the three-dimensional VR scene, and thus, the teleconference is realized only through control data with small data volume, and the efficiency of the teleconference can be improved.

Description

Control method and device for teleconference

Technical Field

The application relates to the technical field of virtual reality, in particular to a control method and device for a teleconference.

Background

Currently, with the development of internet technology, when a conference is carried out, a remote conference can be realized through a remote video technology. However, when a teleconference is performed, since the amount of data per unit time of a remote video is large, there are often problems of a large network pressure and a video delay when the remote video is transmitted, and further, efficiency when the teleconference is performed is very low.

Disclosure of Invention

The embodiment of the application provides a method and a device for controlling a teleconference, so that the efficiency of the teleconference is improved.

The embodiment of the application provides the following specific technical scheme:

a control method of a remote conference is applied to a playing client and comprises the following steps:

receiving control data sent by a network server, wherein the control data is searched by the network server according to the conference number sent by the playing client and returned to the playing client;

generating dynamic human model information according to the control data and the pre-generated human model information;

and establishing a three-dimensional Virtual Reality (VR) scene according to the human body dynamic model information and three-dimensional model information which is acquired from a third-party platform and generated based on the target operation object, so that a user can carry out a teleconference in the three-dimensional VR scene.

Optionally, before receiving the control data sent by the network server, the method further includes:

acquiring an identity verification request input by a user, wherein the identity verification request at least comprises user name information and corresponding password information;

and responding to the identity verification request, matching the user name information and the corresponding password information input by the user with the pre-stored user name information and password information, verifying the identity of the user, and determining that the user identity of the user passes the verification.

acquiring a port identification input by a user, and determining a port corresponding to the port identification;

and searching the network server to which the port belongs, and establishing network connection with the searched network server.

Optionally, if the control data includes handle control data of a handle control device and head coordinates of a head display device, generating dynamic human model information according to the control data and pre-generated human model information, specifically including:

and generating dynamic human body model information according to the handle control data, the head coordinates and the human body model information.

Optionally, the conference number is obtained by the master control client sending the generated new conference request to the network server so that the network server generates a conference number;

the three-dimensional model information is obtained by performing three-dimensional modeling according to the module data to be built of the target operation object;

the control data is obtained by the main control client sending the conference number, the handle control data and the head coordinate to the network server so that the network server establishes an association relationship between the conference number and the handle control data as well as between the head coordinate.

A control method of a remote conference is applied to a network server and comprises the following steps:

respectively acquiring access requests sent by all playing clients, wherein the access requests at least comprise conference numbers;

finding out control data associated with the conference number according to the conference number;

and respectively sending the control data to each playing client so that each playing client generates human body dynamic model information according to the control data and pre-generated human body model information, and establishing a three-dimensional Virtual Reality (VR) scene according to the human body dynamic model information and three-dimensional model information which is acquired from a third-party platform and is generated based on a target operation object so that a user carries out a teleconference in the three-dimensional VR scene.

Optionally, before the obtaining the access request sent by each playing client, the method further includes:

responding to a new conference request sent by a master control client, and generating a conference number;

receiving control data sent by the master control client;

and establishing an incidence relation between the conference number and the control data.

A control system for a teleconference, comprising:

the main control client is used for sending the acquired control data to the network server;

the network server is used for establishing an association relation between the conference number and the control data, finding the control data associated with the conference number according to the conference number in the access request sent by the playing client, and sending the found control data to the playing client;

and the playing client is used for generating human dynamic model information according to the control data and the pre-generated human model information, and establishing a three-dimensional Virtual Reality (VR) scene according to the human dynamic model information and three-dimensional model information which is acquired from a third-party platform and is generated based on a target operation object, so that a user can carry out a teleconference in the three-dimensional VR scene.

A control device of a remote conference is applied to a playing client and comprises:

the receiving module is used for receiving control data sent by a network server, wherein the control data is searched by the network server according to the conference number sent by the playing client and returned to the playing client;

the generating module is used for generating human body dynamic model information according to the control data and the pre-generated human body model information;

and the operation module is used for establishing a three-dimensional Virtual Reality (VR) scene according to the human body dynamic model information and three-dimensional model information which is acquired from a third-party platform and generated based on a target operation object, so that a user can carry out a teleconference in the three-dimensional VR scene.

the system comprises an acquisition module, a verification module and a verification module, wherein the acquisition module is used for acquiring an identity verification request input by a user, and the identity verification request at least comprises user name information and corresponding password information;

and the verification module is used for responding to the identity verification request, matching the user name information and the corresponding password information input by the user with the pre-stored user name information and password information, verifying the identity of the user and determining that the user identity of the user passes verification.

the determining module is used for acquiring a port identifier input by a user and determining a port corresponding to the port identifier;

and the connection module is used for searching the network server to which the port belongs and establishing network connection with the searched network server.

Optionally, if the control data includes handle control data of the handle control device and head coordinates of the head display device, the generating module is specifically configured to:

A teleconferencing control device applied to a network server comprises:

the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for respectively acquiring access requests sent by each playing client, and the access requests at least comprise conference numbers;

the searching module is used for searching the control data associated with the conference number according to the conference number;

and the processing module is used for respectively sending the control data to each playing client so that each playing client generates human body dynamic model information according to the control data and the pre-generated human body model information, and establishes a three-dimensional Virtual Reality (VR) scene according to the human body dynamic model information and three-dimensional model information which is acquired from a third-party platform and is generated based on a target operation object so that a user can carry out a teleconference in the three-dimensional VR scene.

the generating module is used for responding to a new conference request sent by the main control client and generating a conference number;

the receiving module is used for receiving the control data sent by the master control client;

and the establishing module is used for establishing the incidence relation between the conference number and the control data.

An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method for controlling a teleconference as described above when executing the program.

A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of controlling a teleconference mentioned above.

In the embodiment of the application, control data sent by a network server is received, the control data is found by the network server according to a conference number sent by a playing client and returned to the playing client, human dynamic model information is generated according to the control data and pre-generated human model information, a three-dimensional VR scene is established according to the human dynamic model information and three-dimensional model information generated based on a target operation object and acquired from a third-party platform, so that a user can carry out a remote conference in the three-dimensional VR scene, thus, when the playing client receives data transmitted by the network server, only control data with small transmission data amount is received, the three-dimensional VR scene is established according to the control data and the human model information, and the established three-dimensional VR scene is rendered in real time, so that the three-dimensional VR scene and the body posture of a participant can be dynamically presented in real time, compared with the remote video with large data transmission amount in the prior art, the data transmission amount of the network can be reduced, so that the network pressure is reduced, the efficiency of the remote conference is improved, the remote conference is realized by using the three-dimensional VR technology which is rendered in real time, the general conference experience as the scene can be finished, and the experience feeling of a user is improved.

Drawings

Fig. 1 is a flowchart of a method for controlling a teleconference in an embodiment of the present application;

FIG. 2 is a schematic diagram illustrating the effect of the handle device on collecting handle control data in the embodiment of the present application;

FIG. 3 is a schematic diagram illustrating the effect of a dynamic human body model in the embodiment of the present application;

fig. 4 is another flowchart of a method for controlling a teleconference in the embodiment of the present application;

fig. 5 is a schematic structural diagram of a control system for a teleconference in an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a remote consultation system according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a control device for a teleconference in the embodiment of the present application;

fig. 8 is a schematic structural diagram of another remote conference control apparatus in the embodiment of the present application;

fig. 9 is a schematic structural diagram of an electronic device in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

At present, although the on-site conference communication efficiency is high, the time and travel costs are high, and with the emergence of new crown epidemic situations, the travel mode of people has been deeply changed, so how to change the conference form becomes a problem to be solved urgently.

With the development of internet technology, when a conference is carried out, a teleconference can be realized through remote video technology or remote conference software. However, when a teleconference is performed, since the amount of data per unit time of a remote video is large, there are often problems of a large network pressure, video delay, and unclear when the remote video is transmitted, and further, efficiency when the teleconference is performed is very low.

In order to solve the above problems, an embodiment of the present application provides a method for controlling a teleconference, where control data sent by a network server is received, the control data is found by the network server according to a conference number sent by a playing client and returned to the playing client, dynamic human model information is generated according to the control data and pre-generated human model information, a three-dimensional Virtual Reality (VR) scene is established according to the dynamic human model information and three-dimensional model information generated based on a target operation object and acquired from a third-party platform, and the established three-dimensional VR scene is rendered in real time, so that a user carries out the teleconference in the three-dimensional VR scene, and thus only control data with a small data amount is transmitted between the playing client and the network server, compared with a video stream with a large data amount transmitted in the prior art, the data volume of network transmission can be reduced, so that the network pressure is reduced, the problem of video delay is avoided, and the communication efficiency of the conference is improved while the conference is carried out remotely.

Based on the above embodiment, referring to fig. 1, a flowchart of a method for controlling a teleconference in the embodiment of the present application is applied to a playing client, and specifically includes:

step 100: and receiving control data sent by the network server.

The control data is searched by the network server according to the conference number sent by the playing client and returned to the playing client.

In the embodiment of the application, a user inputs a conference number corresponding to a conference to be joined to a playing client, the playing client generates an access request according to the conference number after acquiring the conference number, and sends the access request to a network server, then the network server reads the conference number included in the access request, finds control data associated with the conference number according to the association relationship between each preset conference number and each control data, and sends the found control data to the playing client, so that the playing client receives the control data found by the network server and associated with the conference number.

For example, assuming that a conference number corresponding to a conference that a user needs to join is 1234, the user inputs the conference number 1234 into the playing client, and then the playing client generates an access request according to the conference number 1234 and sends the access request including the conference number 1234 to the network server, and the network server finds the control data a associated with the conference number 1234 according to the association relationship between the conference number and the control data, and sends the found control data a to the playing client, so that the playing client receives the control data a associated with the conference number found by the network server.

The access request is used for acquiring control data required for accessing the conference from the network server.

The conference number is obtained by the main control client sending the generated new conference request to the network server so that the network server generates the conference number.

For example, a login interface is arranged on a client, the login interface is provided with two text boxes of a user name and a password and two buttons of a new room and a room, if a user selects the button of the new room after inputting the user name and the password, the client is determined to be a master control client, the master control client generates a new conference request and sends the new conference request to a network server, the network server randomly generates a room number, and the generated room number is returned to the master control client. If the user selects a room joining button after inputting a user name and a password, the client is determined to be a playing client, the user can input a room number into a text box of a room to be joined, a room matching mechanism is designed in a script of the network server, and the network server connects the main control client and each playing client of the same room number to the same room.

For example, if a user clicks a new room button on a client, the client is determined to be a speaker when entering a conference, an object named an excluder (excluder) in a volume model viewer (VVP) is bound as a child object of a handle device, since the excluder can realize a slicing effect on a volume model of Digital Imaging and Communications in Medicine (DICOM), the excluder bound as the child object of the handle device can slice three-dimensional model information with the handle device, and if the user clicks a room button on the client, the client is determined to be a participant when entering the conference, the local excluder is synchronized to coordinates of a received speaker terminal, and the slicing effect synchronized with the speaker is displayed.

The control data is obtained by the main control client sending the conference number, the handle control data and the head coordinate to the network server so that the network server establishes an association relationship between the conference number and the handle control data as well as between the head coordinate, for example, refer to fig. 2, which is a schematic diagram illustrating an effect of acquiring the handle control data by the handle device in the embodiment of the present application. The handle device a1 held by the participant a can indicate the collected handle control data by the 6 Degree of Freedom (DOF) coordinates, and refer to the table shown in table 1, which is the collected handle control data in the embodiment of the present application.

Table 1.

X	Y	Z
			12.6	562.5	895.5
X(ROTARION)	Y(ROTARION)	Z(ROTARION)
			12.3	34.7	334.6

The network server may be, for example, a Photon Unity Networking (PUN) server, which is not limited in this embodiment of the application.

The preset association relationship between each conference number and each control data may be implemented by, for example, a mapping relationship table of conference numbers and control data, which is shown in table 2 and is a relationship mapping table of conference numbers and control data in the embodiment of the present application.

Table 2.

Conference numbering	Control data
		1	A
2	B
		3	C

It should be noted that both the playing client and the main control client are terminal devices, that is, the terminal device may be a playing client or a main control client. And if the terminal equipment sends a new conference request to the network server, determining that the terminal equipment entering the conference is a speaker, namely the master control client. And if the terminal equipment sends an access request to the network server, determining that the terminal equipment entering the conference is a participant, namely a playing client.

Further, in order to improve the security of the user when the user joins the conference, in the embodiment of the present application, before receiving the control data sent by the network server, the identity of the user may be verified, which specifically includes:

s1: and acquiring an identity verification request input by a user.

The identity verification request at least comprises user name information and corresponding password information.

In the embodiment of the application, a user obtains an identity verification request input by the user from a playing client, wherein the identity verification request comprises user name information and password information corresponding to the user name information.

For example, the user name information included in the id check request input by the user to the playback client is "yang", and the password information is "1111".

S2: and responding to the identity verification request, matching the user name information and the corresponding password information input by the user with the pre-stored user name information and password information, verifying the identity of the user, and determining that the user identity of the user passes the verification.

In the embodiment of the application, after the playing client acquires the user name information and the corresponding password information input by the user, the standard user name information identical to the user name information is searched from the pre-stored identity verification database according to the user name information, and the standard password information associated with the standard user name information is acquired. Then, comparing the password information input by the user with the obtained standard password information, and judging whether the password information input by the user is the same as the obtained standard password information. And if the password information input by the user is determined to be the same as the acquired standard password information, determining that the user identity verification of the user passes, and if the password information input by the user is determined to be different from the acquired standard password information, determining that the user identity verification of the user does not pass.

For example, assuming that the user name information input by the user is "yang", according to the user name information "yang", the standard user name information "yang" identical to the user name information "yang" is found from the pre-stored identity verification database, and the standard password information "1111" associated with the standard user name information "yang" is acquired. Then, comparing the password information input by the user with the acquired standard password information of '1111', if the password information input by the user is '1111', determining that the password information input by the user is the same as the acquired standard password information, and determining that the user identity verification of the user passes, and if the password information input by the user is '1112', determining that the password information input by the user is not the same as the acquired standard password information, and determining that the user identity verification of the user does not pass.

Further, in the embodiment of the present application, identity verification may also be performed in a dynamic verification code manner and a face recognition manner, which is not limited in the embodiment of the present application.

Further, before receiving the control data sent by the network server, a connection needs to be established with the network server first. However, since there are many network servers deployed, it is a problem to be solved which network server needs to establish a connection with one of the multiple network servers, and the following describes in detail the steps of connecting with the network server in the embodiment of the present application, which specifically includes:

a1: and acquiring a port identification input by a user, and determining a port corresponding to the port identification.

In the embodiment of the application, a user inputs a port identifier into a playing client, so that the playing client acquires the port identifier input by the user, and then determines a port corresponding to the port identifier according to a pre-stored correspondence relationship between the port identifier and a corresponding port.

It should be noted that each network server may have a plurality of ports, and the ports of the network servers may be different, so that each port of each network server has a different port identifier, and the port identifier represents a unique identity of the port.

A2: and searching the network server to which the port belongs, and establishing network connection with the searched network server.

In the embodiment of the application, the network server to which the port belongs is found according to the pre-stored corresponding relationship between each port and each network server, and network connection is established between the network server and the found network server. After the playing client establishes network connection with the network server, the playing client can perform network transmission with the network server.

It should be noted that, when the network server is a PUN server, a port for accessing the PUN server is set, and if the network server is applied to the china, the user should first go to the PUN official network to apply for the server port of the china.

In addition, it should be noted that the development platform in the embodiment of the present application is UNITY, and therefore, the VVP, the PUN server, and the component in the embodiment of the present application are all software tools or plug-ins used in UNITY.

Step 110: and generating dynamic human body model information according to the control data and the pre-generated human body model information.

In the embodiment of the application, after the control data is received, the human dynamic model information can be generated according to the control data and the human model information.

Specifically, if the control data includes handle control data of the handle control device and head coordinates of the head display device, the step 110 is executed and specifically includes:

and generating the human body dynamic model information according to the handle control data, the head coordinates and the human body model information.

In the embodiment of the application, the hand in the human body model information is controlled according to the handle control data, and the head in the human body model information is controlled according to the head coordinates of the head display equipment, so that the human body dynamic model information can be generated.

For example, 6DOF data of the handle device a1 is uploaded to the server. The participant B can reproduce the hand motion of the main control client a by downloading the control data of the handle device a1 at the playing client, see fig. 3, which is a schematic view of the effect of the dynamic human body model in the embodiment of the present application, at this time, the 6DOF data of the handle device a1 at the playing client B is shown in the following table 3, see table 3, which is a control data table in the embodiment of the present application.

Table 3.

X	Y	Z
			12.6	562.5	895.5
X(ROTARION)	Y(ROTARION)	Z(ROTARION)
			12.3	34.7	334.6

It should be noted that the human body model information is initial human body model information obtained by performing three-dimensional modeling on an upright human body, and the human body model information does not contain human body actions, so the human body model information needs to be controlled by control data, so that the human body model information achieves a dynamic effect, and the human body dynamic model information is finally generated, so that the actions of the human body can be simulated.

Step 120: and establishing a three-dimensional VR scene according to the human body dynamic model information and the three-dimensional model information which is acquired from the third-party platform and generated based on the target operation object, so that the user can carry out a teleconference in the three-dimensional VR scene.

In the embodiment of the application, after the dynamic human body model information is generated, the three-dimensional model information generated based on the target operation object is acquired from the third-party platform, then the three-dimensional VR scene is established according to the dynamic human body model information and the three-dimensional model information of the target operation object, and the established three-dimensional VR scene is rendered in real time, so that a user can carry out a teleconference in the established three-dimensional VR scene.

And the three-dimensional model information is obtained by performing three-dimensional modeling according to the module data to be built of the target operation object.

In the embodiment of the application, control data sent by a network server are received, the control data are searched by the network server according to a conference number sent by a playing client and returned to the playing client, dynamic human model information is generated according to the control data and pre-generated human model information, a three-dimensional VR scene is established according to the dynamic human model information and three-dimensional model information which is acquired from a third-party platform and generated based on a target operation object, and the established three-dimensional VR scene is rendered in real time, so that a user can carry out a teleconference in the established three-dimensional VR scene, and therefore the human action postures of participants can be synchronized through the control data and the pre-generated human model information, the conference experience as common on site can be completed, and the teleconference and communication efficiency can be achieved.

Based on the foregoing embodiment, referring to fig. 4, another flowchart of a method for controlling a teleconference in the embodiment of the present application is applied to a network server, and specifically includes:

step 400: and respectively acquiring access requests sent by the playing clients.

Wherein, the access request at least comprises a conference number.

Further, before acquiring the access request of the playing client, the network server first needs to acquire the control data sent by the master control client, and the following describes in detail the step of acquiring the control data sent by the master control client in the embodiment of the present application, and specifically includes:

s1: and responding to a new conference request sent by the master control client, and generating a conference number.

In the embodiment of the application, the conference number may be, for example, a room number, and when the main control client sends a mail conference request and requests a new room to be created, a room number is randomly generated.

S2: receiving control data sent by a master control client;

s3: and establishing an incidence relation between the conference number and the control data.

Step 410: and finding out the control data associated with the conference number according to the conference number.

Step 420: and respectively sending the control data to each playing client so that each playing client generates human dynamic model information according to the control data and the pre-generated human model information, and establishing a three-dimensional VR scene according to the human dynamic model information and three-dimensional model information which is acquired from a third-party platform and is generated based on a target operation object so that a user carries out a teleconference in the three-dimensional VR scene.

In the embodiment of the application, an access request sent by a playing client is obtained, control data associated with a conference number is found according to the conference number in the access request, the control data are sent to each client respectively, so that each client generates human dynamic model information according to the control data and pre-generated human model information, a three-dimensional VR scene is established according to the human dynamic model information and three-dimensional model information which is obtained from a third-party platform and generated based on a target operation object, and the established three-dimensional VR scene is rendered in real time, so that a user carries out a remote conference in the rendered three-dimensional VR scene.

Based on the above embodiment, referring to fig. 5, a schematic structural diagram of a control system of a teleconference in the embodiment of the present application is shown, specifically including:

1. and the master control client is used for sending the acquired control data to the network server.

2. And the network server is used for establishing an association relation between the conference number and the control data, searching the control data associated with the conference number according to the conference number in the access request sent by the playing client, and sending the searched control data to the playing client.

3. And the playing client is used for generating human dynamic model information according to the control data and the pre-generated human model information, and establishing a three-dimensional VR scene according to the human dynamic model information and the three-dimensional model information which is acquired from the third-party platform and is generated based on the target operation object, so that the user can carry out a teleconference in the three-dimensional VR scene.

The remote conference system in the embodiment of the application can thoroughly change the logic of the remote conference from building around video transmission to building around virtual reality and virtual substitution, and reduces the bandwidth pressure under the condition of improving the communication telepresence.

Based on the foregoing embodiment, the following describes in detail a control method of a remote conference in the embodiment of the present application by taking a remote consultation as an example, and referring to fig. 6, the method is a schematic structural diagram of a remote consultation system in the embodiment of the present application, and specifically includes:

1. and a PUN server.

Binding head display equipment, handle equipment and three-dimensional model information of a user on related components of the PUN server, then editing a script, designing an uploading and receiving mechanism of related component coordinates in the script, setting a port for accessing the PUN server, if the method is applied to a Chinese area, firstly going to a PUN official network to apply for a server port of the Chinese area, and after a local basic framework is completed, deploying cloud service and PUN voice of the PUN.

The three-dimensional model information is obtained by performing three-dimensional modeling based on DICOM data. User 1, user 2, and user 3 are co-located in one virtual space through the VR device.

2. User 1:

DICOM data and model slices are displayed locally via volume viewer pro.

In the embodiment of the application, whether the conference is a speaker or not is judged. If so, bind the object named "exccluder" in VVP as a child object of the handle device. Since the exccluder can realize the slicing effect of the DICOM three-dimensional model information. The binding of the excluder as a child of the handle device enables the slicing of the three-dimensional model information with the handle device. The display of the medical model in consultation is very convenient. And when the user 1 is the master control client, sending the coordinates of the head display equipment, the coordinates of the handle equipment, the demonstration cursor and the voice to the PUN server.

3. And (4) a user 2:

synchronizing the local excluder to the received speaker side coordinates. The DICOM data and model slices are displayed locally through volume viewer pro, showing the slice effect synchronized with the speaker.

In the embodiment of the application, the user 2 is a playing client, so that the coordinates of the camera, the handle coordinates, the demonstration cursor and the voice sent by the PUN server are received, and the motion of the human body and the slice and the cursor on the DICOM are revealed in real time through gestures and equipment pos.

Therefore, the user can review and use the same DICOM data model in the virtual reality, and can see hand movements and review marks of other people.

4. User 3:

DICOM data and model slices are displayed locally via volume viewer pro.

In the embodiment of the application, the user 3 is a playing client, so that the coordinates of the camera, the handle coordinates, the demonstration cursor and the voice sent by the PUN server are received, and the motion of the human body and the slice and the cursor on the DICOM are revealed in real time through gestures and equipment pos.

In the embodiment of the application, the data transmission amount in unit time is reduced by the remote consultation system based on the virtual proxy. More operations are put into place. Meanwhile, the presence feeling of the participants is greatly enhanced, and the body actions of the whole body can be reproduced. When the medical data is displayed, the zooming and slicing positions can be displayed at will according to the hand posture of the speaker.

Based on the same inventive concept, the embodiment of the present application further provides a control device for a teleconference, where the control device for a teleconference may be, for example, the playing client in the foregoing embodiment, and the control device for a teleconference may be a hardware structure, a software module, or a hardware structure plus a software module. Based on the foregoing embodiment, referring to fig. 7, a schematic structural diagram of a control device for a teleconference in an embodiment of the present application specifically includes:

a receiving module 700, configured to receive control data sent by a network server, where the control data is found by the network server according to a conference number sent by the playing client and returned to the playing client;

a generating module 710, configured to generate dynamic human model information according to the control data and pre-generated human model information;

an operation module 720, configured to establish a three-dimensional virtual reality VR scene according to the human body dynamic model information and three-dimensional model information generated based on a target operation object and acquired from a third-party platform, so that a user performs a teleconference in the three-dimensional VR scene.

an obtaining module 730, configured to obtain an identity verification request input by a user, where the identity verification request at least includes user name information and corresponding password information;

the verification module 740 is configured to, in response to the identity verification request, verify the identity of the user by matching the user name information and the corresponding password information input by the user with the pre-stored user name information and password information, and determine that the user identity of the user passes verification.

a determining module 750, configured to obtain a port identifier input by a user, and determine a port corresponding to the port identifier;

the connection module 760 is configured to find a network server to which the port belongs, and establish a network connection with the found network server.

Optionally, if the control data includes handle control data of the handle control device and head coordinates of the head display device, the generating module 710 is specifically configured to:

Based on the same inventive concept, the embodiment of the present application further provides another remote conference control device, the remote conference control device may be, for example, the network server in the foregoing embodiment, and the remote conference control device may be a hardware structure, a software module, or a hardware structure plus a software module. Based on the above embodiments, referring to fig. 8, a schematic structural diagram of another remote conference control device in the embodiment of the present application specifically includes:

an obtaining module 800, configured to obtain access requests sent by each playing client, respectively, where the access requests at least include a conference number;

a searching module 810, configured to search, according to the conference number, control data associated with the conference number;

and the processing module 820 is configured to send the control data to each playing client, so that each playing client generates human dynamic model information according to the control data and pre-generated human model information, and establishes a three-dimensional Virtual Reality (VR) scene according to the human dynamic model information and three-dimensional model information generated based on a target operation object and acquired from a third-party platform, so that a user performs a teleconference in the three-dimensional VR scene.

the generating module 830 is configured to generate a conference number in response to a new conference request sent by the master control client;

a receiving module 840, configured to receive control data sent by the master control client;

an establishing module 850, configured to establish an association relationship between the conference number and the control data.

Based on the above embodiments, referring to fig. 9, a schematic structural diagram of an electronic device in an embodiment of the present application is shown.

An embodiment of the present application provides an electronic device, which may include a processor 910 (CPU), a memory 920, an input device 930, an output device 940, and the like, wherein the input device 930 may include a keyboard, a mouse, a touch screen, and the like, and the output device 940 may include a Display device, such as a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT), and the like.

Memory 920 may include Read Only Memory (ROM) and Random Access Memory (RAM), and provides the processor 910 with program instructions and data stored in memory 920. In the embodiment of the present application, the memory 920 may be used to store a program of a control method of a teleconference in any one of the embodiments of the present application.

The processor 910 is configured to execute a control method of any teleconference in the embodiment of the present application according to the obtained program instructions by calling the program instructions stored in the memory 920.

Based on the above embodiments, in the embodiments of the present application, there is provided a computer-readable storage medium on which a computer program is stored, the computer program, when executed by a processor, implementing a method for controlling a teleconference in any of the above method embodiments.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims

1. A control method of a teleconference is applied to a playing client, and is characterized by comprising the following steps:

2. The method of claim 1, wherein prior to receiving the control data sent by the network server, further comprising:

3. The method of claim 1, wherein prior to receiving the control data sent by the network server, further comprising:

4. The method according to claim 1, wherein if the control data includes handle control data of a handle control device and head coordinates of a head display device, generating human body dynamic model information according to the control data and pre-generated human body model information, specifically comprising:

5. The method according to any one of claims 1 to 4, wherein the conference number is obtained by the master client sending the generated new conference request to the network server so that the network server generates a conference number;

6. A method for controlling a teleconference, applied to a network server, includes:

7. The method of claim 6, wherein before obtaining the access requests sent by the respective playing clients, the method further comprises:

receiving control data sent by the master control client;

8. A teleconferencing control system, comprising:

9. A teleconferencing control device, which is applied to a play client, comprises:

10. The apparatus of claim 9, wherein prior to receiving the control data sent by the network server, further comprising:

11. The apparatus of claim 9, wherein prior to receiving the control data sent by the network server, further comprising:

12. The apparatus of claim 9, wherein if the control data includes handle control data of a handle control device and head coordinates of a head display device, the generation module is specifically configured to:

13. The apparatus according to any one of claims 9-12, wherein the conference number is obtained by the master client sending the generated new conference request to the network server to enable the network server to generate a conference number;

14. A teleconferencing control device, which is applied to a network server, comprises:

15. The apparatus as claimed in claim 14, wherein before obtaining the access requests sent by the respective playing clients, the apparatus further comprises:

16. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of any of claims 1-5 or 6-7 are implemented when the program is executed by the processor.

17. A computer-readable storage medium having stored thereon a computer program, characterized in that: the computer program when executed by a processor implements the steps of the method of any one of claims 1-5 or 6-7.