CN111818292A - Control method, device, terminal and system - Google Patents

Control method, device, terminal and system Download PDF

Info

Publication number
CN111818292A
CN111818292A CN201910294573.2A CN201910294573A CN111818292A CN 111818292 A CN111818292 A CN 111818292A CN 201910294573 A CN201910294573 A CN 201910294573A CN 111818292 A CN111818292 A CN 111818292A
Authority
CN
China
Prior art keywords
video conference
remote control
terminal
user terminal
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910294573.2A
Other languages
Chinese (zh)
Other versions
CN111818292B (en
Inventor
张腊梅
郭晓亮
王广浩
杨琢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nail Holding Cayman Co ltd
Original Assignee
Nail Holding Cayman Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nail Holding Cayman Co ltd filed Critical Nail Holding Cayman Co ltd
Priority to CN201910294573.2A priority Critical patent/CN111818292B/en
Publication of CN111818292A publication Critical patent/CN111818292A/en
Application granted granted Critical
Publication of CN111818292B publication Critical patent/CN111818292B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The embodiment of the invention provides a control method, a control device, control equipment and a control system, wherein the method comprises the following steps: the video conference terminal participating in the video conference displays the two-dimension code corresponding to the video conference on the display interface, the user equipment scans the two-dimension code through the instant messaging client, so that the remote control right of the video conference terminal is obtained, further, the control interface corresponding to the video conference is displayed on the user equipment, based on the operation behavior of the control interface, the user equipment sends a remote control instruction to the video conference terminal through the server, and the video conference terminal executes the remote control instruction, so that the control of the video conference is simply and conveniently realized.

Description

Control method, device, terminal and system
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a control method, an apparatus, a terminal, and a system.
Background
Video conferencing has become a form of business conferencing that enterprises and public institutions mainly adopt at present. However, the video conference of each enterprise generally requires conditions such as a stable and secure network, reliable conference quality, and a formal conference environment, and thus a special video conference system needs to be established by using professional video conference equipment. Since such a video conference system generally uses a television to display, the video conference is also called a video conference or a video conference.
During the course of a video conference, the conference organizer or other relevant personnel may need to control the television, such as on-off control, control to select a function item in a menu to use the corresponding function, and so on. At present, the control operation is realized based on a special remote controller, and in practical application, the remote controller is not usually allocated to each participant due to the consideration of cost and the like, which means that some participants will be inconvenient to realize some control operations.
Disclosure of Invention
The embodiment of the invention provides a control method, a control device and control equipment, which are used for improving the control convenience of a conference.
In a first aspect, an embodiment of the present invention provides a control method, which is applied to a video conference terminal participating in a video conference, and the method includes:
displaying a two-dimensional code corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
and the user terminal scans the two-dimension code through an instant messaging client to display a control interface corresponding to the video conference, and responds to the operation behavior of the control interface and sends the remote control instruction to the server.
In a second aspect, an embodiment of the present invention provides a control apparatus, which is applied to a video conference terminal participating in a video conference, and includes:
the display module is used for displaying the two-dimensional code corresponding to the video conference on a display interface;
the receiving module is used for receiving the remote control instruction forwarded by the server from the user terminal;
the processing module is used for executing the remote control instruction;
and the user terminal scans the two-dimension code through an instant messaging client to display a control interface corresponding to the video conference, and responds to the operation behavior of the control interface and sends the remote control instruction to the server.
In a third aspect, an embodiment of the present invention provides a video conference terminal, including: a first memory, a first processor; wherein the first memory has stored thereon executable code which, when executed by the first processor, causes the first processor to implement at least the control method of the first aspect.
An embodiment of the present invention provides a non-transitory machine-readable storage medium, on which an executable code is stored, and when the executable code is executed by a processor of a video conference terminal, the processor is enabled to implement at least the control method according to the first aspect.
In a fourth aspect, an embodiment of the present invention provides a control method, which is applied to a video conference terminal participating in a video conference, and the method includes:
displaying remote control identification information corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
the user terminal displays a control interface corresponding to the video conference by acquiring the remote control identification information, and responds to the operation behavior of the control interface, and the user terminal sends the remote control instruction to the server.
In a fifth aspect, an embodiment of the present invention provides a control apparatus, which is applied to a video conference terminal participating in a video conference, and the apparatus includes:
the display module is used for displaying the remote control identification information corresponding to the video conference on a display interface;
the receiving module is used for receiving the remote control instruction forwarded by the server from the user terminal;
the processing module is used for executing the remote control instruction;
the user terminal displays a control interface corresponding to the video conference by acquiring the remote control identification information, and responds to the operation behavior of the control interface, and the user terminal sends the remote control instruction to the server.
In a sixth aspect, an embodiment of the present invention provides a video conference terminal, including: a second memory, a second processor; wherein the second memory has stored thereon executable code which, when executed by the second processor, causes the second processor to at least implement the control method of the fourth aspect.
An embodiment of the present invention provides a non-transitory machine-readable storage medium, having stored thereon executable code, which, when executed by a processor of a video conference terminal, causes the processor to implement at least the control method according to the fourth aspect.
In a seventh aspect, an embodiment of the present invention provides a control method, which is applied to a conference terminal, and the method includes:
displaying remote control identification information on a display interface;
receiving a remote control instruction sent by a user terminal;
executing the remote control instruction;
and the user terminal displays a corresponding control interface by acquiring the remote control identification information, and responds to the operation behavior of the control interface and sends the remote control instruction.
In an eighth aspect, an embodiment of the present invention provides a control apparatus, which is applied to a conference terminal, and includes:
the display module is used for displaying the remote control identification information on a display interface;
the receiving module is used for receiving a remote control instruction sent by a user terminal;
the processing module is used for executing the remote control instruction;
and the user terminal displays a corresponding control interface by acquiring the remote control identification information, and responds to the operation behavior of the control interface and sends the remote control instruction.
In a ninth aspect, an embodiment of the present invention provides a conference terminal, including: a third memory, a third processor; wherein the third memory has stored thereon executable code which, when executed by the third processor, causes the third processor to implement at least the control method of the seventh aspect.
An embodiment of the present invention provides a non-transitory machine-readable storage medium, on which an executable code is stored, and when the executable code is executed by a processor of a conference terminal, the processor is enabled to implement at least the control method according to the seventh aspect.
In a tenth aspect, an embodiment of the present invention provides a control method, applied to a user terminal, where the method includes:
scanning a two-dimensional code displayed on a display interface corresponding to a video conference terminal through an instant messaging client, wherein the two-dimensional code corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
In an eleventh aspect, an embodiment of the present invention provides a control apparatus, which is applied to a user terminal, and the apparatus includes:
the scanning module is used for scanning a two-dimensional code displayed on a display interface corresponding to a video conference terminal through an instant messaging client, wherein the two-dimensional code corresponds to a video conference in which the video conference terminal participates;
the display module is used for displaying a control interface corresponding to the video conference on the user terminal;
and the sending module is used for responding to the operation behavior of the control interface and sending a corresponding remote control instruction to the video conference terminal through the server so as to enable the video conference terminal to execute the remote control instruction.
In a twelfth aspect, an embodiment of the present invention provides a user terminal, where the terminal device includes a fourth processor and a fourth memory, where the fourth memory has stored thereon an executable code, and when the executable code is executed by the fourth processor, the fourth processor is enabled to at least implement the control method according to the tenth aspect.
An embodiment of the present invention provides a non-transitory machine-readable storage medium, having stored thereon executable code, which, when executed by a processor of a user terminal, causes the processor to implement at least the control method according to the tenth aspect.
In a thirteenth aspect, an embodiment of the present invention provides a control method, applied to a user equipment, where the method includes:
acquiring remote control identification information displayed on a display interface corresponding to a video conference terminal, wherein the remote control identification information corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
In a fourteenth aspect, an embodiment of the present invention provides a control apparatus, which is applied to a user terminal, and the apparatus includes:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring remote control identification information displayed on a display interface corresponding to a video conference terminal, and the remote control identification information corresponds to a video conference participated by the video conference terminal;
the display module is used for displaying a control interface corresponding to the video conference on the user terminal;
and the sending module is used for responding to the operation behavior of the control interface and sending a corresponding remote control instruction to the video conference terminal through the server so as to enable the video conference terminal to execute the remote control instruction.
In a fifteenth aspect, an embodiment of the present invention provides a user terminal, where the terminal device includes a fifth processor and a fifth memory, where the fifth memory has stored thereon an executable code, and when the executable code is executed by the fifth processor, the fifth processor is enabled to implement at least the control method according to the thirteenth aspect.
An embodiment of the present invention provides a non-transitory machine-readable storage medium, having stored thereon executable code, which, when executed by a processor of a user terminal, causes the processor to implement at least the control method according to the thirteenth aspect.
In a sixteenth aspect, an embodiment of the present invention provides a control method, applied to a user equipment, where the method includes:
acquiring remote control identification information displayed on a display interface corresponding to a conference terminal;
and displaying a control interface on the user terminal.
In a seventeenth aspect, an embodiment of the present invention provides a control apparatus, applying a user terminal, where the apparatus includes:
the acquisition module is used for acquiring remote control identification information displayed on a display interface corresponding to the conference terminal;
and the display module is used for displaying a control interface on the user terminal.
Eighteenth, an embodiment of the present invention provides a user terminal, where the terminal device includes a sixth processor and a sixth memory, where the sixth memory stores an executable code thereon, and when the executable code is executed by the sixth processor, the sixth processor is enabled to implement at least the control method according to the sixteenth aspect.
An embodiment of the present invention provides a non-transitory machine-readable storage medium, having stored thereon executable code, which, when executed by a processor of a user terminal, causes the processor to implement at least the control method according to the sixteenth aspect.
In a nineteenth aspect, an embodiment of the present invention provides a control system, including:
the system comprises video conference terminals participating in a video conference, a display interface corresponding to the video conference terminals, user terminals and a server;
the video conference terminal is used for displaying the two-dimensional code corresponding to the video conference on the display interface, receiving a remote control instruction forwarded by the server from the user terminal, and executing the remote control instruction;
the user terminal is used for scanning the two-dimension code through the instant messaging client; displaying a control interface corresponding to the video conference on the user terminal; responding to the operation behavior of the control interface, and sending the remote control instruction to the server;
and the server is used for forwarding the remote control instruction to the video conference terminal.
The following video conference scenario is assumed: people in a plurality of conference rooms need to carry out video conferences, each conference room is provided with a video conference terminal, the video conference terminals are correspondingly provided with a display interface, for example, the video conference terminals are connected with the display interface such as a television, and the display interface is used as the display interface. Taking a video conference terminal (referred to as a destination video conference terminal) in any conference room (referred to as a destination conference room) as an example, the video conference terminal can display video data of a local conference site on a display interface, and can also display video data of a conference site where other video conference terminals participating in the video conference are located on the display interface. When a person in a target conference room wants to control a target video conference terminal, for example, to control the display effect of each video data displayed on a display interface, the control scheme provided by the embodiment of the present invention may be adopted.
Specifically, the destination video conference terminal can display remote identification information such as a two-dimensional code on the display interface, so that any person in the destination conference room can conveniently obtain the remote control right of the destination video conference terminal by using the user terminal of the person to scan the two-dimensional code, and further operate a control item contained in the control interface displayed on the user terminal, so that the control of the video conference can be simply and conveniently realized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of a control system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of remote control identification information according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a code scanning function interface of an instant messaging client according to an embodiment of the present invention;
fig. 4 is a schematic diagram of another remote control identification information provided in an embodiment of the present invention;
fig. 5 is a schematic diagram of a remote control identification information input interface according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a control interface according to an embodiment of the present invention;
FIGS. 7 a-7 e are schematic diagrams of interface states of a remote control process according to an embodiment of the present invention;
FIGS. 8 a-8 f are schematic diagrams of interface states of another remote control process provided by embodiments of the present invention;
fig. 9 is a flowchart of a control method according to an embodiment of the present invention;
FIG. 10 is a flow chart of another control method provided by an embodiment of the present invention;
FIG. 11 is a schematic diagram of another control system according to an embodiment of the present invention;
FIG. 12 is a schematic view of another control interface provided by an embodiment of the present invention;
fig. 13 is a schematic structural diagram of a control device according to an embodiment of the present invention;
fig. 14 is a schematic structural diagram of a video conference terminal corresponding to the control device provided in the embodiment shown in fig. 13;
fig. 15 is a schematic structural diagram of another control device according to an embodiment of the present invention;
fig. 16 is a schematic structural diagram of a video conference terminal corresponding to the control device provided in the embodiment shown in fig. 15;
fig. 17 is a schematic structural diagram of another control device according to an embodiment of the present invention;
fig. 18 is a schematic structural diagram of a conference terminal corresponding to the control device provided in the embodiment shown in fig. 17;
FIG. 19 is a schematic structural diagram of another control device according to an embodiment of the present invention;
fig. 20 is a schematic structural diagram of a user terminal corresponding to the control device provided in the embodiment shown in fig. 19;
fig. 21 is a schematic structural diagram of another control device according to an embodiment of the present invention;
fig. 22 is a schematic structural diagram of a user terminal corresponding to the control device provided in the embodiment shown in fig. 21;
fig. 23 is a schematic structural diagram of another control device according to an embodiment of the present invention;
fig. 24 is a schematic structural diagram of a user terminal corresponding to the control device provided in the embodiment shown in fig. 23.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and "a plurality" typically includes at least two.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
In addition, the sequence of steps in each method embodiment described below is only an example and is not strictly limited.
Fig. 1 is a schematic composition diagram of a control system according to an embodiment of the present invention, and as shown in fig. 1, the control system includes: the system comprises video conference terminals participating in the video conference, a display interface corresponding to the video conference terminals, user terminals and a server.
In general, video conferencing refers to conferencing in which people located at different sites communicate "face-to-face" through a network and associated equipment. In a practical scenario, each conference site may deploy a video conference terminal, and therefore, in fig. 1, it is assumed that a currently ongoing video conference is participated in by people located in conference room 1 at one site and in conference room 2 at another site. And it is assumed that a video conference terminal a is deployed in conference room 1 and a video conference terminal b is deployed in conference room 2.
In addition, each video conference terminal corresponds to a display interface, such as the display interface a corresponding to the video conference terminal a and the display interface B corresponding to the video conference terminal a in fig. 1.
In practical application, the video conference terminal and the display interface can be realized in various forms.
For example, in an optional manner, the video conference terminal may be a host that is internally integrated with computing and storage resources such as a processor and an operating system but does not have a large-size screen, and at this time, the display interface corresponding to the video conference terminal may be a television or a simple display that is externally connected to the video conference terminal.
For another example, in another optional manner, the video conference terminal may be an electronic device having computing and storage resources and a large-size screen, and at this time, the display interface corresponding to the video conference terminal is the display interface of the video conference terminal itself.
It is worth noting that, in order to implement the video conference function, audio and video capture devices such as cameras and network devices such as wireless routers are also disposed in the conference room 1 and the conference room 2 illustrated in fig. 1, such as the camera 1 and the wireless router R1 disposed in the conference room 1, and the camera 2 and the wireless router R2 disposed in the conference room 2.
The video conference terminal accesses the network through the wireless router so as to be in communication interaction with the server.
In an alternative, the camera may be an integrated device within the video conference terminal. In another alternative, the camera may be a device that is provided separately from the video conference terminal but is connected to the video conference terminal.
In the case of the video conference terminal a in fig. 1, the video data V1 of the scene where the video conference terminal a is located (i.e. corresponding to the conference room 1) can be collected by the corresponding camera 1, and the camera 1 sends the collected video data V1 to the video conference terminal a. The video conference terminal a can display the video data V1 on the display interface a on the one hand and can transmit the video data V1 to the server, which synchronizes the video data V1 to the video conference terminal b, which is also participating in the current video conference, on the other hand. Thus, the video conference terminal B displays, on its corresponding display interface B, the video data V1 in addition to the video data V2 of the local location (i.e., corresponding to the conference room 2) captured by the camera 2. Likewise, it is understood that the video data V2 corresponding to the video conference terminal b is also displayed on the display interface a. This achieves the effect of a "face-to-face" communication between conference room 1 and people in conference room 2.
As can be seen from the example in fig. 1, multiple paths of video data can be displayed on the display interface corresponding to a certain video conference terminal. Wherein the plurality of video data may optionally correspond to a plurality of video conference terminals participating in the same video conference, i.e. to a plurality of conference sites participating in the video conference. Alternatively, the multiple video data may also correspond to different participants.
In practical application, the display strategy of the multiple paths of video data on the display interface corresponding to a certain video conference terminal can be preset.
For example, the display interface may be subjected to multi-split screen processing according to the number of paths of the video data to obtain a plurality of windows, and one path of video data may be displayed in each window.
For another example, a larger window (which may be referred to as a main window) may be disposed at a visual focus position of the display interface, and one or more small windows may be disposed around the main window than below the main window, so that one path of video data may be displayed in the main window and the other paths of video data may be displayed in the small windows, respectively. At this time, when there are two paths of video data in total, such as for the display interface a in fig. 1, the video data V2 on the side of the video conference terminal b can be realized in the main window, and the local video data V1 is displayed in the small window, because it is more concerned about the video picture on the side of the conference room 2 for the people in the conference room 1. When there are more than two paths of video data in total, which path of the multiple paths of video data is displayed in the main window may be determined according to a set policy, for example, a path of video data is set to be displayed in the main window, for example, a path of video data which is first uploaded to the server is set to be displayed in the main window, and so on.
In the scenario illustrated in fig. 1, it is assumed that a person in conference room 1 wants to control video conference terminal a to change the layout style of multiple paths of video data in display interface a, or wants to turn off a path of video data in display interface a, and so on, and then the person can implement the control by using the control scheme provided in the embodiment of the present invention.
In summary, the control scheme is: the video conference terminal a can display the remote control identification information corresponding to the currently-performed video conference on the display interface a, for example, a two-dimensional code, so that any person in the conference room 1 can conveniently obtain the remote control right of the video conference terminal a by scanning the remote control identification information by using the user terminal of the person, and further operate the control item contained in the control interface displayed on the user terminal, thereby simply and conveniently realizing various controls on the video conference.
When the remote control identification information is represented in the form of a two-dimensional code, any person can scan the two-dimensional code through an instant messaging client in the user terminal of the person to obtain the remote control right of the video conference terminal a.
Optionally, to implement the above control scheme, actions that the video conference terminal, the user terminal, and the server need to complete are as follows:
and the video conference terminal is used for displaying the two-dimensional code corresponding to the video conference on the corresponding display interface, receiving the remote control instruction transmitted from the user terminal by the server and executing the remote control instruction.
The user terminal is used for scanning the two-dimensional code through the instant messaging client; displaying a control interface corresponding to the video conference on the user terminal; and responding to the operation behavior of the control interface, and sending the remote control instruction to the server.
And the server is used for forwarding the received remote control instruction to the video conference terminal.
In the embodiment of the present invention, the user terminal may be a mobile phone, a notebook computer, or other terminal devices.
For convenience of understanding, taking the video conference terminal a illustrated in fig. 1 as an example, it is assumed that the user X in the conference room 1 wants to control the video conference terminal a, and the implementation of the control process is exemplarily described below in connection with the following.
As shown in fig. 2, it is assumed that the current video conference terminal a displays video data V1 and video data V2 on the display interface a, the video data V1 corresponding to the video conference terminal a, and the video data V2 corresponding to the video conference terminal b. And suppose that the display interface A is subjected to two-screen split processing, and is divided into a left window and a right window which are respectively used for displaying the two paths of video data. In addition, remote control identification information corresponding to the currently-performed video conference is also displayed at a certain position of the display interface a.
In practical applications, the organizer of the video conference may create video conference information in the server in advance, which may include information such as conference subject, conference time, used conference rooms, participants, and the like.
After the server obtains the video conference information, optionally, an identifier corresponding to the video conference information, called a conference identifier, may be assigned, where the conference identifier is used to distinguish different video conference information, and may be a string of unique character strings generated randomly. In addition, optionally, the server may also learn, based on a preset correspondence between the conference room and the video conference terminal, each video conference terminal identifier corresponding to the video conference information.
Based on this, in an optional embodiment, the server may generate remote control identification information corresponding to the video conference according to the conference identifier, and send the remote control identification information to each video conference terminal when appropriate. The suitable time may be, for example, several minutes before the meeting time. In this embodiment, the remote control identification information received by each video conference terminal is the same. In another optional embodiment, the server may generate remote identification information corresponding to each video conference terminal according to each video conference terminal identifier and the conference identifier, where the remote identification information received by each video conference terminal may be different.
In the above alternative embodiment, the remote control identification information may be implemented as a graphic code such as a two-dimensional code, as shown in fig. 2, which is a case where the video conference terminal a displays a two-dimensional code graphic and video data V1 and V2 on the display interface a shown in fig. 2.
When the remote control identification information is implemented as a graphic code such as a two-dimensional code, assuming that the user X in the conference room 1 wants to control the video conference terminal a, the user X can scan the two-dimensional code using its user terminal to obtain the remote control right of the video conference terminal a. Optionally, a user terminal of the user X, such as a mobile phone, may have a specific instant messaging client running thereon, as shown in fig. 3, a two-dimension code scanning function item "scan" is provided in an interface of the instant messaging client, so that the user X may scan the two-dimension code through the instant messaging client to obtain a remote control right of the video conference terminal a. The server may be an instant messaging server, as appropriate for such an implementation.
Of course, in another alternative embodiment, the server may also randomly generate a string of character strings as the remote control identification information corresponding to the video conference, where the string of character strings may be a combination of numbers and/or letters, as shown in fig. 4, and in fig. 4, it is illustrated that the video conference terminal a displays the video data V1, the video data V2, and the remote control codes on the display interface a: 302946 in which case 302946 represents remote control identification information. At this time, optionally, a specific conference software may be run in the user terminal of the user X, a remote control identification information input interface as illustrated in fig. 5 may be provided in the conference software, and the user X may input the remote control identification information — 302946 displayed on the display interface a in the interface to obtain the remote control right of the video conference terminal a.
First, it should be noted that the aforementioned user X obtains the remote control right of the video conference terminal a, which means that the user terminal of the user X is used as a remote controller, and the user X can realize the remote control of the video conference terminal a through the user terminal.
Secondly, it should be noted that the user terminal as a remote controller does not need to establish a direct communication connection with the video conference terminal a, and even the user terminal and the video conference terminal a may not be in the same lan.
In order to enable the participants and other related personnel to find out the function of remotely controlling the video conference terminal in the environment through the user terminal of the participants and the like in time, the information displayed in association with the remote control identification information can also include text guide information, such as: please scan the two-dimensional code with the mobile phone to change your mobile phone into a remote controller.
In addition, in the embodiment of the present invention, the remote control of the user terminal on the video conference terminal does not mean that a physical button arranged on the user terminal can be operated to directly send a remote control instruction to the video conference terminal, but means that the purpose of remote control is achieved by operating a visual control interface.
Specifically, referring to fig. 6, still taking the example that the user X wants to remotely control the video conference terminal a, after the user X obtains the remote control identification information through its user terminal, a control interface as shown in fig. 6 may be displayed on the user terminal, where the control interface may include details of the current video conference, such as conference subject, conference time, conference participants, and the like, and in addition, may include one or more control items. Fig. 6 illustrates two control items of changing the layout style and viewing the TA screen, but in actual application, other control items may be set according to the control requirements.
Taking the remote control identification information as a two-dimensional code as an example, the detail information of the video conference contained in the control interface is obtained in the following way: and the user terminal sends a query request to the server, the query request comprises the two-dimension code, the server acquires the detail information of the video conference corresponding to the two-dimension code and sends the detail information to the user terminal, and the user terminal displays the detail information in a control interface.
Since the server allocates the remote control identification information to the video conference when the video conference is created, the server may store therein a correspondence between the remote control identification information and the detail information of the video conference. Therefore, when the user terminal obtains the remote control identification information and then sends an inquiry request containing the remote control identification information to the server, the server can inquire the detail information of the corresponding video conference according to the corresponding relation.
In an optional embodiment, when receiving the query request from the user terminal, the server may further authenticate the query request, that is, determine whether the user corresponding to the user terminal has the right to remotely control a certain video conference terminal. Specifically, the query request may carry a user identifier corresponding to the user terminal, such as a user name, a job/role, and the like, and the server determines whether the corresponding user has a right to remotely control a certain video conference terminal according to the user identifier. Such as: if the user name exists in a participant list of the video conference, the user is considered to have remote control authority; if the user name exists in the participant list of the video conference and the position/role of the user is a department director or a conference host, the user is considered to have the remote control authority.
In the following, some remote control operations that can be performed on the video conference terminal by the user terminal are exemplified, and the foregoing example is still that the user X remotely controls the video conference terminal a by the user terminal.
In an optional embodiment, in response to a selection behavior of the user X on the first layout style included in the control interface, the user terminal may send a first remote control instruction to the video conference terminal a through the server, that is, the user terminal sends the first remote control instruction corresponding to the first layout style to the server, and the server forwards the remote control instruction to the video conference terminal a. When the remote control identification information includes the identification of the video conference terminal a, the first remote control instruction may include the identification of the video conference terminal a, which is obtained by the user terminal through identifying the remote control identification information, and the server forwards the first remote control instruction to the video conference terminal a accordingly.
As shown in fig. 7a, the control interface may include a control item for changing the layout style, and when the user X selects, i.e., clicks, the control item, several optional layout styles as shown in fig. 7b may be displayed: the three icons from left to right correspond to a first layout style, a second layout style, and a third layout style in this order.
In this embodiment, assuming that the user X selects the icon corresponding to the first layout style, the first remote control instruction is triggered to the server, and the server forwards the first remote control instruction to the video conference terminal a.
As shown in fig. 7c, after receiving the first remote control instruction, the video conference terminal a displays first video data in a first window of the display interface a according to the first layout style, and displays second video data in a second window of the display interface a, where the first video data and the second video data correspond to different objects participating in the video conference; the first window is located at the visual focus position of the display interface A.
Wherein the different objects may include: different participants or different conference locations, which correspond to different video conference terminals.
Thus, alternatively, the first video data may be video data V2 described in the foregoing, and the second video data may be video data V1 described in the foregoing, the first video data corresponding to conference room 2 in which video conference terminal b is located, and the second video data corresponding to conference room 1 in which video conference terminal a is located.
As can be seen from the schematic illustration in fig. 7c, the first layout style in this embodiment is to display each piece of video data uploaded by each video conference terminal participating in the video conference, except that one of the pieces of video data is displayed in the first window serving as the main window, and the other pieces of video data are displayed in the second window serving as the small window.
Herein, the first window is located at the visual focus position of the display interface, which generally means that the first window is located at the middle position of the display interface and has a larger size, i.e. the size of the first window is much larger than that of the second window.
Further, the user X can also switch the video data displayed in the first window. Optionally, as shown in fig. 7d, the control interface may further include: looking at the control item of the TA's picture, in cooperation with the control item, the control interface may also include, for example, the identities of the participants, such as the names/avatars and the meeting room identity. Therefore, if the user X wants to watch the video image of a specific participant, the user X can select the identifier of the participant and further click "watch the image of TA", at this time, the user terminal sends a corresponding remote control instruction to the video conference terminal a through the server, the video conference terminal a can control the corresponding camera to collect the video image of the participant and display the collected video image in the first window, and then the video data originally displayed in the first window can be displayed by adding a second window. Similarly, if the user X wants to watch a video picture of a certain conference room, the user X selects the identifier of the conference room, and then clicks "watch the picture of TA", at this time, the user terminal sends a corresponding remote control instruction to the video conference terminal a through the server, and the video conference terminal a can switch the video data uploaded by the video conference terminal corresponding to the conference room to the first window for displaying.
For example, as shown in fig. 7d, the user X selects the conference room identifier, conference room 1, corresponding to the video conference terminal b, and at this time, as shown in fig. 7e, the video data V1 is switched to be displayed in the first window, and the video data V2 originally displayed in the first window is switched to be displayed in the second window.
In another alternative embodiment, the following scenario is assumed: people in the conference room 1 and the conference room 2 participate in a video conference, during the conference, a user may share a piece of data such as a table, a PPT presentation, and the like to people, and to achieve the sharing purpose, the user may project the data onto a display interface of the conference room in a screen projection manner, at this time, a corresponding video conference terminal may be set by default, and when screen projection data is generated, the screen projection data is displayed in a first window of a corresponding display interface. Based on this, assuming that a user in the conference room 2 triggers a screen-casting action, for the video conference terminal a in the conference room 1, the video conference terminal a needs to acquire corresponding screen-casting data, and display the screen-casting data, i.e., the PPT presentation, in the first window of the display interface a, as shown in fig. 8 a. The video conference terminal b in the conference room 2 can send screen projection data uploaded by a local user to the server, and the server can send the screen projection data to other video conference terminals participating in the video conference, so that the video conference terminal a can obtain the screen projection data.
Alternatively, as shown in fig. 8a, when the screen projection data is displayed in the first window, the video data originally displayed in the first window is assumed to be the video data V1, and at this time, the video data may be displayed in a newly added second window, and it is assumed that there is already a second window in which the video data V2 is displayed.
In the screen projection scene, the participant often pays more attention to the video picture of the screen projector side, so that, at the moment, for example, a user X can remotely control the video conference terminal a where the user X is located through the user terminal, so that the purpose that only one second window is reserved and the video data of the screen projector side is displayed in the second window is achieved. Specifically, as shown in fig. 8b, at this time, the user X may select an icon corresponding to the second layout style in the control interface to trigger the second remote control instruction. As shown in fig. 8c, when the video conference terminal a receives the second remote control instruction, the third video data is displayed in the second window of the display interface a according to the second layout style, where the third video data corresponds to the video conference terminal at the screen projector, that is, the third video data is video data of the environment where the screen projector is located, and in fig. 8c, it is assumed that the third video data is video data V2.
Optionally, the display position of the second window in the second layout style may be different from the display position of the second window in the first layout style, for example, in the first layout style, the second window is located below the first window, and the first window and the second window are independent from each other and have no occlusion; in the second layout style, the second window may be displayed in a floating manner at a position within the first window.
Taking the case that the screen projector is located in the conference room 2, that is, corresponds to the video conference terminal b, the following describes a specific processing procedure of the video conference terminal a corresponding to the conference room 1 after receiving the second remote control instruction triggered by the user X: as described above, the server may receive screen-casting data sent by the video conference terminal b, the server may further send a screen-casting notification to the video conference terminal a, and the video conference terminal a receives the screen-casting notification, where the screen-casting notification includes the screen-casting data and an identifier of the video conference terminal at the screen-casting person, that is, an identifier of the video conference terminal b. Therefore, the video conference terminal a determines the third video data corresponding to the environment where the screen projector is located, namely the third video data corresponding to the video conference terminal b, from the obtained multiple paths of video data according to the identifier of the video conference terminal b. In this example, the multiple paths of video data include video data uploaded by the video conference terminal a and video data uploaded by the video conference terminal b.
As can be seen from the schematic diagram of fig. 8c, the second layout style in this embodiment refers to displaying the screen projection data in the first window, and only setting one second window in which the video data of the environment where the screen projector is located is displayed.
In another optional embodiment, for example, in the above screen projection scene, in order to enable each participant to focus on the screen projection data more clearly, a third layout style may be provided for retracting each second window and displaying only the screen projection data in the first window. Accordingly, assuming that the user X considers that the video data displayed in the second window affects the clear view of the screen projection data, an icon corresponding to the third layout style may be selected in the control interface as shown in fig. 8d, thereby triggering a third remote control instruction. As shown in fig. 8e, after receiving the third remote control command, the video conference terminal a may close the second window according to the third layout style.
In yet another alternative embodiment, for example, in the above screen-shot scenario, the remote control of the video conference terminal a may implement other control functions, such as page turning, cursor movement, insertion of an annotation box, and the like illustrated in fig. 8f, in addition to the above change of the layout style.
To sum up, the video conference terminal displays the remote control identification information corresponding to the currently performed video conference on the display interface, so that any user can scan or input the remote control identification information by using the user terminal of the user, the user terminal of the user can be conveniently changed into a remote controller, and the remote control of the corresponding video conference terminal can be realized by operating the visual control interface displayed on the user terminal of the user.
Fig. 9 is a flowchart of a control method according to an embodiment of the present invention, where the control method may be executed by any video conference terminal participating in a video conference. As shown in fig. 9, the method includes the steps of:
901. and displaying the remote control identification information corresponding to the video conference on a display interface.
902. And receiving a remote control instruction transmitted by the server from the user terminal, wherein the user terminal displays a control interface corresponding to the video conference by acquiring the remote control identification information, and the user terminal sends the remote control instruction to the server in response to the operation behavior of the control interface.
903. And executing the remote control command.
As described above, the representation form of the remote control identification information may be a two-dimensional code. At this time, the user terminal may scan the two-dimensional code through the instant messaging client operating inside to display the control interface. Correspondingly, the server comprises an instant messaging server corresponding to the instant messaging client.
As described above, optionally, the remote control command may correspond to a selection action of a first layout style included in the control interface, at this time, the video conference terminal may display first video data in a first window of the display interface according to the first layout style, and display second video data in a second window of the display interface, where the first video data and the second video data correspond to different objects participating in the video conference, and the first window is located at a visual focus position of the display interface.
As described above, optionally, in the screen projection scene, the video conference terminal may further obtain screen projection data generated during the video conference, so as to display the screen projection data in the first window of the display interface. In the screen-projecting scene, a remote control instruction corresponding to a selection behavior of a second layout style included in the control interface may be further generated, and based on the remote control instruction, the video conference terminal may display third video data in a second window of the display interface according to the second layout style, where the third video data corresponds to the screen-projector.
The video conference terminal acquires screen projection data generated during a video conference, and the screen projection data can be realized as follows: and receiving a screen projection notification sent by the server, wherein the screen projection notification comprises the screen projection data and the identification of the video conference terminal at the screen projector. Therefore, the video conference terminal can determine the third video data from the obtained multiple paths of video data according to the identification of the video conference terminal in the screen-casting notification, wherein the multiple paths of video data correspond to different conference places participating in the video conference, and the different conference places correspond to different video conference terminals.
As described above, in the screen-shot scene, a remote control instruction corresponding to a selection behavior of a third layout style included in the control interface may be triggered, and at this time, the video conference terminal may close the second window according to the third layout style, and only reserve the first window to display the screen-shot data.
As described above, in the screen shot scene, control functions such as page turning, cursor movement, annotation box insertion, and the like may also be triggered.
In addition, in practical application, control functions such as closing a certain path of video data and muting a certain path of video data can be realized.
The detailed execution process of this embodiment may refer to the descriptions in the foregoing other embodiments, which are not described herein again.
Fig. 10 is a flowchart of another control method provided in an embodiment of the present invention, where the control method may be executed by the ue in the foregoing embodiment. As shown in fig. 10, the following steps may be included:
1001. and acquiring remote control identification information displayed on a display interface corresponding to the video conference terminal, wherein the remote control identification information corresponds to the video conference in which the video conference terminal participates.
1002. And displaying a control interface corresponding to the video conference on the user terminal.
Optionally, the remote control identification information is a two-dimensional code, and at this time, the user terminal may scan the two-dimensional code through the running instant messaging client to obtain the remote control right of the video conference terminal, so as to display the control interface. At this time, the server described below includes an instant messaging server corresponding to the instant messaging client.
1003. And responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so as to enable the video conference terminal to execute the remote control instruction.
As described above, optionally, in response to a selection action of a first layout style included in the control interface, the user terminal may issue, through the server, a first remote control instruction to the video conference terminal, so that the video conference terminal displays, according to the first layout style, first video data in a first window of a corresponding display interface and second video data in a second window of the display interface, where the first video data and the second video data correspond to different objects participating in the video conference; the first window is located at a visual focus position of the display interface.
As described above, optionally, in response to the selection behavior of the second layout style included in the control interface, the user terminal may send a second remote control instruction to the video conference terminal through the server, so that the video conference terminal displays the screen projection data in the first window of the display interface and displays the third video data in the second window of the display interface according to the second layout style, where the third video data corresponds to the screen projector.
As described above, optionally, in response to the selecting act of the third layout style included in the control interface, the user terminal may issue, through the server, a third remote control instruction to the video conference terminal, so that the video conference terminal closes the second window according to the third layout style.
The detailed execution process of this embodiment may refer to the descriptions in the foregoing other embodiments, which are not described herein again.
In the above embodiments, the execution process of the control scheme provided by the embodiments of the present invention is introduced in a video conference scene, and actually, other conference scenes besides the video conference scene may also be applicable to the control scheme, for example, a scene where a conference is organized only in one conference room.
The difference between the video conference scene and such a scene in which a conference is conducted in one conference room is explained.
It can be understood that, in general, a video conference scene refers to a scene in which people located in different conference places, i.e. different conference rooms, conduct a video conference through a network and related devices, and in this scene, people located in a certain conference room can locally see video pictures of people located in other conference rooms. In the video conference scene, video conference terminals at different conference places need to be connected with the server through a network, and any one of the video conference terminals can obtain video pictures corresponding to other video conference terminals through the server and display the video pictures on corresponding display interfaces.
In a scenario where a conference is organized only in one conference room, as shown in fig. 11, in order to implement the control scheme provided in the embodiment of the present invention, the control system may include: a conference terminal (or called a conference host), a display interface corresponding to the conference terminal, and a user terminal. Of course, according to the actual meeting requirements, a wireless router, a camera and other related devices can be further included. In this scenario, generally, the purpose of remotely controlling the conference terminal by the user terminal is to control the display content in the display interface corresponding to the conference terminal.
In the control system shown in fig. 11, to realize remote control of the conference terminal by the user terminal, the respective working processes of the user terminal and the conference terminal are as follows:
and the conference terminal is used for displaying the remote control identification information on the display interface and executing the remote control instruction sent by the user terminal.
And the user terminal is used for acquiring the remote control identification information displayed on the display interface corresponding to the conference terminal, displaying the control interface on the user terminal, responding to the operation behavior of the control interface and sending the remote control instruction to the conference terminal.
In practical application, as described above, the remote identification information may be a two-dimensional code, and the user terminal may scan the two-dimensional code through an instant messaging client operating with the content, and further display a control interface.
In the above scenario to which the control system shown in fig. 11 is applied, generally, the data content displayed on the display interface is often some shared data, and therefore, optionally, a control item for performing some operations on the shared data may be included in the control interface, such as a page turning, cursor moving, brush pen, inserting annotation box, and other control items illustrated in fig. 12.
The control device of one or more embodiments of the present invention will be described in detail below. Those skilled in the art will appreciate that these control devices can each be configured using commercially available hardware components through the steps taught in this scheme.
Fig. 13 is a schematic structural diagram of a control device according to an embodiment of the present invention, and as shown in fig. 13, the control device includes: display module 11, receiving module 12, processing module 13.
And the display module 11 is configured to display the two-dimensional code corresponding to the video conference on a display interface.
A receiving module 12, configured to receive a remote control instruction forwarded by a server from a user terminal, where the user terminal scans the two-dimensional code through an instant messaging client to display a control interface corresponding to the video conference, and in response to an operation behavior on the control interface, the user terminal sends the remote control instruction to the server.
The processing module 13 is used for executing the remote control instruction;
optionally, the remote control instruction corresponds to a selection action of a first layout style included in the control interface. At this time, the processing module 13 is specifically configured to: displaying first video data in a first window of the display interface according to the first layout style, and displaying second video data in a second window of the display interface, wherein the first video data and the second video data correspond to different objects participating in the video conference; the first window is located at a visual focus position of the display interface.
Wherein the different objects include: different participants or different conference locations, which correspond to different video conference terminals.
Optionally, in a screen-projection scenario, the processing module 13 may be further configured to: screen projection data generated during the video conference is acquired. The display module 11 may further be configured to: and displaying the screen projection data in a first window of the display interface, wherein the first window is positioned at the visual focus position of the display interface.
Thus, in the screen projection scene, optionally, the remote control instruction corresponds to a selection behavior of a second layout style included in the control interface, and at this time, the processing module 13 is specifically configured to: and displaying third video data in a second window of the display interface according to the second layout style, wherein the third video data corresponds to the screen projector.
Wherein, the processing module 13 may specifically be configured to: receiving a screen-casting notification sent by the server, wherein the screen-casting notification comprises screen-casting data and an identifier of a video conference terminal at the screen-casting person, and determining the third video data from obtained multiple paths of video data according to the identifier of the video conference terminal, wherein the multiple paths of video data correspond to different conference places participating in the video conference, and the different conference places correspond to different video conference terminals.
Optionally, the remote control instruction may further correspond to a selection action of a third layout style included in the control interface. At this time, the processing module 13 is specifically configured to: and closing the second window according to the third layout style.
The apparatus shown in fig. 13 may perform the steps performed by the video conference terminal in the foregoing embodiment, and the detailed performing process and technical effect refer to the description in the foregoing embodiment, which are not described herein again.
In one possible design, the structure of the control device shown in fig. 13 may be implemented as a video conference terminal, as shown in fig. 14, and the video conference terminal may include: a first processor 21, a first memory 22. Wherein the first memory 22 has stored thereon executable code which, when executed by the first processor 21, causes the first processor 21 to implement at least the following steps:
displaying a two-dimensional code corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
and the user terminal scans the two-dimension code through an instant messaging client to display a control interface corresponding to the video conference, and responds to the operation behavior of the control interface and sends the remote control instruction to the server.
Optionally, the video conference terminal may further include a first communication interface 23 for communicating with other devices.
In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of a video conference terminal, causes the processor to implement at least the following steps:
displaying a two-dimensional code corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
and the user terminal scans the two-dimension code through an instant messaging client to display a control interface corresponding to the video conference, and responds to the operation behavior of the control interface and sends the remote control instruction to the server.
Fig. 15 is a schematic structural diagram of another control device according to an embodiment of the present invention, where the device corresponds to the video conference terminal in the foregoing embodiment. As shown in fig. 15, the apparatus includes: a display module 31, a receiving module 32 and a processing module 33.
And the display module 31 is configured to display the remote identification information corresponding to the video conference on a display interface.
A receiving module 32, configured to receive a remote control instruction forwarded by a server from a user terminal, where the user terminal displays a control interface corresponding to the video conference by obtaining the remote control identification information, and in response to an operation behavior on the control interface, the user terminal sends the remote control instruction to the server.
And the processing module 33 is used for executing the remote control instruction.
In one possible design, the structure of the control device shown in fig. 15 may be implemented as a video conference terminal, as shown in fig. 16, and the video conference terminal may include: a second processor 41, a second memory 42. Wherein said second memory 42 has stored thereon executable code which, when executed by said second processor 41, causes said second processor 41 to implement at least the following steps:
displaying remote control identification information corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
the user terminal displays a control interface corresponding to the video conference by acquiring the remote control identification information, and responds to the operation behavior of the control interface, and the user terminal sends the remote control instruction to the server.
Optionally, the video conference terminal may further include a second communication interface 43 for communicating with other devices.
In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of a video conference terminal, causes the processor to implement at least the following steps:
displaying remote control identification information corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
the user terminal displays a control interface corresponding to the video conference by acquiring the remote control identification information, and responds to the operation behavior of the control interface, and the user terminal sends the remote control instruction to the server.
Fig. 17 is a schematic structural diagram of another control device provided in an embodiment of the present invention, where the device corresponds to a conference terminal in the foregoing embodiment. As shown in fig. 17, the apparatus includes: a display module 51, a receiving module 52 and a processing module 53.
And the display module 51 is used for displaying the remote control identification information on the display interface.
A receiving module 52, configured to receive a remote control instruction sent by a user terminal; and the user terminal displays a corresponding control interface by acquiring the remote control identification information, and responds to the operation behavior of the control interface and sends the remote control instruction.
And the processing module 53 is configured to execute the remote control instruction.
In one possible design, the structure of the control device shown in fig. 17 may be implemented as a conference terminal, as shown in fig. 18, and the conference terminal may include: a third processor 61, a third memory 62. Wherein the third memory 62 has stored thereon executable code which, when executed by the third processor 61, causes the third processor 61 to at least perform the following steps:
displaying remote control identification information on a display interface;
receiving a remote control instruction sent by a user terminal;
executing the remote control instruction;
and the user terminal displays a corresponding control interface by acquiring the remote control identification information, and responds to the operation behavior of the control interface and sends the remote control instruction.
Optionally, the conference terminal may further include a third communication interface 63 for communicating with other devices.
In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored thereon, which when executed by a processor of a conference terminal, causes the processor to implement at least the following steps:
displaying remote control identification information on a display interface;
receiving a remote control instruction sent by a user terminal;
executing the remote control instruction;
and the user terminal displays a corresponding control interface by acquiring the remote control identification information, and responds to the operation behavior of the control interface and sends the remote control instruction.
Fig. 19 is a schematic structural diagram of another control device according to an embodiment of the present invention, where the device corresponds to the user terminal in the foregoing embodiment. As shown in fig. 19, the apparatus includes: a scanning module 71, a display module 72, and a transmitting module 73.
The scanning module 71 is configured to scan a two-dimensional code displayed on a display interface corresponding to a video conference terminal through an instant messaging client, where the two-dimensional code corresponds to a video conference in which the video conference terminal participates;
a display module 72, configured to display a control interface corresponding to the video conference on the user terminal;
and the sending module 73 is configured to send, in response to the operation behavior on the control interface, a corresponding remote control instruction to the video conference terminal through the server, so that the video conference terminal executes the remote control instruction.
In one possible design, the control device shown in fig. 19 may be implemented as a user terminal, such as a terminal device of a smart phone, a tablet computer, or the like. As shown in fig. 20, the user terminal may include: a fourth processor 81, and a fourth memory 82. Wherein the fourth memory 82 has stored thereon executable code which, when executed by the fourth processor 81, causes the fourth processor 81 to perform at least the following steps:
scanning a two-dimensional code displayed on a display interface corresponding to a video conference terminal through an instant messaging client, wherein the two-dimensional code corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
Optionally, the user terminal may further include a fourth communication interface 83 for communicating with other devices.
Additionally, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of a user terminal, causes the processor to implement at least the following steps:
scanning a two-dimensional code displayed on a display interface corresponding to a video conference terminal through an instant messaging client, wherein the two-dimensional code corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
Fig. 21 is a schematic structural diagram of another control device according to an embodiment of the present invention, where the device corresponds to the user terminal in the foregoing embodiment. As shown in fig. 21, the apparatus includes: the device comprises an acquisition module 91, a display module 92 and a sending module 93.
An obtaining module 91, configured to obtain remote control identification information displayed on a display interface corresponding to a video conference terminal, where the remote control identification information corresponds to a video conference in which the video conference terminal participates;
a display module 92, configured to display a control interface corresponding to the video conference on the user terminal;
and the sending module 93 is configured to send, in response to the operation behavior on the control interface, a corresponding remote control instruction to the video conference terminal through the server, so that the video conference terminal executes the remote control instruction.
In one possible design, the control device shown in fig. 21 may be implemented as a user terminal, such as a terminal device of a smart phone, a tablet computer, or the like. As shown in fig. 22, the user terminal may include: a fifth processor 221 and a fifth memory 222. Wherein the fifth memory 222 has stored thereon executable code, which when executed by the fifth processor 221, causes the fifth processor 221 to at least perform the following steps:
acquiring remote control identification information displayed on a display interface corresponding to a video conference terminal, wherein the remote control identification information corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
Optionally, the user terminal may further include a fifth communication interface 223 for communicating with other devices.
Additionally, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of a user terminal, causes the processor to implement at least the following steps:
acquiring remote control identification information displayed on a display interface corresponding to a video conference terminal, wherein the remote control identification information corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
Fig. 23 is a schematic structural diagram of another control device according to an embodiment of the present invention, where the device corresponds to the user terminal in the foregoing embodiment. As shown in fig. 23, the apparatus includes: an acquisition module 231, a display module 232, and a sending module 233.
The obtaining module 231 is configured to obtain the remote control identifier information displayed on the display interface corresponding to the conference terminal.
And a display module 232, configured to display a control interface on the user terminal.
In one possible design, the control device shown in fig. 23 may be implemented as a user terminal, such as a terminal device of a smart phone, a tablet computer, or the like. As shown in fig. 24, the user terminal may include: a sixth processor 241 and a sixth memory 242. Wherein the sixth memory 242 has stored thereon executable code, which when executed by the sixth processor 241, causes the sixth processor 241 to at least perform the following:
acquiring remote control identification information displayed on a display interface corresponding to a conference terminal;
and displaying a control interface on the user terminal.
Optionally, a sixth communication interface 243 may also be included in the user terminal for communicating with other devices.
Additionally, an embodiment of the present invention provides a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of a user terminal, causes the processor to implement at least the following steps:
acquiring remote control identification information displayed on a display interface corresponding to a conference terminal;
and displaying a control interface on the user terminal.
The above-described apparatus embodiments are merely illustrative, wherein the units described as separate components may or may not be physically separate. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course, can also be implemented by a combination of hardware and software. With this understanding in mind, the above-described aspects and portions of the present technology which contribute substantially or in part to the prior art may be embodied in the form of a computer program product, which may be embodied on one or more computer-usable storage media having computer-usable program code embodied therein, including without limitation disk storage, CD-ROM, optical storage, and the like.
The control method provided in the embodiment of the present invention may be executed by a certain program/software, the program/software may be provided by a network side, the user terminal and the conference terminal mentioned in the foregoing embodiment may download the program/software into a local nonvolatile storage medium, and when it needs to execute the foregoing control method, the CPU reads the program/software into a memory, and then the CPU executes the program/software to implement the control method provided in the foregoing embodiment, and the execution process may refer to the schematic in fig. 1 to fig. 12.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (30)

1. A control method is applied to a user terminal, and the method comprises the following steps:
scanning a two-dimensional code displayed on a display interface corresponding to a video conference terminal through an instant messaging client, wherein the two-dimensional code corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
2. The method of claim 1, further comprising:
sending a query request to the server, wherein the query request comprises the two-dimension code;
receiving the detail information of the video conference corresponding to the two-dimensional code fed back by the server;
displaying the detail information in the control interface.
3. The method according to claim 1, wherein the issuing, by the server, a corresponding remote control instruction to the video conference terminal in response to the operation behavior of the control interface comprises:
responding to a selection behavior of a first layout style contained in the control interface, and sending a first remote control instruction to the video conference terminal through the server so that the video conference terminal displays first video data in a first window of the display interface and second video data in a second window of the display interface according to the first layout style, wherein the first video data and the second video data correspond to different objects participating in the video conference; the first window is located at a visual focus position of the display interface.
4. The method of claim 3, wherein the different objects comprise: different participants or different conference locations, which correspond to different video conference terminals.
5. The method according to claim 1, wherein the issuing, by the server, a corresponding remote control instruction to the video conference terminal in response to the operation behavior of the control interface comprises:
and responding to a selection behavior of a second layout style contained in the control interface, and sending a second remote control instruction to the video conference terminal through the server so that the video conference terminal displays screen projection data in a first window of the display interface and displays third video data in a second window of the display interface according to the second layout style, wherein the third video data corresponds to a screen projector.
6. The method according to claim 5, wherein the issuing, by the server, a corresponding remote control instruction to the video conference terminal in response to the operation behavior of the control interface comprises:
and responding to a selection behavior of a third layout style contained in the control interface, and sending a third remote control instruction to the video conference terminal through the server so that the video conference terminal closes the second window according to the third layout style.
7. A control method is applied to a user terminal, and the method comprises the following steps:
acquiring remote control identification information displayed on a display interface corresponding to a video conference terminal, wherein the remote control identification information corresponds to a video conference in which the video conference terminal participates;
displaying a control interface corresponding to the video conference on the user terminal;
responding to the operation behavior of the control interface, and sending a corresponding remote control instruction to the video conference terminal through the server so that the video conference terminal executes the remote control instruction.
8. A control method is applied to a user terminal, and the method comprises the following steps:
acquiring remote control identification information displayed on a display interface corresponding to a conference terminal;
and displaying a control interface on the user terminal.
9. A control method, applied to a video conference terminal participating in a video conference, the method comprising:
displaying a two-dimensional code corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
and the user terminal scans the two-dimension code through an instant messaging client to display a control interface corresponding to the video conference, and responds to the operation behavior of the control interface and sends the remote control instruction to the server.
10. The method of claim 9, wherein the remote control directive corresponds to a selection behavior of a first layout style included in the control interface;
the executing the remote control instruction comprises:
displaying first video data in a first window of the display interface according to the first layout style, and displaying second video data in a second window of the display interface, wherein the first video data and the second video data correspond to different objects participating in the video conference; the first window is located at a visual focus position of the display interface.
11. The method of claim 10, wherein the different objects comprise: different participants or different conference locations, which correspond to different video conference terminals.
12. The method of claim 9, further comprising:
acquiring screen projection data generated during the video conference;
and displaying the screen projection data in a first window of the display interface, wherein the first window is positioned at the visual focus position of the display interface.
13. The method of claim 12, wherein the remote control directive corresponds to a selection behavior of a second layout style included in the control interface;
the executing the remote control instruction comprises:
and displaying third video data in a second window of the display interface according to the second layout style, wherein the third video data corresponds to the screen projector.
14. The method of claim 13, wherein the obtaining of the screen-shot data generated during the video conference comprises:
receiving a screen projection notification sent by the server, wherein the screen projection notification comprises the screen projection data and an identifier of a video conference terminal at the screen projector;
the method further comprises the following steps:
and determining the third video data from the obtained multiple paths of video data according to the identification of the video conference terminal, wherein the multiple paths of video data correspond to different conference places participating in the video conference, and the different conference places correspond to different video conference terminals.
15. The method of claim 13, wherein the remote control directive corresponds to a selection behavior of a third layout style included in the control interface;
the executing the remote control instruction comprises:
and closing the second window according to the third layout style.
16. A control method, applied to a video conference terminal participating in a video conference, the method comprising:
displaying remote control identification information corresponding to the video conference on a display interface;
receiving a remote control instruction forwarded by a server from a user terminal;
executing the remote control instruction;
the user terminal displays a control interface corresponding to the video conference by acquiring the remote control identification information, and responds to the operation behavior of the control interface, and the user terminal sends the remote control instruction to the server.
17. A control method is applied to a conference terminal, and comprises the following steps:
displaying remote control identification information on a display interface;
receiving a remote control instruction sent by a user terminal;
executing the remote control instruction;
and the user terminal displays a corresponding control interface by acquiring the remote control identification information, and responds to the operation behavior of the control interface and sends the remote control instruction.
18. A control apparatus, applied to a user terminal, the apparatus comprising:
the scanning module is used for scanning a two-dimensional code displayed on a display interface corresponding to a video conference terminal through an instant messaging client, wherein the two-dimensional code corresponds to a video conference in which the video conference terminal participates;
the display module is used for displaying a control interface corresponding to the video conference on the user terminal;
and the sending module is used for responding to the operation behavior of the control interface and sending a corresponding remote control instruction to the video conference terminal through the server so as to enable the video conference terminal to execute the remote control instruction.
19. A user terminal, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to carry out the control method of any one of claims 1 to 6.
20. A control apparatus, applied to a user terminal, the apparatus comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring remote control identification information displayed on a display interface corresponding to a video conference terminal, and the remote control identification information corresponds to a video conference participated by the video conference terminal;
the display module is used for displaying a control interface corresponding to the video conference on the user terminal;
and the sending module is used for responding to the operation behavior of the control interface and sending a corresponding remote control instruction to the video conference terminal through the server so as to enable the video conference terminal to execute the remote control instruction.
21. A user terminal, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform the control method of claim 7.
22. A control apparatus, applied to a user terminal, the apparatus comprising:
the acquisition module is used for acquiring remote control identification information displayed on a display interface corresponding to the conference terminal;
and the display module is used for displaying a control interface on the user terminal.
23. A user terminal, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform the control method of claim 8.
24. A control apparatus, applied to a video conference terminal participating in a video conference, the apparatus comprising:
the display module is used for displaying the two-dimensional code corresponding to the video conference on a display interface;
the receiving module is used for receiving the remote control instruction forwarded by the server from the user terminal;
the processing module is used for executing the remote control instruction;
and the user terminal scans the two-dimension code through an instant messaging client to display a control interface corresponding to the video conference, and responds to the operation behavior of the control interface and sends the remote control instruction to the server.
25. A video conference terminal, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to carry out the control method of any one of claims 9 to 15.
26. A control apparatus, applied to a video conference terminal participating in a video conference, the apparatus comprising:
the display module is used for displaying the remote control identification information corresponding to the video conference on a display interface;
the receiving module is used for receiving the remote control instruction forwarded by the server from the user terminal;
the processing module is used for executing the remote control instruction;
the user terminal displays a control interface corresponding to the video conference by acquiring the remote control identification information, and responds to the operation behavior of the control interface, and the user terminal sends the remote control instruction to the server.
27. A video conference terminal, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform the control method of claim 16.
28. A control apparatus, applied to a conference terminal, the apparatus comprising:
the display module is used for displaying the remote control identification information on a display interface;
the receiving module is used for receiving a remote control instruction sent by a user terminal;
the processing module is used for executing the remote control instruction;
and the user terminal displays a corresponding control interface by acquiring the remote control identification information, and responds to the operation behavior of the control interface and sends the remote control instruction.
29. A conference terminal, comprising: a memory, a processor; wherein the memory has stored thereon executable code which, when executed by the processor, causes the processor to perform the control method of claim 17.
30. A control system, comprising:
the system comprises video conference terminals participating in a video conference, a display interface corresponding to the video conference terminals, user terminals and a server;
the video conference terminal is used for displaying the two-dimensional code corresponding to the video conference on the display interface, receiving a remote control instruction forwarded by the server from the user terminal, and executing the remote control instruction;
the user terminal is used for scanning the two-dimension code through the instant messaging client; displaying a control interface corresponding to the video conference on the user terminal; responding to the operation behavior of the control interface, and sending the remote control instruction to the server;
and the server is used for forwarding the remote control instruction to the video conference terminal.
CN201910294573.2A 2019-04-12 2019-04-12 Control method, device, terminal and system Active CN111818292B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910294573.2A CN111818292B (en) 2019-04-12 2019-04-12 Control method, device, terminal and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910294573.2A CN111818292B (en) 2019-04-12 2019-04-12 Control method, device, terminal and system

Publications (2)

Publication Number Publication Date
CN111818292A true CN111818292A (en) 2020-10-23
CN111818292B CN111818292B (en) 2022-08-30

Family

ID=72843903

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910294573.2A Active CN111818292B (en) 2019-04-12 2019-04-12 Control method, device, terminal and system

Country Status (1)

Country Link
CN (1) CN111818292B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022127511A1 (en) * 2020-12-18 2022-06-23 北京字跳网络技术有限公司 Presentation method and apparatus, and electronic device
CN114938468A (en) * 2022-04-22 2022-08-23 海信视像科技股份有限公司 Display device, screen control method, and storage medium
WO2024001508A1 (en) * 2022-06-28 2024-01-04 腾讯科技(深圳)有限公司 Conference control method and apparatus, electronic device, storage medium, and program product

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110279638A1 (en) * 2010-05-12 2011-11-17 Alagu Periyannan Systems and methods for novel interactions with participants in videoconference meetings
US20120117156A1 (en) * 2010-11-05 2012-05-10 LogMeln, Inc. Network-based quick connect meeting service
CN102572371A (en) * 2011-12-07 2012-07-11 中兴通讯股份有限公司 Video session realizing method and system
US20140029474A1 (en) * 2012-07-27 2014-01-30 Crexendo, Inc. Voip service with streamlined conferencing options
CN103605491A (en) * 2013-11-08 2014-02-26 天脉聚源(北京)传媒科技有限公司 Method, mobile terminal and system of remote control display device
US20140185493A1 (en) * 2012-09-20 2014-07-03 Huawei Technologies Co., Ltd. Method, Device, and System for Accessing Conference
US20140313282A1 (en) * 2011-05-11 2014-10-23 Blue Jeans Network Methods and systems for using a mobile device to join a video conference endpoint into a video conference
WO2017166285A1 (en) * 2016-04-01 2017-10-05 华为技术有限公司 Method, device and system for switching conference terminal
CN108111322A (en) * 2016-11-24 2018-06-01 北京中创视讯科技有限公司 Web conference control method and device
CN108462853A (en) * 2017-02-22 2018-08-28 阿里巴巴集团控股有限公司 Control method, intelligent terminal and the video conference terminal of video conference terminal
KR101968448B1 (en) * 2018-11-16 2019-04-11 최상 Method for automatic control and monitoring smart quenching-tempering heat treatment process and system thereof

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110279638A1 (en) * 2010-05-12 2011-11-17 Alagu Periyannan Systems and methods for novel interactions with participants in videoconference meetings
US20120117156A1 (en) * 2010-11-05 2012-05-10 LogMeln, Inc. Network-based quick connect meeting service
US20140313282A1 (en) * 2011-05-11 2014-10-23 Blue Jeans Network Methods and systems for using a mobile device to join a video conference endpoint into a video conference
CN102572371A (en) * 2011-12-07 2012-07-11 中兴通讯股份有限公司 Video session realizing method and system
US20140029474A1 (en) * 2012-07-27 2014-01-30 Crexendo, Inc. Voip service with streamlined conferencing options
US20140185493A1 (en) * 2012-09-20 2014-07-03 Huawei Technologies Co., Ltd. Method, Device, and System for Accessing Conference
CN103605491A (en) * 2013-11-08 2014-02-26 天脉聚源(北京)传媒科技有限公司 Method, mobile terminal and system of remote control display device
WO2017166285A1 (en) * 2016-04-01 2017-10-05 华为技术有限公司 Method, device and system for switching conference terminal
CN108111322A (en) * 2016-11-24 2018-06-01 北京中创视讯科技有限公司 Web conference control method and device
CN108462853A (en) * 2017-02-22 2018-08-28 阿里巴巴集团控股有限公司 Control method, intelligent terminal and the video conference terminal of video conference terminal
KR101968448B1 (en) * 2018-11-16 2019-04-11 최상 Method for automatic control and monitoring smart quenching-tempering heat treatment process and system thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
程婉君: "云视频会议系统在大型企业中的应用", 《中国新通信》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022127511A1 (en) * 2020-12-18 2022-06-23 北京字跳网络技术有限公司 Presentation method and apparatus, and electronic device
CN114938468A (en) * 2022-04-22 2022-08-23 海信视像科技股份有限公司 Display device, screen control method, and storage medium
WO2024001508A1 (en) * 2022-06-28 2024-01-04 腾讯科技(深圳)有限公司 Conference control method and apparatus, electronic device, storage medium, and program product

Also Published As

Publication number Publication date
CN111818292B (en) 2022-08-30

Similar Documents

Publication Publication Date Title
US10868923B2 (en) Communication management system, communication system, communication control method, and recording medium
US12120158B2 (en) Communication management system, communication system, communication management device, image processing method, and non-transitory computer-readable medium
JP6406395B2 (en) Projector device, display method, and computer program
EP2962478B1 (en) System and method for multi-user control and media streaming to a shared display
US11288031B2 (en) Information processing apparatus, information processing method, and information processing system
US20080184115A1 (en) Design and design methodology for creating an easy-to-use conference room system controller
US20150201162A1 (en) Displaying information about at least one participant in a video conference session
CN111818292B (en) Control method, device, terminal and system
JP6182911B2 (en) Transmission terminal, transmission system, program
CN107734286B (en) Video window display method and device
US20200280456A1 (en) Information processing apparatus, information processing system, and information processing method
US20200177645A1 (en) Content management server, information sharing system, and communication control method
US20220086204A1 (en) Communication system, communication terminal, and screen sharing method
EP2913753A1 (en) Transmission terminal, transmission system, transmission method, and carrier means
EP3125493A1 (en) Terminal, communication method, and carrier means
JP7006330B2 (en) Information processing equipment, image sharing system, image sharing method and program
JP6458345B2 (en) Electronic information linkage system
US11636233B2 (en) Communication terminal sharing image data with counterpart communication terminal, system including the same, and method for controlling image capture
US12002231B2 (en) Communication system, method for communicating to share images, and non-transitory recording medium
US10904026B2 (en) Information processing apparatus, information processing system, and information processing method
CN116980391A (en) File transmission method, device, electronic equipment and storage medium
US11153401B2 (en) Information processing system, information processing apparatus, and method of processing information
JP2020198078A (en) Information processing apparatus, information processing system, and information processing method
JP2024025327A (en) Composite image generation system and image capture support method
JP7358934B2 (en) Communication management system, communication system, communication method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant