CN111708596A

CN111708596A - Layout management method of multimedia conference interface, related equipment and medium

Info

Publication number: CN111708596A
Application number: CN202010532547.1A
Authority: CN
Inventors: 袁雪
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-06-11
Filing date: 2020-06-11
Publication date: 2020-09-25

Abstract

The embodiment of the invention discloses a layout management method of a multimedia conference interface, related equipment and a medium, wherein the method comprises the following steps: in response to a layout management operation for the multimedia conference interface, displaying a layout management interface, the layout management interface comprising: a layout template region of the multimedia conference interface; determining a target layout of the multimedia conference interface according to position setting operation aiming at target user information detected in the layout template area, wherein the target layout is used for indicating the display position of the target user information on the multimedia conference interface; and displaying the target user information in the multimedia conference interface according to the target layout, so that the user identification in the multimedia conference interface can be flexibly arranged.

Description

Layout management method of multimedia conference interface, related equipment and medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a layout management method for a multimedia conference interface, a related device, and a medium.

Background

With the continuous and deep development of computer technology, the computer technology provides a new developing idea for the development of conference work, and multimedia conferences such as audio conferences and video conferences can be widely applied. Currently, in order to facilitate a user to check a user participating in the multimedia conference, when the user participates in the multimedia conference, a user identifier corresponding to the user participating in the multimedia conference is displayed in a multimedia conference interface, and how to flexibly arrange the user identifier in the multimedia conference interface becomes a current research hotspot.

Disclosure of Invention

The embodiment of the invention provides a layout management method, related equipment and a medium for a multimedia conference interface, which can realize flexible arrangement of user identifications in the multimedia conference interface.

In one aspect, an embodiment of the present invention provides a method for managing a layout of a multimedia conference interface, including:

in response to a layout management operation for the multimedia conference interface, displaying a layout management interface, the layout management interface comprising: a layout template region of the multimedia conference interface;

determining a target layout of the multimedia conference interface according to position setting operation aiming at target user information detected in the layout template area, wherein the target layout is used for indicating the display position of the target user information on the multimedia conference interface;

and displaying the target user information in the multimedia conference interface according to the target layout.

In another aspect, an embodiment of the present invention provides a method for managing a layout of a multimedia conference interface, including:

responding to the display operation of a multimedia conference interface, acquiring a target layout of the multimedia conference interface, wherein the target layout is determined by an initiating terminal of a multimedia conference according to a position setting operation for target user information detected in a layout template area of a layout management interface, and the target layout is used for indicating the display position of the target user information on the multimedia conference interface;

In another aspect, an embodiment of the present invention provides a layout management apparatus for a multimedia conference interface, including:

a display unit configured to display a layout management interface in response to a layout management operation for a multimedia conference interface, the layout management interface including: a layout template region of the multimedia conference interface;

a determining unit, configured to determine a target layout of the multimedia conference interface according to a position setting operation for target user information detected in the layout template region, where the target layout is used to indicate a display position of the target user information on the multimedia conference interface;

the display unit is further configured to display the target user information in the multimedia conference interface according to the target layout.

In an embodiment, the layout template area is used to display a layout template, the layout template includes one or more cells, and if the target user information is not displayed in the cells, the determining unit is specifically configured to:

adding the target user information into a target grid of the layout template, wherein the target grid is any grid of the layout template;

and taking the layout template added with the target user information as the target layout of the multimedia conference interface.

In an embodiment, the layout template area is used to display a layout template, the layout template includes one or more lattices, and if the target user information is displayed in a first lattice of the layout template, the determining unit is specifically configured to:

moving the target user information from a first grid of the layout template to a second grid of the layout template, wherein the second grid is any grid except the first grid in the layout template;

and taking the layout template of the target user information which is moved to the second grid for display as a target layout.

In one embodiment, the layout template region includes: template coding of the layout template and template adding identification; the device further comprises: a detection unit and an addition unit.

A detection unit, configured to detect a selection operation for adding an identifier to the template, and add a new layout template in the layout template area;

and the adding unit is used for adding template codes to the new layout according to the display sequence of the new layout template in the layout template area.

In one embodiment, the layout template area includes a plurality of layout templates, and the apparatus further includes: the device comprises an output unit, a receiving unit and a deleting unit.

An output unit configured to detect a deletion operation for any one of the plurality of layout template regions, and output first deletion prompt information;

a receiving unit configured to receive a confirmation operation for the first deletion hint information;

a deleting unit configured to delete the any layout template in the layout template area, wherein the deleting of the any layout template includes: and deleting the user identification added in any layout template.

In one embodiment, the output unit is further configured to output a second deletion prompt message;

the deleting unit is further configured to detect a confirmation operation for the second deletion prompt information, and delete the any layout template in the layout template area.

In one embodiment, the apparatus further comprises: and an adjusting unit.

An adjusting unit, configured to obtain an adjustment operation on a layout template in the layout management interface, and adjust attribute information of the layout template according to the adjustment operation, where the attribute information includes one or more of the following: the width of the square frame, the shape of the square frame, the color of the square frame and the square background of the layout template;

the adjusting operation includes one or more of: adjusting the width of the grid frame, adjusting the shape of the grid frame, adjusting the color of the grid frame, and adjusting the background of the grid.

In one embodiment, the display unit is further configured to display a text editing window in the multimedia conference interface;

the display unit is further configured to display the characters acquired from the text editing window in the multimedia conference interface; or, according to the adjustment operation of the characters displayed in the text editing window, displaying the adjusted characters in the multimedia conference interface;

the adjusting operation on the character comprises: one or more of an operation of adjusting the size of the character, an operation of adjusting the style of the character, or an operation of adjusting the position of the character.

In one embodiment, the display unit is further configured to detect a reservation operation for the multimedia conference, and display a conference reservation interface, where the conference reservation interface includes: selecting marks of the layout template;

the display unit is further used for responding to the confirmation operation of the selection identification of the layout template and displaying one or more layout templates;

the display unit is further configured to display a target layout template in the layout preview area of the conference reservation interface according to a selection operation on the target layout template in the one or more layout templates.

In an embodiment, the display unit is further configured to detect a template switching operation on a target layout template in the layout preview area, and redisplay the one or more layout templates;

the display unit is further configured to replace the target layout template with a new layout template according to a selection operation on the new layout template in the one or more layout templates, and display the new layout template in a layout preview area of the conference reservation interface.

In one embodiment, the apparatus further comprises: and a sending unit.

The determining unit is further configured to acquire style information of the target layout and determine a display position of the target user information in the target layout;

and the sending unit is used for sending the style information, the display position and the target user information to a background server so as to generate layout configuration information of the target layout in the background server and send the layout configuration information to a target terminal indicated by the target user information.

the multimedia conference system comprises an acquisition unit, a display unit and a management unit, wherein the acquisition unit is used for responding to the display operation of a multimedia conference interface and acquiring the target layout of the multimedia conference interface, the target layout is determined by an initiating terminal of a multimedia conference according to the position setting operation aiming at target user information detected in a layout template area of a layout management interface, and the target layout is used for indicating the display position of the target user information on the multimedia conference interface;

and the display unit is used for displaying the target user information in the multimedia conference interface according to the target layout.

In one embodiment, the number of the target user information displayed in the multimedia conference interface is plural, and the apparatus further includes: and an output unit.

The acquisition unit is further configured to acquire display information of each piece of target user information displayed in the multimedia conference interface, and determine a user identifier with an abnormal display from the plurality of pieces of target user information according to the display information;

and the output unit is used for outputting a masking interface at a display position corresponding to the user identifier with the abnormal display.

In an embodiment, the obtaining unit is specifically configured to:

acquiring layout configuration information of a target layout from a background server, wherein the layout configuration information is generated by the background server according to style information of the target layout, a display position of the target user information in the target layout and the target user information;

analyzing the configuration information of the target layout to obtain style information of the target layout, a display position of the target user information in the target layout and the target user information.

In another aspect, an embodiment of the present invention provides an initiating terminal, including a processor, an input device, an output device, and a memory, where the processor, the input device, the output device, and the memory are connected to each other, where the memory is used to store a computer program that supports the terminal to execute the foregoing method, where the computer program includes program instructions, and the processor is configured to call the program instructions to perform the following steps:

In another aspect, an embodiment of the present invention provides a target terminal, including a processor, an input device, an output device, and a memory, where the processor, the input device, the output device, and the memory are connected to each other, where the memory is used to store a computer program that supports the terminal to execute the foregoing method, where the computer program includes program instructions, and the processor is configured to call the program instructions to perform the following steps:

responding to the display operation of a multimedia conference interface, acquiring a target layout of the multimedia conference interface, wherein the target layout is determined by an initiating terminal of a multimedia conference according to the position setting operation aiming at target user information detected in a layout template area of a layout management interface, and the target layout records the display position of the target user information on the multimedia conference interface;

In still another aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a first program instruction and a second program instruction are stored, where the first program instruction is used to execute the layout management method for a multimedia conference interface according to the first aspect when executed by a processor, and the second program instruction is used to execute the layout management method for a multimedia conference interface according to the second aspect when executed by the processor.

In the embodiment of the invention, the initiating terminal can display the layout management interface after detecting the layout management operation aiming at the multimedia conference interface, and the initiating user of the multimedia conference can set the position of the target user information displayed in the layout management interface so as to determine the display position of the target user information in the layout template displayed by the layout management interface.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic diagram of a layout management system of a multimedia conference interface according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a method for managing a layout of a multimedia conference interface according to an embodiment of the present invention;

fig. 3a is a schematic diagram of a management interface of a multimedia conference according to an embodiment of the present invention;

FIG. 3b is a diagram of a layout management interface according to an embodiment of the present invention;

FIG. 3c is a diagram of a layout management interface according to an embodiment of the present invention;

FIG. 3d is a schematic diagram of an image displayed in a grid according to an embodiment of the present invention;

FIG. 3e is a diagram illustrating a display of target user information according to an embodiment of the present invention;

FIG. 3f is a diagram illustrating a location setting operation performed on target user information according to an embodiment of the present invention;

FIG. 3g is a diagram illustrating a location setting operation performed on target user information according to an embodiment of the present invention;

FIG. 3h is a diagram illustrating a location setting operation performed on target user information according to an embodiment of the present invention;

FIG. 4a is a schematic diagram of a layout management interface according to an embodiment of the present invention;

FIG. 4b is a diagram illustrating a location setting operation performed on target user information according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a multimedia conference interface frame according to an embodiment of the present invention;

fig. 6 is a schematic flowchart of a method for managing a layout of a multimedia conference interface according to an embodiment of the present invention;

fig. 7a is a schematic diagram of a conference reservation interface according to an embodiment of the present invention;

FIG. 7b is a diagram of a display layout template according to an embodiment of the present invention;

FIG. 7c is a diagram illustrating a layout template displayed in a layout preview area according to an embodiment of the present invention;

fig. 7d is a schematic diagram of detail information of a multimedia conference provided by an embodiment of the present invention;

fig. 7e is a schematic diagram illustrating a display text editing window according to an embodiment of the present invention;

FIG. 7f is a diagram illustrating a text adjustment according to an embodiment of the present invention;

FIG. 8a is a diagram of an add layout template provided by an embodiment of the present invention;

FIG. 8b is a diagram illustrating an output of a delete prompt according to an embodiment of the present invention;

FIG. 8c is a diagram of a delete layout template according to an embodiment of the present invention;

fig. 8d is a schematic diagram of outputting a deletion notification message according to an embodiment of the present invention;

FIG. 8e is a diagram of a replacement layout template according to an embodiment of the present invention;

fig. 9 is a schematic flowchart of a layout management method for a multimedia experience interface according to an embodiment of the present invention;

fig. 10a is a schematic diagram of a multimedia conference interface in a target terminal according to a target layout according to an embodiment of the present invention;

FIG. 10b is a diagram of a user interface for outputting a mask at a user identifier of an exception display according to an embodiment of the present invention;

fig. 11 is a schematic block diagram of a layout management apparatus for a multimedia conference interface according to an embodiment of the present invention;

fig. 12 is a schematic block diagram of a layout management apparatus for a multimedia conference interface according to an embodiment of the present invention;

fig. 13 is a schematic block diagram of an initiating terminal according to an embodiment of the present invention;

fig. 14 is a schematic block diagram of a target terminal according to an embodiment of the present invention.

Detailed Description

The embodiment of the invention provides a layout management method for a multimedia conference, which enables an initiating terminal of the multimedia conference to realize real-time adjustment of the layout of a multimedia conference interface in different conference scenes, and can effectively improve the flexibility of adjusting the layout of the multimedia conference interface, thereby ensuring the conformity of the multimedia conference interface and the multimedia conference, and further improving the conference experience of a user. The initiating terminal can manage the layout of the multimedia conference interface before the multimedia conference begins, after the initiating user manages the layout of the multimedia conference interface through the initiating terminal, at the beginning of the multimedia conference, the multimedia conference interface displayed in the terminal corresponding to the user participating in the multimedia conference may be displayed in accordance with a designated target layout, or, the initiating user may also adjust the layout of the multimedia conference interface during the ongoing multimedia conference through the initiating terminal, which, in turn, after the initiating user adjusts the layout of the multimedia conference interface through the initiating terminal, if the user participating in the multimedia conference detects the adjustment of the layout of the multimedia conference interface through the corresponding terminal, the adjusted layout can be obtained again and displayed according to the adjusted layout, so that the real-time adjustment of the corresponding layout of the multimedia conference interface is realized. It should be noted that the management (or layout adjustment) of the layout proposed by the embodiment of the present invention may include one or two of the following:

managing (or adjusting) layout styles of the layout, such as adjusting a style A (such as a Sudoku layout) of the original layout to a style B (such as a quad layout) of a target layout;

adjusting the display position of the user identifier in the layout under the same layout style, for example, adjusting the display position of target user information in the layout from A to B under the original layout style, wherein the target user information comprises: identification information of the target user, image information, etc.

In one embodiment, the layout management method for the multimedia conference interface can be applied to a layout management system as shown in fig. 1, which includes an initiating terminal 10, a backend server 11, and a set of target terminals 12 corresponding to users participating in the multimedia conference, as shown in fig. 1, where each target terminal in the set of target terminals 12 corresponds to a participating user participating in the multimedia conference, the initiating terminal 10 and each target terminal in the set of target terminals 12 establish a communication connection through the backend server 11, the initiating user of the multimedia conference can manage the layout of the multimedia conference interface through the initiating terminal 10, the initiating terminal 10 can send the style of the target layout selected by the initiating user and the display position of the user identifier indicated by the target layout in the multimedia conference to the backend server 11 based on the management operation of the initiating user on the multimedia conference interface, the background server 11 may generate layout configuration information based on the style of the target layout and the display position corresponding to the user identifier, and store the layout configuration information in a data table of a database. In an embodiment, the background server 10 may be an independent physical server, may also be a server cluster or a distributed system formed by a plurality of physical servers, and may also be a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, a middleware service, a domain name service, a security service, a Content Delivery Network (CDN), a big data and artificial intelligence platform, and the like. Each of the target terminals in the initiating terminal 10 and the target terminal set 12 may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, and the like. The initiating terminal 10 and each target terminal in the target terminal set 12 and the background server 11 may be directly or indirectly connected through a wired or wireless communication manner, which is not limited in the present embodiment. The backend server 11 may store the layout configuration information in a data table as shown in table 1:

TABLE 1

In one embodiment, the layout configuration information is stored in the database at the background server 11, and after the participating users of the multimedia conference participate in the multimedia conference through the target terminals in the target terminal set 12, the layout configuration information obtained after the initiating user lays out the multimedia conference interface through the initiating terminal can be obtained from the backend server 11, the target terminal is based on the layout configuration information obtained from the backend server 11, the layout configuration information can be analyzed to determine the style of the target layout of the multimedia conference layout, and further, the target terminal can display the target user information in the multimedia conference interface based on the style of the target layout and the display position. In one embodiment, the target terminal may be any terminal device in the set of target terminals 12.

In an embodiment, based on the analysis of the layout configuration information by the target terminal, the target terminal may obtain an identity (identity, ID) corresponding to the target user information, where the identity corresponding to the target user information includes the user's api and uid recorded in table 1, and based on the user's api and uid, the target terminal determines the target user corresponding to the target user information, so as to further obtain the state information of the target user from the backend server 11, and based on the determined state information of the target user and the obtained user's api and uid through analysis, the target terminal may generate a member list first, and after the target terminal generates the member list, after detecting that the target terminal enters the multimedia conference, the relevant information in the member list may be displayed in the multimedia conference interface. In one embodiment, after the target terminal generates the member list, when the related information of the member list is displayed in the multimedia conference interface, the size of the display window of the multimedia conference interface may be determined first, so that layout rendering may be performed on the multimedia conference interface according to a style of a target layout, where the style of the target layout is used to indicate the number of the grids rendered in the multimedia conference interface, the size of the grids (i.e., the length and width of the grids), the position of each grid in the multimedia interface, and the like. After the target terminal renders according to the style of the target layout, the initiating user can also adjust the frame size, the frame color, the filling background picture, the display position and the like of the grid in the multimedia conference interface through the initiating terminal 10, and can issue the adjusted target layout to the target terminal through the background server 11 in real time so as to realize the real-time adjustment of the multimedia conference interface.

In an embodiment, after determining that the target layout of the initiating terminal after adjusting the multimedia conference interface is determined, the target terminal may display target user information of a target user participating in the multimedia conference based on the target layout, and further, when displaying the target user information, the target terminal displays state information corresponding to the target user at a display position (i.e., a grid) corresponding to the target user information, where the state information of the target user includes: whether a target terminal corresponding to the target user is offline, online or not, whether the target terminal is speaking or not, whether screen sharing is performed or not and the like are determined, so that the users participating in the multimedia conference can determine the current states of the various participating target users based on the state information, and the target terminal can adjust the display position of the target user information based on the state information. In one embodiment, when entering a multimedia conference interface for display, the target terminal may adjust target user information displayed in the multimedia conference interface in real time based on a current link of the target terminal, for example, when a current link condition of the target terminal is poor, a resolution and a definition of current display may be reduced, and when the current link condition is good, the current resolution and definition in the multimedia conference interface may be improved; or, the target terminal may further adjust the display of the target user information in real time based on the state information of the target user, and if the state information of the target user indicates that the camera is not turned on, the resolution and the definition of displaying the target user information may be reduced, and if the state information of the target user indicates that the camera is turned on, the resolution and the definition of displaying the target user information may be improved, so that the target terminal may flexibly adjust the displayed target user information.

Referring to fig. 2, a layout management method for a multimedia conference interface according to an embodiment of the present invention is provided, where the layout management method is applicable to an initiating terminal of the multimedia conference, and as shown in fig. 2, the method may include:

s201, responding to the layout management operation aiming at the multimedia conference interface, and displaying a layout management interface.

In one embodiment, an initiating user of a multimedia conference can manage the layout of a multimedia conference interface through a corresponding initiating terminal, wherein the initiating user can set the layout of the multimedia conference interface before the multimedia conference starts and adopt the set layout to display the interface after the multimedia conference starts; or, the initiating user can also change the layout of the multimedia conference interface in the process of the multimedia conference, and apply the changed layout to the multimedia conference interface so as to display the interface according to the changed layout. In a specific implementation, when the initiating user predefines the multimedia conference, the initiating terminal may first determine that the layout mode of the multimedia conference interface is the free layout mode, and in one embodiment, in the free layout mode, the initiating user may freely adjust the layout style of the multimedia conference interface through the initiating terminal, and/or freely adjust the position of the user identifier displayed by the multimedia conference interface in the uniform layout style. After the initiating terminal determines that the layout mode of the multimedia conference interface is the free layout mode, the initiating user can adjust the layout of the multimedia conference interface through the layout management interface of the initiating terminal.

In one embodiment, an initiating user can preset a layout mode of a multimedia conference after starting a conference reservation interface of the multimedia conference, and can select the layout mode of the multimedia conference interface as a free layout mode through the conference reservation interface, in a specific implementation, the initiating user can select any layout template from a plurality of layout templates output by the conference reservation interface through an initiating terminal as a layout template of the multimedia conference interface, and the initiating terminal can determine that the layout mode of the multimedia conference interface is the free layout mode after detecting that the initiating user performs selection operation on any layout template; if the initiating terminal does not detect that the initiating user selects the layout template in the conference reservation interface, the initiating terminal determines that the layout mode of the multimedia conference interface is the predefined layout mode, and if the initiating user needs to adjust (or manage) the layout of the multimedia conference interface in the predefined layout mode, the initiating user needs to select the layout template of the multimedia conference interface first, so that the layout mode of the multimedia conference interface can be adjusted from the predefined layout mode to the free layout mode, and the layout of the multimedia conference interface is adjusted.

In one embodiment, when the initiating user manages the layout of the multimedia conference interface through the initiating terminal, the initiating user may first enter the management interface of the multimedia conference, the management interface of the multimedia conference may be, for example, the interface shown in fig. 3a, the initiating user may perform a search of the multimedia conference by making a search at the management interface of the multimedia conference, if the screening period can be selected in a search area as marked by 301 in fig. 3a, the initiating terminal can then conduct a search for multimedia conferences based on the screening period, alternatively, a conference number of the multimedia conference may be inputted in the search area so that the originating terminal can perform a search for the multimedia conference based on the conference number, or alternatively, the initiating terminal may also enter a conference topic for the multimedia conference in the search area, such that the initiating terminal may conduct a search for the multimedia conference based on the conference topic. In an embodiment, the management interface of the multimedia conference further displays the detail information of the conference that the initiating user participates in, and the management interface of the multimedia conference can display the detail information of the conference that the initiating user correspondingly participates in an area as marked by 302 in fig. 3a, where the detail information of the conference specifically includes: the starting time of the conference, the conference subject, the conference number, the host, the number of participants, and the operation control identifier for the conference, when the initiating user needs to manage the layout of the multimedia conference interface, the layout of the multimedia conference interface can be managed through the operation control identifier for the conference displayed in the management interface of the multimedia conference, wherein the operation control identifier can be, for example, the conference control identifier displayed in the area marked by 302 in fig. 3a, and after detecting the selection instruction of the initiating user for the operation control identifier, the initiating terminal determines to detect the layout management operation for the multimedia conference interface, so that the layout management interface can be displayed.

In one embodiment, the initiating terminal, upon determining that the layout management operation for the multimedia conference interface is detected, may display a layout management interface, as shown in fig. 3b, which may be an interface marked by 31 in fig. 3b, the layout management interface including: a layout template region of the multimedia conferencing interface, wherein the layout template region may be a 310 region in the markup interface as in fig. 3b by 31. In one embodiment, the layout template area 310 displays layout templates selected by an initiating user when a multimedia conference is predefined, the number of the layout templates displayed in the target template area 310 is one or more, and a template code corresponding to each layout template is simultaneously displayed, where the template code is used to indicate a display order of the layout templates after being applied to the multimedia conference interface, for example, one layout template is displayed in the layout template area marked by 310 in fig. 3b, and a template code corresponding to the one layout template is simultaneously displayed as a first page, and then, after the layout template is applied to the multimedia conference, the corresponding layout template is displayed on the first page of the multimedia conference.

In one embodiment, the layout management interface may further include: target user information of target users participating in the multimedia conference, wherein a layout management interface including the target user information may be as shown in fig. 3c, the target user information may be displayed in an area marked by 311 in fig. 3c, and since there are one or more target users participating in the multimedia conference, the area 311 for displaying the target user information corresponding to the target user includes target user information corresponding to each target user participating in the multimedia conference, that is, the number of the target user information displayed in the area 311 for displaying the target user information is one or more.

In one embodiment, the layout template includes one or more cells, the cells in the layout template may be the cells without displaying the target user information as shown by the cells in the area 310 in the 31-marked interface in fig. 3b, the cells may display the target user information of the target users participating in the multimedia conference, and the target user information displayed in the cells includes one or more of the following: the user head portrait, the nickname, the conference identity information (such as the host, the joint host, or the common conference member, etc.), the state information of the conference media (such as whether the video is turned on, whether the voice is turned on, whether the screen sharing is turned on, etc.), and the image of the target user when the camera is turned on, etc., wherein the image displayed in the grid can be as shown in fig. 3 d. As shown in the image of the grid marked by 32 in fig. 3d, after the image marked by 32 in fig. 3d starts the video camera for the target user, the image of the target user displayed in the grid is the real-time dynamic state of the target user participating in the multimedia conference because the target user starts the video camera, and meanwhile, the information of the target user displayed in the grid further includes: the nickname, the voice starting identifier and the participant identity information (host) of the target user; in addition, the image displayed in the grid may also be as shown in fig. 3d by the image marked by 33, the image marked by 33 in fig. 3d is an image of the target user not turning on the video camera, and since the target user does not turn on the video camera, the identification information corresponding to the target user, such as the user head portrait of the target user, may be displayed in the grid, and the target user information displayed in the grid at the same time further includes: the nickname of the target user, the voice starting identifier and the participant identity information of the target user (the participant identity information is a common participant member).

After the initiating terminal displays the layout management interface, the initiating user may perform a position setting operation for the target user information in a layout template region included in the layout management interface, and after the initiating terminal detects the position setting operation for the target user information, the initiating terminal may determine a target layout corresponding to the multimedia conference interface based on the position setting operation, that is, turn to perform step S202.

S202, according to the position setting operation aiming at the target user information detected in the layout template area, determining the target layout of the multimedia conference interface.

In one embodiment, the target user information of the target users participating in the multimedia conference is not displayed in the layout management interface, and the initiating terminal may, after detecting a selection instruction of the initiating user for the lattice of any layout template in the layout template region, the target user information is displayed in the layout management interface so that the initiating user can add any identification in the target user information to the grid of the layout template, as shown in figure 3e, after the initiating terminal displays the target user information on the layout management interface, the initiating user can add any user information in the target user information displayed on the layout management interface into the grid of the layout template, so that the layout template with the added user information can be used as the target layout of the multimedia conference interface, the target layout is used for indicating the display position of the target user information in the multimedia conference interface. After detecting the selection instruction of the initiating user to the grid of any layout template in the layout template region, the interface after outputting the target user information in the layout management interface can also be as shown in fig. 3 c.

In one embodiment, if target user information of a target user participating in the multimedia conference is already displayed in the layout management interface, the initiating user may drag the target user information displayed in the layout management interface into a layout template region of the layout management interface, and when detecting a user operation of dragging the target user information into the layout template region, the initiating terminal may determine that a location setting operation for the target user information is detected in the layout template region, where the dragging operation for the target user information includes: selecting the target user information and moving the selected target user information, wherein the initiating user can drag the target user information to any layout template in a layout template area, further, the initiating user can drag the target user information to any grid of any layout template, the initiating terminal can determine the position of the target grid dragged by the target user information based on the dragging track of the target user information and display the target user information in the target grid, the layout template displaying the target user information is the target layout corresponding to the multimedia conference interface, and the initiating terminal determines the display position of the target user information in the multimedia conference interface based on the target layout. In a specific implementation, the initiating terminal may determine, based on a position of a target lattice in which the target user information is located in the target layout, a display position of the target user information in the multimedia conference interface, as shown in fig. 3f, if the target user information is dragged according to a trajectory indicated by a dotted line in fig. 3f, the target layout in which the target user information may be added by the initiating terminal is shown as a layout marked by 303 in fig. 3f, and if it is known from the target layout that a position of the target lattice for displaying the target user information, which corresponds to the layout template, is a lower-right corner position, the initiating terminal may determine that the display position of the target user information in the multimedia conference interface is: and equally dividing the multimedia conference interface into the lower right corner positions behind the four grids.

In an embodiment, when a selection operation for target user information in the layout management interface is detected, the initiating terminal may further determine that a position setting operation for the target user information is detected, where the selection operation may be, for example, a single-click operation or a double-click operation, and after the initiating terminal detects the selection operation for the target user information, the target user information may be added to a target grid of the layout template according to a preset identifier adding rule, so as to obtain the target layout of the multimedia conference interface, where the preset identifier adding rule may be, for example, a rule in which identifiers are added sequentially from top to bottom and from left to right. As shown in fig. 3g, after detecting the selection operation for the target user information, the initiating terminal may add the target user information to the upper left corner position of the layout template of the four lattices, that is, the upper left corner lattice of the layout template of the four lattices is the target lattice to which the target user information is added, so as to obtain the target layout marked by 304 in fig. 3g, and based on the target layout, it may be determined that the position of the target lattice for displaying the target user information, which corresponds to the layout template, is the upper left corner position, and then the initiating terminal may determine that the display position of the target user information in the multimedia conference interface is: and equally dividing the multimedia conference interface into the lower left corner position behind the four grids.

In one embodiment, the initiating terminal may further output prompt information for identifying addition when detecting a target user information selection operation for the layout management interface, where the output prompt information may be as shown in an interface marked by 305 in fig. 3h, and the prompt information for identifying addition includes: after the prompt information is output, the initiating terminal may detect a selection instruction for the lattice to be selected in the prompt information, and after the selection instruction for the lattice to be selected is detected, determine that a position setting operation for the target user information is detected, where the selection instruction for the lattice to be selected of the prompt information may be, for example: as a selection instruction of the dotted arrow of the interface marked by 305 in fig. 3h to the lattice to be selected, based on the selection instruction of the dotted arrow to the lattice to be selected, the target user information may be added to the lattice selected by the dotted arrow, so that a target layout as marked by 306 in fig. 3h may be obtained. Based on the target layout, it may be determined that a position, corresponding to the layout template, of a target grid for displaying the target user information is an upper-right corner position, and then the initiating terminal may determine that the display position of the target user information in the multimedia conference interface is: and equally dividing the multimedia conference interface into the positions of the upper right corners behind the four grids.

In one embodiment, the layout management interface displayed by the initiating terminal may further include, as shown in fig. 4a, a layout template region also included in the layout management interface, and target user information of target users participating in the multimedia conference, where one or more pieces of target user information are displayed in cells of a layout template of the target template region, as shown in a layout marked by 401 in fig. 4a, and two cells in the layout template already display the target user information, then, when the initiating user changes a display position of the target user information already displayed in the layout template, the target user information already displayed in the layout template may be moved from a first cell to a second cell, and the initiating terminal may determine that a position setting operation for the target user information is detected after detecting an operation for moving the target user information from the first cell to the second cell, and determining the target layout of the multimedia conference interface based on the moving track of the target user information. The first grid is a current display grid of target user information, the second grid is any grid in the layout template area, other target user information can be displayed in the second grid, or other user identifications cannot be displayed, and the second grid and the first grid can belong to the same template code or different template codes. If the initiating terminal detects that the second grid to which the target user information is moved does not display other target user information, the target user information is directly moved to the second grid for display, and if the second grid to which the target user information is moved already displays other target user information, the target user information can be moved to the second grid for display, and then other previously displayed target user information in the second grid is displayed in the first grid. As shown in fig. 4b, if the initiating user moves the target user information from the upper left-hand grid (i.e., the first grid) to the upper right-hand grid (i.e., the second grid) according to the trajectory indicated by the dotted line in fig. 4b, the initiating terminal determines the target layout of the multimedia conference interface based on the movement trajectory of the target user information, as shown by the layout marked by 402 in fig. 4b, since other target user information is already displayed in the upper right-hand grid, after the target user information is moved to the upper right-hand grid, other previously displayed target user information in the upper right-hand grid is displayed in the upper left-hand grid of the target user information, and the quick replacement of the display position of the target user information displayed in the layout template can be achieved.

In an embodiment, when an initiating user performs a setting operation on a position of target user information in a layout management interface, the same target user information may be displayed in different lattices of a layout template, and the initiating user may add all of a plurality of target user information displayed in the layout management interface to the layout template in a layout template region, or only add a part of target user information displayed in the layout management interface to the layout template in the layout template region, and target user information that is not added to the layout template will not be displayed in a multimedia conference interface during a multimedia conference. For example, if the number of participants of the multimedia conference is 200 and the number of users needing to speak during the running process of the multimedia conference is only 10, the initiating user of the multimedia conference may add only the target user information of 10 target users needing to speak to the layout template, and the target user information of the remaining 190 target users will not be added to the layout template.

In an embodiment, after determining the target layout of the multimedia conference interface, the initiating terminal may display the target user information on the multimedia conference interface according to the target layout when detecting that the initiating terminal switches to the multimedia conference interface for displaying, that is, turn to execute step S203.

S203, displaying the target user information in the multimedia conference interface according to the target layout.

In an embodiment, after determining the target layout of the multimedia conference interface, the initiating terminal may display target user information in the multimedia conference interface according to the target layout when displaying the multimedia conference interface, where if the layout management interface and the multimedia conference interface are in the same interface when the initiating terminal displays the layout management interface, the initiating terminal may directly perform the step of displaying the target user information in the multimedia conference interface according to the target layout after determining the target layout, or, when the layout management interface and the multimedia interface are in different interfaces, the initiating terminal may display in the multimedia conference interface according to the target layout when detecting that the initiating terminal switches to the multimedia conference interface to display after determining the target layout. In a specific implementation, when the initiating terminal displays the multimedia conference interface based on the target layout, the size of the border of the multimedia conference interface may be obtained first, where the size of the border of the multimedia conference interface is the maximum size displayed by the whole initiating terminal, and the size of the border of the multimedia conference interface may be shown by the border marked by 50 in fig. 5, further, the initiating terminal may determine the maximum area for displaying the target user information based on the aspect ratio indicated by the single page layout information in the layout configuration information, as shown by the border marked by 51 in fig. 5, further, the initiating terminal may determine the style information of the target layout and the target user information displayed by each grid in the target layout based on the layout detail template in the layout configuration information, and the initiating terminal may determine the number of grids in the target layout based on the style information of the target layout, thus, the display width and height of each grid in the maximum area 51 can be calculated, the grids in the target layout can be shown as the grid marked by 52 in fig. 5, and the initiating terminal can render the layout in the process of the multimedia conference.

In an embodiment, after determining the target layout, the initiating terminal may further send style information of the target layout, a display position of the target user information in the target layout, and the target user information to the backend server, and the backend server may generate layout configuration information of the target layout based on the style information of the target layout, the display position of the target user information in the target layout, and the target user information, so that the backend server may send the layout configuration information to the target terminal indicated by the target user information, so that the target terminal is displayed according to the target layout during the multimedia conference, where the layout configuration information of the target layout may be stored in a data table (the data table may be as shown in table 1) of the backend server. Or, the initiating terminal can also directly generate layout configuration information of the target layout based on the style information of the target layout, the display position of the target user information in the target layout and the target user information, and send the layout configuration information to the target terminal through the background server. After the target terminal determines the target layout of the multimedia conference interface from the background server, the target terminal can display the target user information in the multimedia conference interface based on the display position of the target user information indicated by the target layout. In an embodiment, the number of the target user information is multiple, and the initiating terminal may send the target layout to the target terminal indicated by each target user information after determining the target layout.

In an embodiment, after entering the multimedia conference, the target terminal may query the layout mode of the multimedia conference from the background server, and if it is determined that the layout mode of the multimedia conference is the self-owned layout mode, further, may obtain layout configuration information of the target layout of the multimedia conference interface from the background server, and may apply the layout configuration information to the multimedia conference interface for display after performing analysis processing on the layout configuration information. In a specific implementation, a target terminal may first obtain layout configuration information of a target layout from a background server, where the layout configuration information is generated by the background server according to style information of the target layout, a display position of target user information in the target layout, and the target user information; analyzing the configuration information of the target layout to obtain style information of the target layout, a display position of the target user information in the target layout and the target user information. And further, the target terminal can generate a new member list based on the target user information and the state of the corresponding target user in the multimedia conference, and display the related information of the new member list in a multimedia conference interface.

Please refer to fig. 6, which is a schematic flowchart of a method for managing a layout of a multimedia conference interface according to an embodiment of the present invention, where the method for managing a layout of a multimedia conference interface is also applicable to the initiating terminal, and referring to fig. 6, the method may include:

s601, detecting the reservation operation aiming at the multimedia conference, and displaying a conference reservation interface.

In an embodiment, an initiating user of a multimedia conference may make a reservation for the multimedia conference after starting a client corresponding to the multimedia conference, and an initiating terminal may determine that a reservation operation for the multimedia conference is detected after detecting the client starting the multimedia conference, so as to display a conference reservation interface, where the conference reservation interface may be as shown in fig. 7a, the conference reservation interface includes a selection identifier of a layout template, and the selection identifier is as shown by an identifier marked by 701 in fig. 7 a. After detecting the confirmation operation of the selection identifier for the layout template in the conference reservation interface, the initiating terminal may display one or more layout templates, that is, execute step S602 in turn

In one embodiment, the conference reservation interface further includes conference basic information, the initiating user needs to fill in the relevant conference basic information to implement reservation of the multimedia conference, the conference basic information may include a conference name, a start time, an end time, a conference place, and the like, in addition, the conference reservation interface further includes confidential information, such as a conference password, and the like, the conference password input by the user participating in the multimedia conference needs to be always the same as the conference password set by the initiating user to join the multimedia conference, the conference reservation interface further includes an inviting member, and member invitation may be performed based on the filled member information (such as enterprise WeChat) of the inviting member; the conference appointment interface also comprises a conference setting option, a document option and a live broadcast option, wherein the conference setting option is used for setting relevant matters before the multimedia conference is started when the multimedia conference is carried out, such as whether a waiting room is opened or not, whether members are allowed to join the conference before a host enters, and the like; the initiating user can upload the conference document related to the multimedia conference through the document option or is used for indicating whether the participating user is allowed to upload the document; the live option is used for indicating whether the multimedia conference is live or not. After the initiating user fills in the relevant information in the conference reservation interface or selects the relevant options, the initiating terminal can generate the multimedia conference reservation information based on the relevant information filled in the conference reservation interface and the selected relevant options and store the reservation information of the multimedia conference after detecting that the initiating user performs the reservation confirmation operation of the multimedia conference.

S602, responding to the confirmation operation of the selection mark aiming at the layout template, and displaying one or more layout templates.

S603, according to the selection operation of the target layout template in the one or more layout templates, displaying the target layout template in a layout preview area of the conference reservation interface.

In steps S602 and S603, after detecting the confirmation operation for the selection identifier, the initiating terminal may display one or more layout templates, where the layout templates may be displayed in a display area marked by 702 in fig. 7b, the initiating user may select a target layout template from the displayed one or more layout templates, and after determining the target layout template selected by the initiating user, the initiating terminal may display the target layout template in a layout preview area of the conference reservation interface, as shown in fig. 7c, where the layout preview area may be, for example, an area marked by 703 in fig. 7 c. In one embodiment, after the initiating terminal displays the target layout template in the layout preview area of the conference reservation interface, the initiating user may further change the target layout template, in a specific implementation, the initiating user may change the target layout template by clicking a layout switching identifier in the layout preview area, where the layout switching identifier may be, for example, an identifier marked by 704 in fig. 7c, after detecting a selection operation of the layout switching identifier in the layout preview area, the initiating terminal may determine that a template switching operation of the target layout template in the layout preview area is detected, further, the initiating terminal may redisplay the one or more layout templates and may replace the target layout template with a new layout template according to the selection operation of the new layout template in the one or more layout templates, and displaying the new layout template in a layout preview area of the conference reservation interface.

In one embodiment, when the initiating user subscribes to the multimedia conference, if the target layout template is selected from one or more layout templates, the target layout templates are output together when the details of the scheduled multimedia conference are output, as shown in the interface marked by 70 in fig. 7d, whereas if the initiating user does not select the target layout template when subscribing to the multimedia conference, the target layout template is displayed according to the preset layout template during the proceeding of the multimedia conference, and when the details of the scheduled multimedia conference are output, the preset layout template is not output, as shown in the interface marked by 71 in fig. 7 d.

S604, responding to the layout management operation aiming at the multimedia conference interface, and displaying a layout management interface, wherein the layout management interface comprises: and the layout template area of the multimedia conference interface.

In an embodiment, after displaying the layout management interface, the initiating terminal may adjust attribute information of the layout template displayed in the layout management interface, for example, adjust a width, a shape, a color, and a background of a grid frame of the layout template, in a specific implementation, after obtaining an adjustment operation on the layout template in the layout management interface, the initiating terminal may adjust the attribute information of the layout template according to the adjustment operation, where the attribute information includes one or more of the following: the width of the square frame, the shape of the square frame, the color of the square frame and the square background of the layout template; the adjustment operation includes one or more of: the method comprises the following steps of adjusting the width of the lattice frame, adjusting the shape of the lattice frame, adjusting the color of the lattice frame and adjusting the background of the lattice, wherein the adjusting operation of the background of the lattice comprises the following steps: the background color, the background image and the background decorative pendant are adjusted, and the shape of the frame of the grid can be rectangular, heart-shaped or circular, for example.

In an embodiment, the initiating terminal may further display a text editing window in the multimedia conference interface to adjust characters in the multimedia conference interface, in a specific implementation, the initiating terminal may display the text editing window in the multimedia conference interface, as shown in fig. 7e, where the text editing window may be, for example, a window marked by 705 in fig. 7e, and further, the initiating terminal may display characters obtained from the text editing window in the multimedia conference interface, as shown in the multimedia conference: party A, party B, and XX project collaboration meetings; or, the initiating terminal can also adjust the characters displayed in the text editing window, and display the adjusted characters in the multimedia conference interface; wherein the adjusting operation on the character comprises: as shown in fig. 7f, if the interface of the multimedia conference before the adjustment is shown as the interface marked by 73 in fig. 7f, the interface of the multimedia conference after the character adjustment may be shown as the interface marked by 74 in fig. 7 f.

S605, determining the target layout of the multimedia conference interface according to the position setting operation aiming at the target user information detected in the layout template area, wherein the target layout is used for indicating the display position of the target user information on the multimedia conference interface.

S606, displaying the target user information in the multimedia conference interface according to the target layout.

In step S605 and step S606, the layout template region is used to display a layout template, the layout template includes one or more lattices, if the target user information is not displayed in the lattices, the initiating terminal performs a position setting operation based on the target user information, and when determining the target layout of the multimedia conference interface, the target user information may be added to the target lattices of the layout template, and the target lattices are any lattices of the layout template, so that the layout template to which the target user information is added may be used as the target layout of the multimedia conference interface, as shown in fig. 3 f. In an embodiment, if target user information is already displayed in one or more cells in the layout template, if the target user information is already displayed in a first cell of the layout template, when the initiating user determines the target layout of the multimedia conference interface based on the position setting operation for the target user information, the target user information may be first moved from the first cell of the layout template to a second cell of the layout template, where the second cell is any cell of the layout template except the first cell, so that the layout template of the target user information to be moved to the second cell for display may be used as the target layout, as shown in fig. 4 b. In one embodiment, the layout template displayed in the layout template area is the target layout template selected by the user when the user performs multimedia conference pre-definition as described above.

In one embodiment, the layout template area further includes a template code of the layout template, as shown in fig. 8a, the template code may be, for example, a "first page" as shown in fig. 8a, and the template adding identifier may be, for example, an identifier as marked by 801 in fig. 8a, after the initiating terminal detects a selection operation for the template adding identifier, a new layout template is added in the layout template area, and a template code may be added for the new layout according to a display order of the new layout template in the layout template area, wherein an interface after adding the new layout template in the layout template area may be as shown by an interface as marked by 81 in fig. 8a, the added new layout template is a template in the grid which does not display the target user information, it should be noted that the initiating terminal may perform a selection operation based on the template adding identifier, one or more new layout templates are added in the layout template area.

In one embodiment, if the number of the layout templates included in the layout template area is multiple, the initiating user may delete any layout template displayed in the layout template area through the initiating terminal based on an actual meeting situation, and when the initiating user deletes any layout template in the layout template area through the initiating terminal, the initiating user may popup twice to confirm the deletion prompt information, where the content in the deletion prompt information may be, for example: is it determined that the page is deleted? The content filled into the page is emptied, the operation is irreversible, and any layout template can be deleted from the layout template area after the initiating terminal detects the confirmation operation of the initiating user for the secondary popup. In a specific implementation, the initiating terminal may output a first deletion prompt message after detecting a deletion operation for any layout template, and delete any layout template in the layout template region after the initiating terminal receives a confirmation operation for the first deletion prompt message, as shown in fig. 8b, the initiating user may delete the layout template whose corresponding layout in the layout template region is encoded into the second page through the initiating terminal, the initiating terminal may output the first deletion prompt message after detecting the deletion operation for the layout template of the second page, the first deletion prompt message may be as shown in the prompt message labeled by 802 in fig. 8b, and the initiating terminal may delete the layout template of the second page after detecting the confirmation operation for the first prompt message, where deleting the layout template in the template region includes: deleting the layout template and the corresponding layout code, and/or deleting the user identifier added to the layout template, where the deleting operation may be, for example, a click operation, a double click operation, or a slide operation. In one embodiment, the interface for deleting the layout template of the second page may be as shown in FIG. 8 c.

In an embodiment, the initiating terminal may output the first deletion hint information multiple times in succession after detecting the deletion operation for the any layout template, for example, output the first deletion hint information twice in succession, where the first deletion hint information output twice in succession may be as shown in the left diagram of fig. 8d, and the initiating terminal may delete the any layout after detecting the confirmation operation for the first deletion hint information twice in succession. In order to prevent the initiating user from deleting the layout template in the layout template region by mistake, the initiating terminal may detect the deletion operation for any layout template again after detecting the confirmation operation for the first deletion prompt information, and output second deletion prompt information after detecting the deletion operation for any layout template again, so that any layout template may be deleted in the layout template region after detecting the confirmation operation for the second deletion prompt information, as shown in the right diagram of fig. 8d, and the initiating user may be prevented from deleting any layout template in the layout template region by mistake, wherein the second deletion prompt information may be the same prompt information as the first deletion prompt information or different prompt information.

In one embodiment, the initiating user may further change the template style of the layout template displayed in the layout template region through the initiating terminal, for example, if the layout template displayed in the layout template region is a foursquare, the initiating user may further change the foursquare template displayed in the layout template region to a nine-square template through the initiating terminal. In a specific implementation, an initiating user may change a layout template displayed in a layout template area of a layout management interface by clicking a template switching identifier displayed in a layout management interface of the initiating terminal, as shown in fig. 8e, where the layout template switching identifier may be, for example, a change layout key shown in fig. 8e, the initiating user may popup-display one or more selectable layout templates by clicking the change layout key on the layout management interface of the initiating terminal, the layout management interface after displaying one or more layout templates may be, as shown in the interface marked by 803 in fig. 8e, the initiating user may select a new layout template from the layout templates displayed by popup, after the initiating terminal determines the new layout template selected by the initiating user, and after detecting that the initiating user confirms to apply the new layout template to a multimedia conference interface, can the information be confirmed twice whether the layout template needs to be changed? After the changed original layout template and the user identifier in the layout template are reset, after the initiating terminal detects the confirmation instruction of the initiating user on the secondary confirmation information, the original layout template in the layout template area and the user identifier added in the layout template can be deleted, and a new layout template is displayed in the layout template area. After the initiating user reselects the style of the layout template in the layout template region, no target user information is added to the lattices of the new layout template displayed in the layout template region, and the number of the new layout templates added to the layout template region may be one or more, the number of the new layout templates added to the layout template region may be specified by the initiating user when the initiating user selects the new layout template, and may also be determined based on the number of the original layout templates, or a default number (e.g., 1) of new layout templates may also be added.

In an embodiment, after determining the layout template appearing in the layout template region, the originating terminal may determine the layout of the multimedia conference interface based on the position setting operation by detecting the position setting operation for the target user information in the layout template region, where the position setting operation for the target user information may be, for example, the above-mentioned drag operation, move operation, select operation, and the like for the target user information. After the initiating terminal determines the target layout of the multimedia conference interface based on the position setting operation, the target layout can be sent to the target terminal indicated by the target user information, and the target user information is displayed in the multimedia conference interface at the display position of the target user information recorded in the target terminal according to the target layout in the multimedia conference interface.

In the embodiment of the invention, the initiating terminal can display the conference reservation interface after detecting the reservation operation aiming at the multimedia conference, and can display one or more layout templates after detecting the confirmation operation aiming at the selection identifier of the layout template in the conference reservation interface, so that the target layout template can be displayed in the layout preview area of the conference reservation interface according to the selection operation aiming at the target layout template in the one or more layout templates, and the self-definition of the layout of the multimedia conference interface can be realized. The method comprises the steps that when an initiating terminal detects layout management operation aiming at a multimedia conference interface, the layout management interface can be displayed, operation can be set according to the position aiming at target user information detected in a layout template area of the layout management interface, the target layout of the multimedia conference interface is determined, further, when the initiating terminal is switched to the multimedia conference interface from the layout management interface to display, the target user information can be displayed according to the display position of the target user information indicated by the target layout, the target user information can be flexibly arranged in the multimedia conference interface, and the flexibility of arrangement of the target user information in the multimedia conference interface is improved.

Please refer to fig. 9, which is a schematic flowchart illustrating a method for managing a layout of a multimedia experience interface according to an embodiment of the present invention, the method is applicable to a target terminal corresponding to target user information, and as shown in fig. 9, the method may include:

s901, responding to the display operation of the multimedia conference interface, and acquiring the target layout of the multimedia conference interface.

In one embodiment, the target terminal may determine that the display operation for the multimedia conference interface is detected after detecting that the target user participating in the multimedia conference enters the multimedia conference through the target terminal, so as to obtain a layout mode set by the originating terminal when the multimedia conference is predefined, and may obtain layout configuration information corresponding to the target layout of the multimedia conference from a database of a backend server after entering the multimedia conference if the target terminal determines that the layout mode of the multimedia conference is a custom mode, wherein the target layout is determined by the originating terminal of the multimedia conference according to the position setting operation for the target user information of the target user participating in the multimedia conference detected in a layout template region of a layout management interface, and the target layout records the display position of the target user information in the multimedia conference interface, the layout configuration information is generated by the background server according to the style information of the target layout of the multimedia conference, the display position of the target user information in the target layout and the target user information.

After the target terminal acquires the layout configuration information of the target layout from the database of the background server, the configuration information can be analyzed, so that style information of the target layout, the display position of the target user information in the target layout and the target user information can be acquired. In an embodiment, after obtaining the style information of the target layout, the display position of the target user information in the target layout, and the target user information, the target terminal may perform layout display according to the style information of the target layout after entering the multimedia conference, and may display the target user information in the display position indicated by the configuration information, as shown in fig. 10a, where a grid of each multimedia conference interface in fig. 10a is used to display the specified target user information.

S902, displaying the target user information in the multimedia conference interface according to the target layout.

In one embodiment, after the target terminal determines the target layout, the multimedia conference interface can be displayed according to the layout style indicated by the target layout, and the target user information is displayed in the grid of the target layout. The method comprises the steps that one or more target user information are displayed in the multimedia conference interface, after the target user information is displayed in the multimedia conference interface according to the indication of target layout, the target terminal can obtain the display information of each target user information displayed in the multimedia conference interface, so that the user identification with abnormal display can be determined from the target user information according to the display information, and after the user identification with abnormal display is determined from the multimedia conference interface, the overlay interface can be output at the display position corresponding to the user identification with abnormal display to prompt a user participating in the multimedia conference, and the state of the user identification corresponding to the overlay interface is abnormal. As shown in fig. 10b, if the user identifier displayed in the multimedia conference interface is the interface marked by 101 in fig. 10b, when it is detected that the target user information corresponding to the user a is abnormally displayed, a cover interface may be output at the user identifier corresponding to the user a, and the interface after the cover interface is output is the interface marked by 102 in fig. 10 b.

In one embodiment, after the target terminal enters the multimedia conference and displays the target user information on the multimedia conference interface according to the display position recorded by the target layout, the target terminal can detect the user identifier corresponding to the speaking user in the current multimedia conference and can further determine the grid displayed in the multimedia conference interface by the user identifier corresponding to the speaking user, so that the grid displayed in the multimedia conference interface by the user identifier corresponding to the speaking user can be highlighted, in one embodiment, when the user identifier corresponding to the speaking user is highlighted in the multimedia user interface, the display grid in the multimedia conference interface by the user identifier corresponding to the speaking user can be moved to the maximum grid of the multimedia conference interface for display, or the display grid in the multimedia conference interface by the user identifier corresponding to the speaking user is moved to the middle grid of the multimedia conference interface for display, or, the frame of the display grid in the multimedia conference interface of the user identifier corresponding to the speaking user is flashed, or other colors are added to the frame of the display grid in the multimedia conference interface of the user identifier corresponding to the speaking user for display, or speaking marks are added to the display grid in the multimedia conference interface of the user identifier corresponding to the speaking user for display, and the like.

In the embodiment of the invention, after the target terminal detects the display operation aiming at the multimedia conference interface, after the target layout of the multimedia conference interface is determined, the target user information is displayed in the multimedia conference interface according to the display position of the target user information indicated by the target layout, a covering interface can be output at the position where abnormal user information is displayed in the multimedia conference interface, to remind the users participating in the multimedia conference, so that the target terminal can display the information of the target users according to the arrangement of the initiating terminal to the target users, since the display of the target user information in the multimedia conference interface can be adjusted in real time in the originating terminal, the corresponding target terminal can also realize real-time adjustment of the display position of the target user information in the multimedia conference interface, and the flexibility of the target user information in the multimedia conference interface is improved.

Based on the description of the above method for managing the layout of the multimedia conference interface, an embodiment of the present invention further provides a device for managing the layout of the multimedia conference interface, where the device for managing the layout of the multimedia conference interface may be a computer program (including a program code) running in the initiating terminal. The layout management apparatus of the multimedia conference interface can be used for executing the layout management method of the multimedia conference interface as shown in fig. 2 and fig. 6, please refer to fig. 11, and the layout management apparatus of the multimedia conference interface includes: a display unit 111, and a determination unit 112.

A display unit 111 configured to display a layout management interface in response to a layout management operation for the multimedia conference interface, the layout management interface including: a layout template region of the multimedia conference interface;

a determining unit 112, configured to determine a target layout of the multimedia conference interface according to a position setting operation for target user information detected in the layout template region, where the target layout is used to indicate a display position of the target user information on the multimedia conference interface;

the display unit 111 is further configured to display the target user information in the multimedia conference interface according to the target layout.

In an embodiment, the layout template area is used to display a layout template, the layout template includes one or more grids, and if the target user information is not displayed in the grids, the determining unit 112 is specifically configured to:

In an embodiment, the layout template area is used to display a layout template, where the layout template includes one or more cells, and if the target user information is already displayed in a first cell of the layout template, the determining unit 112 is specifically configured to:

In one embodiment, the layout template region includes: template coding of the layout template and template adding identification; the device further comprises: a detection unit 113 and an addition unit 114.

A detecting unit 113, configured to detect a selection operation for adding an identifier to the template, and add a new layout template in the layout template area;

an adding unit 114, configured to add a template code to the new layout according to a display order of the new layout template in the layout template region.

In one embodiment, the layout template area includes a plurality of layout templates, and the apparatus further includes: an output unit 115, a receiving unit 116, and a deleting unit 117.

An output unit 115 configured to detect a deletion operation for any one of the plurality of layout template regions, and output first deletion prompt information;

a receiving unit 116, configured to receive a confirmation operation for the first deletion hint information;

a deleting unit 117 configured to delete the any layout template in the layout template area, where the deleting the any layout template includes: and deleting the user identification added in any layout template.

In an embodiment, the output unit 115 is further configured to output a second deletion prompting message;

the deleting unit 117 is further configured to detect a confirmation operation for the second deletion prompt information, and delete any layout template in the layout template area.

In one embodiment, the apparatus further comprises: an adjusting unit 118.

An adjusting unit 118, configured to obtain an adjustment operation on a layout template in the layout management interface, and adjust attribute information of the layout template according to the adjustment operation, where the attribute information includes one or more of the following: the width of the square frame, the shape of the square frame, the color of the square frame and the square background of the layout template;

In one embodiment, the display unit 111 is further configured to display a text editing window in the multimedia conference interface;

the display unit 111 is further configured to display the characters acquired from the text editing window in the multimedia conference interface; or, according to the adjustment operation of the characters displayed in the text editing window, displaying the adjusted characters in the multimedia conference interface;

In one embodiment, the display unit 111 is further configured to detect a reservation operation for the multimedia conference, and display a conference reservation interface, where the conference reservation interface includes: selecting marks of the layout template;

the display unit 111 is further configured to display one or more layout templates in response to a confirmation operation for the selection identifier of the layout template;

the display unit 111 is further configured to display a target layout template in the layout preview area of the conference reservation interface according to a selection operation on the target layout template in the one or more layout templates.

In an embodiment, the display unit 111 is further configured to detect a template switching operation on a target layout template in the layout preview area, and redisplay the one or more layout templates;

the display unit 111 is further configured to replace the target layout template with a new layout template according to a selection operation on the new layout template in the one or more layout templates, and display the new layout template in a layout preview area of the conference reservation interface.

In one embodiment, the apparatus further comprises: a transmission unit 119.

The determining unit 112 is further configured to obtain style information of the target layout, and determine a display position of the target user information in the target layout;

a sending unit 119, configured to send the style information, the display position, and the target user information to a backend server, so as to generate layout configuration information of the target layout in the backend server, and send the layout configuration information to a target terminal indicated by the target user information.

In the embodiment of the present invention, after detecting the layout management operation for the multimedia conference interface, the display unit 111 may display the layout management interface, the initiating user of the multimedia conference may set the position of the target user information displayed in the layout management interface, the determining unit 112 may determine the display position of the target user information in the layout template displayed in the layout management interface, further, the determining unit 112 may determine the target layout corresponding to the multimedia conference interface based on the detected position setting operation for the target user information, so that the sending unit 113 may display the target user information in the multimedia conference interface according to the target layout, and may implement flexible switching of the display position of the target user information in the multimedia conference interface.

Based on the description of the above method for managing the layout of the multimedia conference interface, an embodiment of the present invention further provides a device for managing the layout of the multimedia conference interface, where the device for managing the layout of the multimedia conference interface may be a computer program (including a program code) running in the target terminal. The layout management apparatus of the multimedia conference interface can be used for executing the layout management method of the multimedia conference interface as shown in fig. 9, please refer to fig. 12, and the layout management apparatus of the multimedia conference interface includes: an acquisition unit 121 and a display unit 122.

An obtaining unit 121, configured to obtain, in response to a display operation of a multimedia conference interface, a target layout of the multimedia conference interface, where the target layout is determined by an initiating terminal of a multimedia conference according to a position setting operation for target user information detected in a layout template region of a layout management interface, and the target layout is used to indicate a display position of the target user information on the multimedia conference interface;

a display unit 122, configured to display the target user information in the multimedia conference interface according to the target layout.

In one embodiment, the number of the target user information displayed in the multimedia conference interface is plural, and the apparatus further includes: and an output unit 123.

The obtaining unit 121 is further configured to obtain display information of each piece of target user information displayed in the multimedia conference interface, and determine a user identifier with an abnormal display from the plurality of pieces of target user information according to the display information;

and the output unit 123 is configured to output a masking interface at a display position corresponding to the user identifier with the display abnormality.

In an embodiment, the obtaining unit 121 is specifically configured to:

In the embodiment of the present invention, after the obtaining unit 121 detects the display operation for the multimedia conference interface, after determining the target layout of the multimedia conference interface, the display unit 122 may display the target user information in the multimedia conference interface according to the display position indicated by the target layout, the output unit 123 may output a cover interface at the user identifier where the abnormality is displayed in the multimedia conference interface, to remind the users participating in the multimedia conference, so that the information of the target users can be displayed according to the arrangement of the initiating terminal, since the display of the target user information in the multimedia conference interface can be adjusted in real time in the originating terminal, the display position of the target user information in the multimedia conference interface can be correspondingly adjusted in real time, and the flexibility of the target user information in the multimedia conference interface is improved.

Fig. 13 is a schematic block diagram of an initiating terminal according to an embodiment of the present invention. The server in the present embodiment as shown in fig. 13 may include: one or more processors 131; one or more input devices 132, one or more output devices 133, and memory 134. The processor 131, input device 132, output device 133, and memory 134 are connected by a bus 135. The memory 134 is used to store a computer program comprising program instructions, and the processor 131 is used to execute the program instructions stored by the memory 134.

The memory 134 may include volatile memory (volatile memory), such as random-access memory (RAM); the memory 134 may also include a non-volatile memory (non-volatile memory), such as a flash memory (flash memory), a solid-state drive (SSD), etc.; the memory 134 may also comprise a combination of the above types of memory.

The processor 131 may be a Central Processing Unit (CPU). The processor 131 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or the like. The PLD may be a field-programmable gate array (FPGA), a General Array Logic (GAL), or the like. The processor 131 may also be a combination of the above structures.

In an embodiment of the present invention, the memory 134 is configured to store a computer program, the computer program includes program instructions, and the processor 131 is configured to execute the program instructions stored in the memory 134, so as to implement the steps of the corresponding methods as described above in fig. 2 and fig. 6.

In one embodiment, the processor 131 is configured to call the program instructions for performing:

In one embodiment, the layout template area is used for displaying a layout template, the layout template includes one or more cells, and if the target user information is not displayed in the cells, the processor 131 is configured to call the program instructions to perform:

In one embodiment, the layout template area is used for displaying a layout template, the layout template includes one or more cells, and if the target user information is displayed in a first cell of the layout template, the processor 131 is configured to call the program instructions to perform:

In one embodiment, the layout template region includes: template coding of the layout template and template adding identification; the processor 131 is configured to call the program instructions for performing:

detecting selection operation for adding the identifier for the template, and adding a new layout template in the layout template area;

and adding template codes for the new layout according to the display sequence of the new layout template in the layout template area.

In one embodiment, the layout template area includes a plurality of layout templates, and the processor 131 is configured to call the program instructions to perform:

detecting a deletion operation for any layout template in the plurality of layout template areas, and outputting first deletion prompt information;

receiving a confirmation operation aiming at the first deletion prompt message, and deleting any layout template in the layout template area, wherein the deleting any layout template comprises: and deleting the user identification added in any layout template.

outputting second deletion prompt information;

and detecting a confirmation operation aiming at the second deletion prompt message, and deleting any layout template in the layout template area.

obtaining an adjustment operation on a layout template in the layout management interface, and adjusting attribute information of the layout template according to the adjustment operation, wherein the attribute information comprises one or more of the following: the width of the square frame, the shape of the square frame, the color of the square frame and the square background of the layout template;

displaying a text editing window in the multimedia conference interface;

displaying the characters acquired from the text editing window in the multimedia conference interface; or, according to the adjustment operation of the characters displayed in the text editing window, displaying the adjusted characters in the multimedia conference interface;

detecting a reservation operation aiming at the multimedia conference, and displaying a conference reservation interface, wherein the conference reservation interface comprises: selecting marks of the layout template;

displaying one or more layout templates in response to a confirmation operation for the selection identification of the layout template;

and displaying the target layout template in a layout preview area of the conference reservation interface according to the selection operation of the target layout template in the one or more layout templates.

detecting template switching operation on the target layout template in the layout preview area, and redisplaying the one or more layout templates;

and replacing the target layout template with the new layout template according to the selection operation of the new layout template in the one or more layout templates, and displaying the new layout template in a layout preview area of the conference reservation interface.

acquiring style information of the target layout, and determining the display position of the target user information in the target layout;

and sending the style information, the display position and the target user information to a background server so as to generate layout configuration information of the target layout in the background server and send the layout configuration information to a target terminal indicated by the target user information.

Please refer to fig. 14, which is a block diagram schematically illustrating a structure of an initiating terminal according to an embodiment of the present invention. The server in the present embodiment shown in fig. 14 may include: one or more processors 141; one or more input devices 142, one or more output devices 143, and memory 144. The processor 141, the input device 142, the output device 143, and the memory 144 are connected via a bus 145. Memory 144 is used to store computer programs comprising program instructions and processor 141 is used to execute the program instructions stored by memory 144.

The memory 144 may include volatile memory (volatile memory), such as random-access memory (RAM); the memory 144 may also include a non-volatile memory (non-volatile memory), such as a flash memory (flash memory), a solid-state drive (SSD), etc.; the memory 144 may also comprise a combination of the above types of memory.

The processor 141 may be a Central Processing Unit (CPU). The processor 141 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or the like. The PLD may be a field-programmable gate array (FPGA), a General Array Logic (GAL), or the like. The processor 141 may also be a combination of the above structures.

In an embodiment of the present invention, the memory 144 is configured to store a computer program, the computer program includes program instructions, and the processor 141 is configured to execute the program instructions stored in the memory 144, so as to implement the steps of the corresponding method as described above in fig. 9.

In one embodiment, the processor 141 is configured to call the program instructions for performing:

In one embodiment, the number of the target user information displayed in the multimedia conference interface is plural, and the processor 141 is configured to call the program instructions to perform:

acquiring display information of each target user information displayed in the multimedia conference interface, and determining a user identifier with abnormal display from a plurality of target user information according to the display information;

and outputting a masking interface at a display position corresponding to the user identification with the abnormal display.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

While the invention has been described with reference to a particular embodiment, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A layout management method for a multimedia conference interface is characterized by comprising the following steps:

2. The method of claim 1, wherein the layout template area is used for displaying a layout template, the layout template includes one or more lattices, and if the target user information is not displayed in the lattices, the determining the target layout of the multimedia conference interface according to a position setting operation for the target user information detected in the layout template area includes:

3. The method of claim 1, wherein the layout template area is used for displaying a layout template, the layout template includes one or more cells, and if the target user information is already displayed in a first cell of the layout template, the determining the target layout of the multimedia conference interface according to the position setting operation for the target user information detected in the layout template area comprises:

4. The method of claim 1, wherein laying out the template region comprises: template coding of the layout template and template adding identification; the method further comprises the following steps:

5. The method according to claim 1, wherein the layout template area includes a plurality of layout templates, and the method further includes:

6. The method of claim 5, wherein after receiving the confirmation operation for the first deletion hint information, the method further comprises:

outputting second deletion prompt information;

7. The method of claim 1, wherein after the displaying the layout management interface, the method further comprises:

8. The method of claim 1, further comprising:

displaying a text editing window in the multimedia conference interface;

9. The method of claim 1, further comprising:

10. The method of claim 9, wherein after displaying the target layout template in a layout preview area of the conference reservation interface, the method further comprises:

11. The method of claim 1, further comprising:

12. A layout management method for a multimedia conference interface is characterized by comprising the following steps:

13. The method of claim 12, wherein the number of target user information displayed in the multimedia conference interface is plural, the method further comprising:

14. The method of claim 12, wherein obtaining the target layout of the multimedia conference interface comprises:

15. A layout management apparatus for a multimedia conference interface, comprising: