WO2024078406A1 - Data display method and apparatus, electronic device and storage medium - Google Patents

Abstract

The present disclosure provides a data display method and apparatus, an electronic device and a storage medium. The method comprises: acquiring layout configuration information of a client, the layout configuration information comprising configuration data of multiple display windows, and the configuration data comprising window positioning parameters and data quality parameters; rendering the multiple display windows on a display interface of the client, on the basis of the window positioning parameters; displaying data in corresponding display windows on the basis of the data quality parameters, the data displayed by different display windows having different sources. The method provided by the present disclosure can control the positions of corresponding display windows on the display interface by means of window positioning parameters, and control data quality of the corresponding display windows by means of data quality parameters, so that the client layout may be flexibly adjusted without considering the version of the client, and a customization requirement of a user for the client layout is met.

Description

Data display method, device, electronic device and storage medium

This application claims priority to the Chinese patent application filed with the China Patent Office on October 13, 2022, with application number 202211255646.5 and application name “A data display method, device, electronic device and storage medium”, the entire contents of which are incorporated by reference in this application.

Technical Field

The present disclosure relates to the field of computer technology, and in particular to a data display method, device, electronic device and storage medium.

Background technique

With the rapid development of the Internet and multimedia technology, multimedia conferences such as audio conferences and video conferences with good real-time and interactivity have been widely used, and higher and higher requirements have been placed on the video quality of multimedia conferences.

In the related art, when participating in a multimedia conference, different layout templates such as a lecture view, a thumbnail view, and a grid view are usually provided to each client, and each layout template has its own number. The web conference control terminal can send the layout template number selected by the administrator on the server to each client, and each client performs window layout on the display interface according to the layout template indicated by the layout template number based on the layout template number. However, when a new layout template is added to the server, the client cannot perform window layout on the display interface according to the layout template indicated by the layout template number based on the layout template number, resulting in a limitation in the types of layout styles of the client.

Summary of the invention

According to one aspect of the present disclosure, a data presentation method is provided, the method comprising:

Obtaining layout configuration information of the client, the layout configuration information including configuration data of multiple display windows, the configuration data including window positioning parameters and data quality parameters;

Render multiple display windows on the client's display interface based on the window positioning parameters;

The data is displayed in the corresponding display window based on the data quality parameters.

According to another aspect of the present disclosure, a data presentation method is provided, the method comprising:

Determine layout configuration information of the client, the layout configuration information includes configuration data of multiple display windows, the configuration data includes window positioning parameters and data quality parameters;

Send layout configuration information to the client, where the window positioning parameters are used to position the corresponding display window on the client display interface, and the data quality parameters are used to control the data quality displayed in the corresponding display window.

According to another aspect of the present disclosure, a data display device is provided, the device comprising:

A processing module, used to obtain layout configuration information of a client, the layout configuration information includes configuration data of multiple display windows, the configuration data includes window positioning parameters and data quality parameters;

A display module, used for rendering multiple display windows on the display interface of the client based on the window positioning parameters;

The display module is used to display data in the corresponding display window based on the data quality parameters. The data displayed in different display windows come from different sources.

According to another aspect of the present disclosure, a data display device is provided, the device comprising:

A processing module, used to determine layout configuration information of a client, the layout configuration information including configuration data of a plurality of display windows, the configuration data including window positioning parameters and data quality parameters;

The communication module is used to send layout configuration information to the client, wherein the window positioning parameter is used to position the corresponding display window on the client display interface, and the data quality parameter is used to control the data quality displayed in the corresponding display window.

According to another aspect of the present disclosure, there is provided an electronic device, comprising:

processor; and,

Memory for storing programs;

The program includes instructions, and when the instructions are executed by a processor, the processor executes the method according to the exemplary embodiment of the present disclosure.

According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause a computer to execute the method according to the exemplary embodiments of the present disclosure.

One or more technical solutions provided in the exemplary embodiments of the present disclosure can first obtain the layout configuration information of the client, and the layout configuration information includes the configuration data of multiple display windows, and the configuration data includes window positioning parameters and data quality parameters. Based on this, multiple display windows can be rendered on the display interface of the client based on the window positioning parameters, and data can be displayed in the corresponding display windows based on the data quality parameters, and the data displayed in different display windows comes from different sources. It can be seen that the method of the exemplary embodiments of the present disclosure can flexibly display multiple display windows of the required layout on the display interface through the configuration data of multiple display windows, and configure the display data quality of each display window, so that the types of layout styles of the client are not limited by the client version, and meet the user's customized needs for the client layout.

BRIEF DESCRIPTION OF THE DRAWINGS

Further details, features and advantages of the present disclosure are disclosed in the following description of exemplary embodiments in conjunction with the accompanying drawings, in which:

FIG. 1 is a schematic diagram showing an example system in which various methods described herein may be implemented according to an exemplary embodiment of the present disclosure;

FIG2 shows a basic flow chart of a data display method of an exemplary embodiment of the present disclosure;

FIG3 shows an exemplary flow chart of a data display method of an exemplary embodiment of the present disclosure;

FIG4 shows another exemplary flow chart of a data display method according to an exemplary embodiment of the present disclosure;

FIG5A shows a schematic diagram 1 of a configuration operation process of an exemplary embodiment of the present disclosure;

FIG5B shows a second procedural schematic diagram of a configuration operation of an exemplary embodiment of the present disclosure;

FIG6A shows another configuration operation process schematic diagram 1 of an exemplary embodiment of the present disclosure;

FIG6B shows another procedural schematic diagram of configuration operation according to an exemplary embodiment of the present disclosure;

FIG. 7 shows a schematic diagram of digitized layout configuration information of an exemplary embodiment of the present disclosure;

FIG8A shows a schematic diagram of a layout style of a conference client in the related art of an exemplary embodiment of the present disclosure;

FIG8B shows a schematic diagram of a layout style of a conference client according to an exemplary embodiment of the present disclosure;

FIG. 9A shows a schematic diagram of a layout pattern of a video client in a related art of an exemplary embodiment of the present disclosure;

FIG. 9B shows a second schematic diagram of a layout pattern of a video client in the related art of an exemplary embodiment of the present disclosure;

FIG9C shows a schematic diagram of a layout pattern of a video client of an exemplary embodiment of the present disclosure;

FIG10 shows a schematic block diagram of modules of a data display device according to an exemplary embodiment of the present disclosure;

FIG11 shows a schematic block diagram of a chip according to an exemplary embodiment of the present disclosure;

FIG. 12 shows a block diagram of an exemplary electronic device that can be used to implement an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and/or in parallel. In addition, the method embodiments may include additional steps and/or omit the steps shown. The scope of the present disclosure is not limited in this respect.

The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

Before introducing the embodiments of the present disclosure, the following definitions are given for the relevant terms involved in the embodiments of the present disclosure:

Multimedia conferencing is a multimedia communication technology that allows people in different places to achieve "real-time, visual, and interactive" communication through a certain transmission medium. It can distribute various information such as static/dynamic images, voice, text, and pictures of people to the terminal devices of each user through various existing electrical communication transmission media, so that geographically dispersed users can gather together and exchange information through graphics, sound, and other methods, which increases the understanding of the content of both parties and makes people feel as if they are participating in the meeting in the same venue.

In related technologies, different layout templates such as lecture view, thumbnail view and grid view are usually provided for each participating client. Each layout template has its own number. When the user wants to switch the conference layout, he needs to select the corresponding layout template on the client according to the number sent by the server, and display the corresponding video data in each window. For example: for a multimedia conference with 6 participants, the layout template that only displays the main screen is numbered "L1", the layout template that displays 1+5 large-format is numbered "L1S5-LT", and the layout template that displays 1+5 small-format is numbered "L1S5-RB". If the user wants to switch the conference layout to 1+5 When the screen size is large, the client switches the conference layout to 1+5 large format according to the number "L1S5-LT" sent by the server. It can be seen that the switching method of the above layout templates depends on the number of the corresponding layout template. When a new layout template is added to the server, the old version of the client is not updated in time, resulting in the old version of the client not storing the corresponding number of the new layout template. Therefore, when the number of the layout template is sent by the server, the client cannot perform window layout according to the layout template indicated by the layout template number on the display interface based on the layout template number, and render the new layout template on the display interface. It can be seen that the switching method of the above layout templates has high requirements for the client version. The old version of the client often cannot use the new layout template, and cannot achieve flexible arrangement of each display window.

In order to solve the technical problem that the client layout depends on the layout template number and flexibly layout the display windows in the client display interface, the exemplary embodiment of the present disclosure provides a data display method, which can flexibly layout multiple display windows in the client display interface regardless of the client version, so that the layout styles are diversified, thereby meeting the user's customized needs for the client layout.

The data display method of the exemplary embodiment of the present disclosure can be applied to various scenarios for switching multiple window layout styles. FIG1 shows a schematic diagram of an example system in which the various methods described herein can be implemented according to an exemplary embodiment of the present disclosure. As shown in FIG1 , an application scenario 100 of the exemplary embodiment of the present disclosure includes a first terminal 110, a second terminal 120, a server 130, and a data storage system 140.

In actual application, as shown in FIG1 , the first terminal 110 and the second terminal 120 are both installed with a client capable of switching multiple window layout styles, and other clients may also be installed. It should be understood that the client here may be any client that needs to switch multiple window layout styles, including conference clients, live broadcast clients, video websites, online writing websites, etc., which are not listed here one by one.

For conference clients and live broadcast clients, the scenarios are similar. For both, relevant members enter the corresponding client and can view data from other client users in different display windows on the corresponding client display interface. For example: when participating in a multimedia conference, each participant will join the conference through the client, display a list of participants on the client, and display the data that the participants want to share in the window on the display interface. At this time, the layout of the window can be configured. For clients such as video websites and graphic websites, the data they display comes from resources uploaded by client users. When searching for multimedia resources on similar clients, such clients often provide several layout styles for users to choose from.

The clients installed on the first terminal 110 and the second terminal 120 may be the same type of applications based on the same or different operating system platforms (Android, IOS, Huawei Hongmeng system, etc.). The first terminal 110 and the second terminal 120 may be the initiating terminal of the multimedia conference, and the second terminal 120 may be the target terminal corresponding to other users participating in the multimedia conference. The number of the second terminals 120 may be one or more, which is determined according to the actual application scenario. The exemplary embodiments of the present disclosure are only illustrated by the first terminal 110 and the second terminal 120. The device types of the first terminal 110 and the second terminal 120 are the same or different, and the device type includes at least one of a smart phone, a tablet computer, a laptop computer, and a desktop computer.

As shown in FIG1 , the first terminal 110 and the second terminal 120 can communicate with the server 130 through a communication network. In terms of communication mode, the communication network can be divided into a wireless communication network, such as satellite communication, microwave communication, etc., or a wired communication network, such as optical fiber communication, power line carrier communication; in terms of communication range, the communication network can be a local area communication network, such as Wifi, Zigbee communication network, etc., or a wide area communication network, such as the Internet network.

As shown in FIG1 , the server 130 may be a single server, or a server cluster or distributed system composed of multiple servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms. The data storage system 140 may be a general term, including local storage and databases for storing historical data. The data storage system 140 may be separate from the server 130 or integrated into the server 130.

In actual applications, the user corresponding to the first terminal 110 is the first user, who is the initiator of the multimedia conference; the user corresponding to the second terminal 120 is the second user, who is the participant of the multimedia conference. The first user and the second user can respectively input their own user names and passwords to log in to the server 130 through the first terminal 110 and the second terminal 120. The server 130 verifies the identity of the user by reading the user database. If the user name and password are correct, a sign of successful user login is displayed. The first user can pull at least one second user into the conference room to start a multimedia conference through group chat. The first user and the second user can also enter the conference room to participate in the multimedia conference by clicking on the conference link, scanning the conference invitation code, entering the conference number, etc.

The first user can configure the layout of the display interface of the client through the first terminal 110, and the first terminal 110 displays the corresponding layout on the display interface of the first terminal 110 based on the configuration operation of the first user on the client; at the same time, the first terminal 110 sends the layout style to the server 130, and the server 130 sends the layout style to the second terminal 120. After receiving the layout style, the second terminal 120 Rendering the corresponding layout in the display interface. In addition, the layout of the display interface of the client can also be configured on the server 130, and the server 130 sends the configured layout configuration information to the first terminal 110 and the second terminal 120. After receiving the layout style, the first terminal 110 and the second terminal 120 render the corresponding layout in the display interface.

FIG2 shows a basic flow chart of a data display method of an exemplary embodiment of the present disclosure. As shown in FIG2 , the data display method of an exemplary embodiment of the present disclosure may include:

Step 201: The client obtains the layout configuration information of the client, the layout configuration information includes the configuration data of multiple display windows, the configuration data includes the window positioning parameters and the data quality parameters. It should be understood that the client can be a client supporting multimedia interaction, including a conference client, a live broadcast client, a video website, an online article website, etc., which are not listed here one by one.

In actual applications, the layout configuration information can be issued by the server, or the client can generate the layout configuration information in response to the operation for the layout configuration. Regardless of whether it is the layout configuration information issued by the server or the layout configuration information generated by the client in response to the operation for the layout configuration, the layout configuration information can be implemented by user settings.

When the layout configuration information is configured on the client, the layout configuration information can be directly obtained by the client (of the first terminal) without being forwarded by the server; at the same time, it can be forwarded by the server and then obtained by the client (of the first terminal and/or the second terminal). When the layout configuration information is configured on the server, after the server obtains the layout configuration information, it sends the layout configuration information to the client (including the first terminal and the second terminal).

Step 202: The client renders multiple display windows on the display interface of the client based on the window positioning parameters. When the window positioning parameters may include shape parameters and size parameters of the display windows, the shape parameters may be used to define the shape of each display window, and the shape of each display window may be the same or different.

The shape of the display window can be square, rectangle, triangle, circle, rounded rectangle, rhombus, polygon, star, heart, or other regular shapes or irregular shapes, which is determined according to actual selection and is not specifically limited here.

In actual applications, the shape parameter can be set to a rectangle by default or by configuration, and the size parameter can be defined by the display window coordinates, such as defining the size of the display window by the coordinates of multiple characteristic positions of the display window. It should be understood that the coordinates of the characteristic positions of different display windows can belong to the same coordinate system, which can be a coordinate system established in the client display interface or other coordinate systems. Standard system.

For example, when the display window is rectangular by default, the display window has four vertices, and the two diagonal vertex positions can be characteristic positions. The two diagonal vertices can be the upper left vertex and the lower right vertex, or the lower left vertex and the upper right vertex of the display window. On this basis, combined with the default rectangular shape, the width, height and geometric center position of the rectangular display window can be determined based on the coordinate combination of the above characteristic positions.

Step 203: The client displays data in a corresponding display window based on the data quality parameter. The data displayed in the display window can be various types of information such as pictures, videos, text, files, audio, etc., which are determined according to the actual application scenario and are not specifically limited here.

The data quality parameters include at least one of the image frame rate and the image resolution. The image frame rate refers to the number of frames of the image transmitted per second, which is expressed as resolution and can be used to indicate the smoothness of the data displayed in the display window. The image resolution can be used to indicate the amount of information stored in the image, which is expressed as fps, which is the number of pixels per inch of the image. The smaller the pixel, the more pixels are contained in the unit length, and the higher the resolution. Based on this, after receiving the image data, the client can use the image frame rate to control the playback speed of the image data, and use the image resolution to control the clarity of the image data.

The number of configuration data of the display window can be selected according to the actual situation of the number of participants and the application scenario. Different display windows display data from different sources. The data source here can be distinguished according to the client user account or other distinctions. For example: the data of the two display windows can be data from different client user accounts. For example, in a scenario where there is no shared screen, the data of the display window can display the data of the client user account corresponding to the display window. The data can be the name, avatar, etc. of the user account. Another example: the data of the two display windows can also be images from different paths of the same client. For example, in a shared screen scenario, if a display window corresponding to the client user who shares the screen already exists, a new display window is added for the client user, and the shared screen content is displayed in the display window.

In actual applications, if the client user does not start the camera, the exemplary embodiments of the present disclosure can add default images such as animated images or video materials to the display window of the client user. These animated images or video materials can be default images pre-stored locally on the client or pre-stored on the server. When the client user does not start the camera, the client can directly call the default image as Display data is rendered in the display window. Considering that the default image does not come from the client user, a higher image quality is not required. Therefore, if it is a default image, the image quality parameters of the default image can be used instead of the data quality parameters that need to be configured.

It can be seen that the method of the exemplary embodiment of the present disclosure can configure configuration data for multiple display windows contained in the client display interface respectively, and the configuration data includes window positioning parameters and data quality parameters. The position of the corresponding display window in the display interface is controlled by the window positioning parameters, and the data quality of the corresponding display window is controlled by the data quality parameters. Therefore, there is no need to consider the client version, and the client layout can be flexibly adjusted to meet the user's customized needs for the client layout, which solves the technical problem in the prior art that the client layout depends on the layout template number.

In an optional manner, the method of the exemplary embodiment of the present disclosure may further include: the client determines an association relationship between each display window and a data source of the corresponding display window.

Exemplarily, the above association relationship may be a default association relationship of the system. After rendering multiple display windows on the client display interface, data sources may be bound to different display windows in a certain order. For example, each display window may have identification information, which may be a sequence number or other identification. Taking the sequence number as an example, the data source may be bound to each display window according to the sequence number in the order in which the participants enter the conference room or the order of the participant list (essentially, a display window for displaying image data is configured for each participant).

Exemplarily, the above association relationship may be a customized association relationship. In the configuration stage of the layout configuration information, when configuring the configuration data for each display window, the data source may be bound to each display window. For example, each display window may be bound to a client user, so that the display window is bound to the data from the client.

In some embodiments, when the layout configuration information is configured on the client and is directly obtained by the client without being forwarded by the server, the data display method of the exemplary embodiment of the present disclosure can be executed by the terminal or a chip in the terminal. The method of the exemplary embodiment of the present disclosure is described in detail below with reference to the accompanying drawings.

FIG3 shows an example flow chart of a data display method of an exemplary embodiment of the present disclosure. As shown in FIG3 , the data display method of an exemplary embodiment of the present disclosure may include:

Step 301: The client determines the window positioning parameters of multiple display windows in response to the layout configuration operation for the client, and configures data quality parameters for each display window. The layout configuration information includes the configuration data of the multiple display windows, and the configuration data includes the window positioning parameters and the data quality parameters. See the above step 201 for details, which will not be repeated here.

When the client responds to the layout configuration operation for the client, the layout configuration operation permission can be opened to any client user participating in the meeting, or it can be opened to one or more client users participating in the meeting. The identity of the client user with the layout configuration operation permission can be the host, administrator, administrator assistant, etc., please refer to the permission scope for details.

Exemplarily, the client can configure the layout configuration information of the client in response to the modification operation on the layout configuration information. The above modification operation can be performed on the client setting interface, and after the layout information configuration is completed, the newly added layout configuration information can be stored locally or uploaded to the server for storage.

Exemplarily, the client can determine the layout configuration information of the client in response to a selection operation on the layout configuration information. The selection operation can also be performed on the client setting interface to configure the layout. For example, when it is necessary to display the layout on the display interface of the client, target configuration information can be selected from multiple stored layout configuration information, and the target configuration information can be determined as the layout configuration information of the client. The target configuration information can also be modified for use.

Step 302: The client renders multiple display windows on the display interface of the client based on the window positioning parameters. The specific content is detailed in the above step 202, which will not be repeated here.

Step 303: The client displays the data in the corresponding display window based on the data quality parameter. The specific content is detailed in the above step 203, which will not be repeated here.

It can be seen that when the layout configuration information is configured on the client and directly obtained by the client, the layout configuration information can be directly obtained by the client without passing through the server after the configuration is completed. Therefore, the data display method of the exemplary embodiment of the present disclosure can realize flexible adjustment of the client layout without considering the client version, meet the user's customized needs for the client layout, and solve the technical problem in the prior art that the client layout depends on the layout template number.

In an optional manner, when the client determines the window positioning parameters of multiple display windows and configures the data quality parameters for each display window, the layout configuration information can be determined. On this basis, the method of the exemplary embodiment of the present disclosure can also include: the client sends the layout configuration information to the server, and the server forwards the layout configuration information to other clients.

It can be seen that when the layout configuration information is configured on the client, forwarded by the server, and then obtained by the client, the layout configuration information is forwarded by the server after the configuration is completed and then obtained by the client. The server only receives and forwards the layout configuration information, but does not configure it. That is, the server does not affect the determination of the layout configuration information. Therefore, the data display method of the exemplary embodiment of the present disclosure can realize flexible adjustment of the client layout without considering the client version, and meet the user's customized needs for the client layout.

In some embodiments, when the layout configuration information is configured on the server, the steps executed by the terminal in the data display method provided by the exemplary embodiment of the present disclosure may also be executed by a chip applied in the terminal, and the steps executed by the server may also be executed by a chip applied in the server. The following embodiments take the terminal and the server as examples respectively as the execution subjects, and describe the method of the exemplary embodiment of the present disclosure in an interactive manner in combination with the accompanying drawings.

FIG4 shows another exemplary flow chart of a data display method of an exemplary embodiment of the present disclosure. As shown in FIG4 , the data display method of an exemplary embodiment of the present disclosure may include:

Step 401: The server determines the layout configuration information of the client, the layout configuration information includes the configuration data of multiple display windows, the configuration data includes window positioning parameters and data quality parameters. The specific content is referred to above and will not be repeated here.

Exemplarily, the server may configure the layout configuration information of the client in response to the modification operation on the layout configuration information. The above modification operation may be performed on the server setting interface to perform layout configuration, and after the layout information configuration is completed, the newly added layout configuration information may be stored.

Exemplarily, the server may determine the layout configuration information of the client in response to a selection operation on the layout configuration information. The selection operation may also be performed on the server setting interface to configure the layout. For example, when the layout needs to be displayed on the display interface of the client, the target configuration information may be selected from the stored multiple layout configuration information, and the target configuration information may be determined as the layout configuration information of the client. The target configuration information may also be modified for use.

Step 402: The server sends layout configuration information to the client. The window positioning parameter is used to position the corresponding display window in the client display interface, and the data quality parameter is used to control the data quality displayed in the corresponding display window. Based on this, the method of the exemplary embodiment of the present disclosure also includes:

Step 403: The client obtains the layout configuration information from the server. At this point, the client parses the layout configuration information to obtain configuration data of multiple display windows, each of which includes window positioning parameters and data quality parameters.

Step 404: The client renders multiple display windows on the client's display interface based on the window positioning parameters For details, please refer to the above step 202, which will not be repeated here.

Step 405: The client displays the data in the corresponding display window based on the data quality parameter. The specific content is detailed in the above step 203, which will not be repeated here.

In an optional manner, when the layout configuration information is configured on the server, the layout configuration information can be configured on the web control front end. After the configuration is completed, the web control front end sends the layout configuration information to the web control back end. After receiving it, the web control back end forwards it to the client back end. Finally, the client back end sends the layout configuration information to the client.

It can be seen that when the layout configuration information is configured on the server, the layout configuration information is sent from the server to the client, so that the client can render the corresponding layout and display the corresponding data on the display interface based on the layout configuration information. Therefore, the data display method of the exemplary embodiment of the present disclosure can realize the flexible adjustment of the client layout without considering the client version, meet the user's customized needs for the client layout, and solve the technical problem that the client layout depends on the layout template number in the prior art.

In an optional manner, both the client and the server can configure the layout configuration information by setting parameters and by customizing the parameters. The operation process of the two is roughly the same, but the operation interface is slightly different. When the client configures the layout configuration information, the client user with the layout configuration operation authority can perform the layout configuration in the client's setting interface; when the server configures the layout configuration information, the client user with the layout configuration operation authority can log in to the layout configuration of the server's web control front-end setting interface. Both can configure the layout configuration information, but the layout configuration function of the web control front-end is more than that of the client.

FIG5A shows a procedural schematic diagram of a configuration operation of an exemplary embodiment of the present disclosure, and FIG5B shows a procedural schematic diagram of a configuration operation of an exemplary embodiment of the present disclosure. As shown in FIG5A , when configuring the layout configuration information by setting parameters, the number of display windows and the data source in the layout template style can be selected in the layout configuration bar 510 of the setting interface 500. For example, if there are 4 meeting participants in the conference room, the number of display windows can be set to 4, wherein the data of user 1 and user 2 are selected to be displayed in the display window. After these operations are completed, click the OK button to jump to the configuration data interface of the display window configuration interface shown in FIG5B . At this time, the configuration data of display window 1 can be configured, and display window 1 can be used to display the data of user 1. For example, the shape of display window 1 can be selected in the shape parameter option bar 511, the coordinates of the characteristic position of display window 1 can be assigned in the size parameter option bar 512, and the image of display window 1 can be assigned in the image frame rate option bar 513. Assign a value to the image frame rate, and assign a value to the image resolution of the display window 1 in the image resolution option bar 514. When the above configuration operation is completed, click the OK button to configure the configuration data of the next display window.

Fig. 6A shows another procedural schematic diagram of configuration operation of an exemplary embodiment of the present disclosure, and Fig. 6B shows another procedural schematic diagram of configuration operation of an exemplary embodiment of the present disclosure. As shown in Fig. 6A, when the layout configuration information is configured in a custom manner, the custom configuration interface 600 includes a member list 610 and a layout view 620, the member list 610 includes the first participant 611, the second participant 612, the third participant 613 and the fourth participant 614, and the layout view 620 has a plurality of dotted grids of the same size, and the display window of the selected participant can be rendered in the specified dotted grid in a dragging manner. If the first participant 611 and the second participant 612 need to be displayed in the layout view 620, the first participant 611 and the second participant 612 can be long pressed, and the first participant 611 can be dragged to the first dotted grid 621 and the second participant 612 can be dragged to the second dotted grid 622 in the directions indicated by the arrows. As shown in FIG6B , a display window of the first participant 611 is rendered in the first dotted grid 621, and corresponding data is displayed in the first display window 621 based on the data quality parameters of the first participant 611; a display window of the second participant 612 is rendered in the second dotted grid 622, and corresponding data is displayed in the second display window 622 based on the data quality parameters of the second participant 612.

If the server adds new layout configuration information and the client does not synchronize, the server can label the new layout configuration information. When the client user logs in to the web control front end and selects the label of the new layout configuration information, the web control back end can generate data-based layout configuration information based on the label and send it to the client through the web control back end and the client back end. It should be understood that the layout configuration information here includes not only the configuration data of multiple display windows, but also the window positioning parameters and data quality parameters.

Exemplarily, for a conference scenario, the web page control front end and web page control back end may be a conference control front end and conference control back end, and the client back end may be a conference client back end; for video websites and graphic websites, the web page control front end and web page control back end may be a website front end and website back end, and the client back end may be a website client back end.

The above three configuration methods of layout configuration information, regardless of the interaction method of the client front end, can be displayed in the same way as the digital layout configuration information formed at the back end, and can be displayed according to the digital layout configuration information shown in Figure 7. As shown in Figure 7, assuming that the number of participants is n The layout configuration information 700 includes configuration data of n display windows, including: configuration data 710 of the first display window, configuration data 720 of the second display window, configuration data 730 of the third display window and configuration data of other n-3 display windows.

Taking the configuration data 710 of the first display window as an example, each configuration data includes a window positioning parameter 711 and a data quality parameter 712. The window positioning parameter 711 can be a combination of the upper left corner coordinates (X11, Y11) and the lower right corner coordinates (X12, Y12). Therefore, the size and position of the first display window in the client display interface can be adjusted by modifying the assignments of X11, Y11, X12 and Y12. For example: it can be assumed that the size of the entire layout in the client display interface is 1920×1080, and the window positioning parameters are adjusted based on this total width and height. The data quality parameter 712 can be resolution and fps. The smoothness of the data picture displayed in the first display window can be adjusted by modifying the assignment of resolution, and the clarity of the image in the first display window can be adjusted by modifying the assignment of fps.

In the relevant conference room client, the layout style displayed can be a layout style diagram of the conference client in the related technology as shown in Figure 8A. As shown in Figure 8A, after entering the conference room, the participants can render the display windows of the participants from top to bottom and from left to right in the display interface. The layout method of this display window is relatively fixed, and the position of the display window cannot be flexibly adjusted, and the user's customized layout style requirements cannot be met. Figure 8B shows a layout style diagram of the conference client of an exemplary embodiment of the present disclosure. As shown in Figure 8B, the exemplary embodiment of the present disclosure can layout the display windows of the participants according to the configuration methods of the above three layout configuration information, and can flexibly adjust the position of the display window to meet the user's customized layout style requirements.

In the relevant video client, the layout style displayed may be as shown in FIG9A , which is a schematic diagram of the layout style of the video client in the relevant technology, and FIG9B , which is a schematic diagram of the layout style of the video client in the relevant technology. As shown in FIG9A , on the video website, after the user enters a keyword, multiple corresponding videos pop up on the web page interface. The display windows of the multiple videos may be arranged in the order of m rows and 1 column as shown in FIG9A , or in the order of m rows and 3 columns as shown in FIG9B , where m is an integer greater than or equal to 1.

However, the layout styles shown in FIG9A and FIG9B are relatively simple and cannot meet some scenarios that require customization. For example, if the layout style of a video website needs to be customized in a local area network, the administrator with configuration authority can operate on the web page. The operation method can refer to the relevant description above, and then when users in the local area network log in to the video client, they can use the customized layout. Check out the related video for bureau style.

FIG9C shows a schematic diagram of the layout style of the video client of the exemplary embodiment of the present disclosure. According to any of the configuration modes of the above three layout configuration information, the display windows of multiple videos can be laid out according to the layout styles of FIG9A and FIG9B, or can be laid out in the diagonal direction as shown in FIG9C, or can even be laid out in other user-defined orders, so that the display window positions of multiple videos can be flexibly adjusted to meet the user's customized layout style requirements. In addition, these layout styles can be switched at will by the user clicking the layout style switching button. The layout style switching button is not shown in the figure, and the user can select it in the display interface.

One or more technical solutions provided in the exemplary embodiments of the present disclosure can first obtain the layout configuration information of the client, and the layout configuration information includes the configuration data of multiple display windows, and the configuration data includes window positioning parameters and data quality parameters. Based on this, multiple display windows can be rendered on the display interface of the client based on the window positioning parameters, and then the data can be displayed in the corresponding display windows based on the data quality parameters, and the data displayed in different display windows comes from different sources. It can be seen that the method of the exemplary embodiments of the present disclosure can configure the configuration data for the multiple display windows contained in the client display interface respectively, and the configuration data includes window positioning parameters and data quality parameters. The position of the corresponding display window in the display interface is controlled by the window positioning parameters, and the data quality of the corresponding display window is controlled by the data quality parameters. Therefore, there is no need to consider the client version, and the client layout can be flexibly adjusted to meet the user's customized needs for the client layout, and solve the technical problem that the client layout depends on the layout template number in the prior art.

The above mainly introduces the solution provided by the embodiment of the present disclosure from the perspective of the interaction between the terminal and the server. It is understandable that, in order to realize the above functions, the terminal and the server include hardware structures and/or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present disclosure.

The embodiment of the present disclosure can divide the terminal and the server into functional units according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or It can be implemented in the form of software function modules. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical function division. There may be other division methods in actual implementation.

In the case of dividing each functional module according to each function, the exemplary embodiment of the present disclosure provides a data display device. FIG10 shows a schematic block diagram of a data display device of the exemplary embodiment of the present disclosure. As shown in FIG10 , the device 1000 includes:

Processing module 1001 is used to obtain layout configuration information of the client, where the layout configuration information includes configuration data of multiple display windows, where the configuration data includes window positioning parameters and data quality parameters;

A display module 1002 is used to render multiple display windows on a display interface of a client based on window positioning parameters;

The display module 1002 is further configured to display data in a corresponding display window based on the data quality parameters.

As a possible implementation manner, the processing module 1001 is further configured to determine window positioning parameters of multiple display windows in response to a layout configuration operation on the client; and configure data quality parameters for each display window.

As a possible implementation manner, the apparatus 1000 includes: a communication module 1003, configured to send layout configuration information to a server.

As a possible implementation manner, the processing module 1001 is further configured to determine an association relationship between each display window and a data source of the corresponding display window.

As a possible implementation manner, the layout configuration information is layout configuration information from a server.

As a possible implementation manner, the window positioning parameters include shape parameters and size parameters of the display window; and the data quality parameters include at least one of an image frame rate and an image resolution.

As a possible implementation manner, the client is a client that supports multimedia interaction.

As a possible implementation, the processing module 1001 is used to determine the layout configuration information of the client, where the layout configuration information includes configuration data of multiple display windows, where the configuration data includes window positioning parameters and data quality parameters;

The communication module 1003 is also used to send layout configuration information to the client, wherein the window positioning parameter is used to position the corresponding display window in the client display interface, and the data quality parameter is used to control the quality of data displayed in the corresponding display window.

As a possible implementation, the processing module 1001 is further configured to respond to the layout configuration information. Select the information to determine the layout configuration information of the client.

As a possible implementation manner, the processing module 1001 is further configured to determine window positioning parameters of multiple display windows in response to a layout configuration operation on the client; and configure data quality parameters for each display window.

As a possible implementation method, different display windows display data from different sources.

FIG11 shows a schematic block diagram of a chip of an exemplary embodiment of the present disclosure. As shown in FIG11 , the chip 1100 includes one or more (including two) processors 1101 and a communication interface 1102. The communication interface 1102 can support the server to perform the data sending and receiving steps in the above method, and the processor 1101 can support the server to perform the data processing steps in the above method.

Optionally, as shown in FIG11 , the chip 1100 further includes a memory 1103. The memory 1103 may include a read-only memory and a random access memory, and provide operation instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory (NVRAM).

In some embodiments, as shown in FIG. 11 , the processor 1101 performs corresponding operations by calling operation instructions stored in the memory (the operation instructions may be stored in the operating system). The processor 1101 controls the processing operations of any one of the terminal devices, and the processor may also be referred to as a central processing unit (CPU). The memory 1103 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1101. A portion of the memory 1103 may also include NVRAM. For example, in an application, the memory, the communication interface, and the memory are coupled together through a bus system, wherein the bus system may include a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, various buses are labeled as bus system 1104 in FIG. 11 .

The method disclosed in the above-mentioned embodiment of the present disclosure can be applied to a processor, or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above-mentioned method can be completed by an integrated logic circuit of hardware in the processor or instructions in software form. The above-mentioned processor may be a general-purpose processor, a digital signal processor (digital signal processing, DSP), an ASIC, a field-programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The various methods, steps and logic block diagrams disclosed in the embodiments of the present disclosure can be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. In combination with this The steps of the method disclosed in the disclosed embodiment can be directly embodied as being executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

The exemplary embodiment of the present disclosure also provides an electronic device, comprising: at least one processor; and a memory connected to the at least one processor in communication. The memory stores a computer program that can be executed by the at least one processor, and the computer program is used to cause the electronic device to perform the method according to the embodiment of the present disclosure when executed by the at least one processor.

The exemplary embodiments of the present disclosure also provide a non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor of a computer, is used to cause the computer to execute the method according to the embodiments of the present disclosure.

The exemplary embodiments of the present disclosure further provide a computer program product, including a computer program, wherein when the computer program is executed by a processor of a computer, the computer is used to enable the computer to perform the method according to the embodiments of the present disclosure.

With reference to Figure 12, the structural block diagram of the electronic device 1200 that can be used as the server or client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital electronic computer equipment, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples, and are not intended to limit the implementation of the present disclosure described and/or required herein.

As shown in FIG. 12 , the electronic device 1200 includes a computing unit 1201, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1202 or a computer program loaded from a storage unit 1208 into a random access memory (RAM) 1203. In the RAM 1203, various programs and data required for the operation of the device 1200 can also be stored. The computing unit 1201, the ROM 1202, and the RAM 1203 are connected to each other via a bus 1204. An input/output (I/O) interface 1205 is also connected to the bus 10204.

A plurality of components in the electronic device 1200 are connected to the I/O interface 1205, including: an input unit 1206, an output unit 1207, a storage unit 1208, and a communication unit 1209. The input unit 1206 may be any type of device capable of inputting information to the electronic device 1200, and the input unit 1206 may receive input digital or character information, and generate key signal inputs related to user settings and/or function control of the electronic device. The output unit 1207 may be any type of device capable of presenting information, and may include, but is not limited to, a display, a speaker, a video/audio output terminal, a vibrator, and/or a printer. The storage unit 1208 may include, but is not limited to, a disk, an optical disk. The communication unit 1209 allows the electronic device 1200 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks, and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and/or a chipset, such as a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and/or the like.

As shown in FIG. 12 , the computing unit 1201 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the computing unit 1201 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1201 performs the various methods and processes described above. For example, in some embodiments, the method of the exemplary embodiments of the present disclosure may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1208. In some embodiments, part or all of the computer program may be loaded and/or installed on the electronic device 1200 via the ROM 1202 and/or the communication unit 1209. In some embodiments, the computing unit 1201 may be configured to execute the method in any other appropriate manner (e.g., by means of firmware).

The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, implements the functions/operations specified in the flow chart and/or block diagram. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store information for use by or in connection with an instruction execution system, apparatus, or device. The program used. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

As used in this disclosure, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and/or data to a programmable processor.

To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. -server relationship computer programming to create the client-server relationship.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the process or function described in the embodiment of the present disclosure is executed in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a terminal, a user device or other programmable device. The computer program or instruction may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program or instruction may be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server, data center, etc. that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a tape; it may also be an optical medium, such as a digital video disc (DVD); it may also be a semiconductor medium, such as a solid state drive (SSD).

Although the present disclosure has been described in conjunction with specific features and embodiments thereof, it is apparent that various modifications and combinations may be made thereto without departing from the spirit and scope of the present disclosure. Accordingly, this specification and the drawings are merely exemplary illustrations of the present disclosure as defined by the appended claims, and are deemed to have covered any and all modifications, variations, combinations or equivalents within the scope of the present disclosure. Obviously, those skilled in the art may make various modifications and variations to the present disclosure without departing from the spirit and scope of the present disclosure. Thus, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalents, the present disclosure is also intended to include these modifications and variations.

Claims (16)

1. A data display method, characterized in that the method comprises:

   Acquire layout configuration information of the client, wherein the layout configuration information includes configuration data of multiple display windows, wherein the configuration data includes window positioning parameters and data quality parameters;

   Rendering a plurality of display windows on a display interface of the client based on the window positioning parameters;

   The data is displayed in the corresponding display window based on the data quality parameter.
2. The method according to claim 1, characterized in that the obtaining of the layout configuration information of the client comprises:

   In response to a layout configuration operation for a client, determining window positioning parameters of a plurality of presentation windows;

   The data quality parameter is configured for each of the display windows.
3. The method according to claim 2, characterized in that the method further comprises:

   The layout configuration information is sent to a server.
4. The method according to claim 1, characterized in that the method further comprises:

   Determine the association relationship between each display window and the data source of the corresponding display window.
5. The method according to claim 1, characterized in that the layout configuration information is layout configuration information from a server.
6. The method according to any one of claims 1 to 5, characterized in that the window positioning parameters include shape parameters and size parameters of the display window;

   The data quality parameter includes at least one of an image frame rate and an image resolution.
7. The method according to any one of claims 1 to 5, characterized in that the client is a client supporting multimedia interaction.
8. The method according to claim 1 is characterized in that the data displayed in different display windows come from different sources.
9. A data display method, characterized in that the method comprises:

   Determining layout configuration information of the client, the layout configuration information including configuration data of a plurality of display windows, the configuration data including window positioning parameters and data quality parameters;

   Sending layout configuration information to the client, wherein the window positioning parameter is used to position the corresponding display window on the client display interface, and the data quality parameter is used to control the quality of data displayed by the corresponding display window.
10. The method according to claim 9, wherein determining the layout configuration information of the client comprises:

    In response to a selection operation on the layout configuration information, the layout configuration information of the client is determined.
11. The method according to claim 9, wherein determining the layout configuration information of the client comprises:

    In response to the layout configuration operation for the client, determining window positioning parameters of a plurality of display windows;

    The data quality parameter is configured for each of the display windows.
12. A data display device, characterized in that the device comprises:

    An acquisition module, used to acquire layout configuration information of a client, wherein the layout configuration information includes configuration data of multiple display windows, wherein the configuration data includes window positioning parameters and data quality parameters;

    A processing module, configured to render a plurality of display windows on a display interface of the client based on the window positioning parameters;

    The processing module is used to display data in the corresponding display window based on the data quality parameter, and the data displayed in different display windows have different sources.
13. A data display device, characterized in that the device comprises:

    A determination module, used to determine layout configuration information of a client, wherein the layout configuration information includes configuration data of a plurality of display windows, wherein the configuration data includes window positioning parameters and data quality parameters;

    The communication module is used to send layout configuration information to the client, wherein the window positioning parameter is used to position the corresponding display window on the client display interface, and the data quality parameter is used to control the data quality displayed by the corresponding display window.
14. An electronic device, comprising:

    processor; and,

    A memory for storing programs;

    The program includes instructions, and when the instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 11.
15. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 11.
16. A computer program product, characterized in that when the computer program product is run on a device, the device is caused to execute the method according to any one of claims 1 to 11.