CN114040254A

CN114040254A - Display device and high-concurrency message display method

Info

Publication number: CN114040254A
Application number: CN202111312731.6A
Authority: CN
Inventors: 贾富佳
Original assignee: Juhaokan Technology Co Ltd
Current assignee: Juhaokan Technology Co Ltd
Priority date: 2021-11-08
Filing date: 2021-11-08
Publication date: 2022-02-11
Anticipated expiration: 2041-11-08
Also published as: WO2023077991A1; CN117981331A; CN114040254B

Abstract

The method can acquire the number of current users in a live broadcast room after a user controls the display device to enter the live broadcast room, and then creates a message cache list for temporarily caching instant messaging messages according to the number of the current users, so that the instant messaging messages in the message cache list are displayed when the message state in the message cache list meets a specific condition. The specific condition comprises that the number of the instant communication messages in the message cache list is larger than or equal to the upper limit of the cache number, or the storage time of the instant communication messages in the message cache list is larger than or equal to the refresh delay time. The method can reduce the refreshing times of the frames of the live broadcast room in a mode of temporarily storing the instant communication messages through the message cache list when the instant communication messages are highly concurrent, thereby relieving the problem of interface blockage.

Description

Display device and high-concurrency message display method

Technical Field

The application relates to the technical field of intelligent display equipment, in particular to display equipment and a high concurrent message display method.

Background

The display device is a terminal device capable of outputting a specific display picture, and may be a terminal device such as a smart television, a communication terminal, a smart advertisement screen, and a projector. Taking an intelligent television as an example, the intelligent television is based on an Internet application technology, is provided with an open operating system and a chip, is provided with an open application platform, can realize a bidirectional man-machine interaction function, integrates multiple functions of video, entertainment, data and the like, and is a television product for meeting diversified and personalized requirements of users.

The display equipment can be accessed to a live broadcast platform through live broadcast application, and live broadcast pictures are presented for users in real time. For example, a "live classroom" application may be installed in the display device, and the display device accesses a specific live room by running the live classroom application to receive and display live lesson pictures corresponding to the live room in real time. In order to increase the interactivity of live broadcast, part of live broadcast applications support the instant messaging function, that is, for a plurality of users in the same live broadcast room, the users can communicate by sending instant messaging messages. Therefore, the display device can synchronously display the instant communication messages in the process of playing the live pictures.

However, when the number of users in the same live broadcast room is large, the display device receives a large number of instant messaging messages in a short time, and the display device needs to continuously refresh the UI interface in order to display the instant messaging messages, so that the main thread task is blocked, and the interface is jammed.

Disclosure of Invention

The application provides a display device and a high-concurrency message display method, and aims to solve the problem that the interface of the traditional display device is blocked when high-concurrency messages exist.

In one aspect, the present application provides a display device, comprising: a display, a communicator, and a controller. Wherein the display is used for displaying a user interface; the communicator is used for enabling the display equipment to establish communication connection with the server; the controller is configured to perform the steps of:

receiving a control instruction which is input by a user and used for entering a live broadcast room;

responding to the control instruction, and acquiring the current user number and instant communication messages in the live broadcast room;

creating a message cache list, wherein the message cache list is used for storing the instant communication message; setting the upper limit of the caching quantity and the refreshing delay time of the message caching list according to the current user quantity;

and when the number of the instant messaging messages in the message cache list is larger than or equal to the upper limit of the cache number, or the storage time of the instant messaging messages in the message cache list is larger than or equal to the refresh delay time, displaying the instant messaging messages in the message cache list.

On the other hand, the application also provides a high-concurrency message display method, which is applied to display equipment, wherein the display equipment comprises a display, a communicator and a controller, and the method comprises the following steps:

According to the technical scheme, the display device and the high-concurrency message display method can acquire the number of the current users in the live broadcast room after the user controls the display device to enter the live broadcast room, and then create the message cache list for temporarily caching the instant messaging messages according to the number of the current users, so that the instant messaging messages in the message cache list are displayed when the message states in the message cache list meet specific conditions. The specific condition comprises that the number of the instant communication messages in the message cache list is larger than or equal to the upper limit of the cache number, or the storage time of the instant communication messages in the message cache list is larger than or equal to the refresh delay time. The method can reduce the refreshing times of the frames of the live broadcast room in a mode of temporarily storing the instant communication messages through the message cache list when the instant communication messages are highly concurrent, thereby relieving the problem of interface blockage.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a usage scenario of a display device in an embodiment of the present application;

fig. 2 is a block diagram of a hardware configuration of a control device in the embodiment of the present application;

fig. 3 is a hardware configuration diagram of a display device in an embodiment of the present application;

FIG. 4 is a software configuration diagram of a display device in an embodiment of the present application;

FIG. 5 is a schematic view of a live application interface in an embodiment of the present application;

FIG. 6 is a diagram illustrating a display effect of a live view in an embodiment of the present application;

FIG. 7 is a diagram illustrating a display effect of a real-time communication message according to an embodiment of the present application;

FIG. 8 is a flow chart of high concurrency message display in an embodiment of the present application;

FIG. 9 is a schematic flow chart illustrating comparison of the number of users in the embodiment of the present application;

FIG. 10 is a flowchart illustrating a history message display process according to an embodiment of the present application;

FIG. 11 is a flowchart illustrating modification of a message cache list parameter according to an embodiment of the present application;

fig. 12 is a timing diagram of a high concurrency message display method in an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following examples do not represent all embodiments consistent with the present application. But merely as exemplifications of systems and methods consistent with certain aspects of the application, as recited in the claims.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, software steps executed by one step execution agent may be migrated on demand to another step execution agent in data communication therewith for execution. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an application (Applications) layer (abbreviated as "application layer"), an application Framework (application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) layer and a system library layer (abbreviated as "system runtime library layer"), and a kernel layer, from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

Based on the above-described display device 200, the user may control the display device 200 to present different user interfaces through a specific interactive action. Wherein portions of the application interface are available for presenting live views. For example, a live application "xx classroom" may be installed in the display device 200 for presenting an online lesson live screen. When the user controls the display device 200 to start the "xx classroom" application, the display device 200 may jump to an application interface corresponding to the xx classroom, i.e., a live interface, through a current user interface, such as an application list interface.

In some embodiments, the display device 200 may also make live room (or channel) selections through a particular interface before presenting the live interface. For example, after launching the "xx classroom" application, the "xx classroom" application may first provide a course selection interface. As shown in fig. 5, in the course selection interface, live link options of different possible contents such as "literature lessons, historical long river … …" and the like can be included, and each live link option can be correspondingly associated with one or more live rooms. When the user selects any live link option, the display device 200 can be controlled to access the live broadcast room, obtain a live broadcast picture corresponding to the live broadcast room, and display the live broadcast picture through the display 260 in real time.

Because the live broadcast picture corresponding to the same live broadcast room can be acquired by the plurality of display devices 200, and the plurality of display devices 200 entering the same live broadcast room can communicate with each other to send the instant communication message. Accordingly, the display apparatus 200 may also display an instant communication message in a live interface while displaying a live screen through the display 260. For example, as shown in fig. 6, the users who enter the live broadcast room corresponding to the same lesson may include a teacher, a student 1, a student 2, a student 3, a student 4, a student 5, a student 6, and the like. Each of these users may enter instant messaging messages through their own display device 200. These instant messaging messages may be based on an upper display of the live view and presented in a scrolling manner as the messages are continuously entered, as shown in fig. 7.

In order to display the instant messaging message in the live broadcast interface, in some embodiments, the display device 200 may refresh the live broadcast interface according to the received instant messaging message while displaying the live broadcast screen, and display the instant messaging message in a layer corresponding to the local message list above the live broadcast screen. For example, after the student 6 issues an instant communication message "teacher does not do so", all the display devices 200 accessing the current live room need to update the local message list according to the instant communication message issued by the student 6, so that the "teacher does not do so" issued by the student 6 is displayed at the bottom position of the message list. Similarly, for instant messaging messages sent by different users in sequence at different times, the display device 200 may perform real-time display by using the above refresh method.

In the process of presenting the instant messaging message, the picture corresponding to the local message list is usually a real-time rendering picture displayed in a layer on the live broadcast picture, and therefore, the display device 200 needs to continuously render according to the sending condition of the instant messaging message and refresh and display the rendered picture in the live broadcast interface. Therefore, when the number of people in the live broadcast room accessed by the display apparatus 200 is large and the speech is frequent, the display apparatus 200 receives instant messaging messages sent by a plurality of users in a short time, and in order to display the received messages, the display apparatus 200 needs to refresh, render and display the local message list frequently.

Based on this, when the number of instant messaging messages received by the display device 200 in a unit time is too large, the main thread is blocked, causing a problem of interface seizure. For example, the screen frame-swiping frequency of the display device 200 such as a smart terminal is usually 60FPS, i.e. 60 refreshes per second, when the number of instant messages received by the display device 200 per second exceeds 60, the main thread may be blocked, and the interface is stuck.

In order to improve the problem of interface seizure, some embodiments of the present application provide a high concurrency message display method, which can be applied to the display apparatus 200. Also, to satisfy the implementation of the method, the display device 200 should include at least a display 260, a communicator 220, and a controller 250. Wherein the display 260 is configured to display a user interface, including a live interface. The communicator 220 is configured to establish a communication connection with the server 400 so as to acquire a live view and an instant communication message from the server 400. The controller 250 is configured to execute the above-mentioned high concurrent message display method to control the display process of the live broadcast picture and the instant communication message, as shown in fig. 8, which specifically includes the following contents:

and receiving a control instruction input by a user and used for entering the live broadcast room. When the user uses the display device 200, the user may input various control instructions according to a user interaction policy defined by an operating system of the display device 200. Wherein, part of the control instructions are used for controlling the display device 200 to enter the live broadcast room and present the live broadcast picture. Therefore, when detecting that the user inputs the control instruction, the display device 200 may start displaying the live interface, and start displaying the live picture and the instant messaging message according to the manner corresponding to the high concurrent message display method.

The user may input a control command for entering the live room in various ways according to an interaction policy defined in the operating system of the display apparatus 200. That is, in some embodiments, a user may control the focus cursor in the interface of the display device 200 to move through the control device 100, such as a remote controller or an intelligent terminal, which is associated with the display device 200, and sequentially select a specific option based on different user interfaces to control the display device 200 to enter the live broadcast room. For example, the user may control the focus cursor to sequentially select "my" - "application" - "xx classroom" and control the display device 200 to launch the live class application. And selecting any live broadcast link option from the presented application interface to control the access to the live broadcast room.

In some embodiments, for the display device 200 supporting touch interaction, the user may further select "my" - "application" - "xx classroom" in sequence through the touch interaction to start a live application, and then select any live link option through the touch interaction to control entry into a live room.

In some embodiments, for display devices 200 that support intelligent voice interaction, the user may also input control instructions for entering the live room based on the intelligent voice system. For example, the user can input voice contents such as "i want to watch live lessons", "open x class", and the like through a far-field microphone of the display device 200 or a microphone built in the control apparatus 100. After receiving the voice content, the intelligent voice system converts the voice into characters, and then extracts the semantics through the natural language processing model, so that a control instruction is generated according to the semantics, the display device 200 is controlled to open the live broadcast application, and the live broadcast application enters a live broadcast room.

It should be noted that the manner of the control command is merely an example of a specific input manner, and does not limit the input process of the control command, and those skilled in the art can conceive other input manners based on the above input manner, and other input manners adopted to adapt to different interaction strategies of the display device 200 all belong to the scope of the present application.

After the user inputs a control instruction for entering the live room, the display apparatus 200 may receive a live screen in response to the control instruction. The live video is usually generated by a user who opens a live room by recording a specific video in real time. After the display device 200 of the user in the live broadcast room is started to generate the live broadcast picture, the live broadcast picture can be transmitted to the server 400 in real time, and the server 400 distributes the live broadcast picture to the display devices 200 corresponding to different users according to the access user corresponding to the live broadcast room, so that the display devices 200 can receive the live broadcast picture. After receiving the live broadcast picture, the display device 200 of the user accessing the live broadcast room can render the live broadcast picture, generate a live broadcast interface, and display the live broadcast interface through the display 260.

The display apparatus 200 may also receive an instant communication message in real time while receiving a live screen. The instant messaging message can be sent by any user accessing the current live broadcast room, the sent instant messaging message is sent to the server 400 firstly, and the server 400 pushes the instant messaging message to each user in the current live broadcast room, wherein the users initiate the live broadcast room and access the live broadcast room. Each user, upon receiving an instant message, may display the instant message according to a real-time display or a caching delay.

When the number of users in the live broadcast room is large, the number of instant messaging messages sent by the users is large, and therefore the interface is blocked easily due to the fact that the main thread is blocked by high-concurrency messages. Therefore, in the embodiment of the present application, the display device 200 may obtain the current number of users in the live broadcast room in real time while obtaining the live broadcast picture and the instant messaging message, so as to determine whether the display mode of the instant messaging message needs to be adjusted according to the current number of users.

That is, as shown in fig. 9, in some embodiments, after obtaining the current number of users, the display device 200 may compare the current number of users with the user number threshold. According to the comparison result, if the number of the current users is less than or equal to the user number threshold, that is, the number of the users in the current live broadcast room is small, the problem of high concurrent messages is not easy to occur, so that the display device 200 does not need to adjust the display mode of the instant messaging messages, and directly controls the display 260 to display the instant messaging messages in real time. And according to the comparison result, if the number of the current users is larger than the user number threshold value, namely the number of the users in the current live broadcast room is large, the problem of high concurrency of instant messaging messages is easy to occur, so that the display mode of the instant messaging messages can be adjusted, the influence of the refreshing process of the instant messaging messages on the main thread is reduced through the mode of delaying the display of the instant messaging messages, and the pause phenomenon is improved.

The current number of users may also be used to control the delayed display process, and when the display device 200 displays the instant messaging messages in the delayed display mode, the display device 200 may first create a message cache list for storing the instant messaging messages, that is, the instant messaging messages received from the server 400 may not be displayed in real time but may be temporarily stored in the message cache list. And when the instant messaging messages stored in the message cache list reach the preset display condition, refreshing the interface to display the stored instant messaging messages.

Since the number of users in a live room usually has a positive correlation with the number of concurrency of instant messaging messages. I.e., the greater the number of users, the more instant messaging messages. Different message concurrency numbers directly influence the blocking degree of the instant messaging message to the main thread and the display timeliness, so that in order to take account of the fluency and the display timeliness, the upper limit of the buffer number and the refresh delay time of the message buffer list can be set according to the number of current users.

To set the upper limit of the buffer number and the refresh delay time of the message buffer list, in some embodiments, the display device 200 may obtain the refresh frequency of the display 260 after obtaining the current user number. It is apparent that the display 260 screen refresh frequency is different for different display devices 200. For example, the refresh rate of the normal display 260 is 60Hz, and the refresh rate of the professional display 260 is 120Hz, etc. Moreover, for the same display device 200, different refresh frequencies can be adopted in different display modes, for example, the screen refresh frequency of the smart television is 60Hz when the display media asset picture is displayed, and the screen refresh frequency is 120Hz when the game device is accessed to display the game picture. Accordingly, the display device 200 may determine the refresh frequency by integrating the type and operation mode of the display device 200 when acquiring the refresh frequency of the display 260.

After obtaining the refresh rate of the display 260, the display device 200 may calculate a ratio of the current number of users to the refresh rate of the display 260. And then calculating the upper limit of the buffer amount according to the ratio of the current user amount to the refresh frequency of the display 260, wherein the upper limit of the buffer amount is the minimum integer which is greater than or equal to the ratio of the current user amount to the refresh frequency of the display 260, namely:

maxChacheCount＝ceil(memberCount/fps)；

wherein, maxCHacheCount represents the upper limit of the cache number; ceil (… …) represents the return of the smallest integer computation function that is greater than or equal to the specified expression; the memberCount represents the number of current users; fps represents the refresh rate of display 260.

After obtaining the upper limit of the number of buffers by the above formula, the display device 200 calculates the minimum refresh interval according to the refresh frequency, where the minimum refresh interval is a time interval between adjacent frames of display pictures and can be obtained by calculating the inverse of the refresh frequency. For example, when the refresh frequency of the display 260 is 60Hz, the minimum refresh interval is 1/60 ═ 0.016 s.

Finally, the display device 200 may calculate the refresh delay time according to the upper limit of the buffer number and the minimum refresh interval, that is, by calculating the product of the upper limit of the buffer number and the minimum refresh interval, as the refresh delay time delayTime. For example, after calculating the obtained upper limit of the buffer count and the minimum refresh interval of 0.016s, the display device 200 may calculate maxChacheCount × 0.016 as the refresh delay time delayTime.

After creating the message cache list and setting the upper limit of the cache number and the refresh delay time of the message cache list according to the number of current users, the display device 200 may store the acquired instant messaging message in the message cache list, and perform delay display on the instant messaging message based on the created message cache list. In implementing the delayed display, the display apparatus 200 may detect the instant communication messages stored in the message cache list, and determine the cache number and storage time of the instant communication messages in the message cache list.

And then determining whether the display condition of the instant messaging message is met by comparing the cache number with the upper limit of the cache number, and the storage time with the refresh delay time, and determining that the display condition of the instant messaging message is met when the number of the instant messaging messages in the message cache list is greater than or equal to the upper limit of the cache number, or the storage time of the instant messaging messages in the message cache list is greater than or equal to the refresh delay time, so that the display 260 can be controlled to display the instant messaging messages in the message cache list.

According to the technical scheme, the high-concurrency message display method provided by the embodiment can enable the message delay display function by creating the message cache list when the number of users in the live broadcast room is large, so that the refreshing frequency of the instant communication message display process is reduced, and the problem of interface blockage is solved. In addition, since the upper limit of the cache number and the refresh delay time in the message cache list can be set according to the number of the current users, different judgment conditions can be adopted when the number of the users is different, so that the display timeliness and the interface fluency of the communication message can be considered, and the user experience is improved.

Because the live frames corresponding to the live rooms can be simultaneously pushed to the display devices 200 of different users, and different display devices 200 can enter the live rooms at different times, in order to timely know the chat states in the live rooms, as shown in fig. 10, in some embodiments, for a display device 200 which later enters the live room, a history message can also be obtained when the display device enters the live room. In this regard, the display device 200 may create a local message list for displaying instant messaging messages in real time upon entering a live broadcast room. For ease of display, the instant messaging messages may be arranged in the local message list in the same order as the message bars in the live interface, e.g., all new messages are below the old messages. Therefore, when the instant communication message is displayed, the display picture can be directly rendered according to the local message list.

After the local message list is created, the display apparatus 200 may extract a reception time of the control instruction, that is, after the display apparatus 200 receives the control instruction input by the user, an input time of the control instruction may be recorded as the reception time. And then requests the history message from the server 400 according to the receiving time, that is, after extracting the receiving time, the display device 200 may generate a request instruction, which may include the receiving time. The generated request instruction is sent to the server 400, so that the server 400 can feed back the history message according to the request instruction.

The history message is an instant messaging message in a preset synchronization period before the receiving time. The history messages fed back by the server 400 are not too much so as to reduce the synchronization time; and the history information fed back by the server 400 is not too little, so that the user can know the communication condition in the live broadcast room, and the user requirement is met. Therefore, the preset synchronization period may be determined comprehensively according to the storage capacity of the server 400, the user communication frequency in the current live broadcast room, and other factors. For example, the preset synchronization period may be an integer multiple of the refresh delay time.

After acquiring the history message, the display device 200 adds the history message to the local message list to display the history message together with the live broadcast picture, so as to form a live broadcast interface. For example, when the user 1 enters any live broadcast room of the live broadcast classroom through the display device 200, the display device 200 may send an HTTP request to the instant messaging module of the server 400, obtain a history message (historyMessages) of the live broadcast room, add the historyMessages to a local message list (msgl), and then load and display the message in the msgl through a UI refresh method.

In some embodiments, when the display apparatus 200 establishes the local message list, the instant messaging messages in the cache list may also be displayed by adding the instant messaging messages in the message cache list to the local message list to refresh the user interface based on the local message list.

It can be known from the foregoing technical solutions that, in the above embodiment, the display device 200 may display the history message and the instant messaging message in real time based on the local message list, and since the display device 200 may add the message to the local message list according to the time sequence, the message displayed in the live broadcast interface can still maintain the original speaking sequence of the instant message, thereby alleviating the problem of display error.

In the above embodiment, the message displayed with delay may be temporarily stored in the message buffer list, and displayed when the storage amount is greater than the upper limit of the buffer amount or the storage time reaches the refresh delay time. The upper limit of the buffer amount and the refresh delay time are set according to the number of users in the current live broadcast room, but the number of users in the live broadcast room continuously changes along with live broadcast, that is, in the live broadcast process, users enter or exit the live broadcast room at random, so as shown in fig. 11, in some embodiments, the display device 200 may modify the upper limit of the buffer amount and the refresh delay time according to the change of the number of users in the live broadcast room, so that the display process of the live broadcast picture can take account of both smoothness and timeliness.

That is, the display device 200 may obtain user update information of the live broadcast room, where the user update information may include information contents such as a name of a user who enters or exits the live broadcast room, and an entry or exit time, and is used to indicate information of the user who enters or exits the current live broadcast room. The same as the instant messaging message and the live broadcast picture, the user update information may also be obtained by the server 400, that is, when any user enters or leaves the live broadcast room, the server 400 may be triggered to generate the user update information, and the generated update information may also be sent to all users in the live broadcast room in a data push manner.

After obtaining the user update information from the server 400, the display device 200 may modify the current number of users according to the number update information, and set the upper limit of the cache number and the refresh delay time according to the modified current number of users. For example, when the user 1 enters the live broadcast room, the server 400 may push the user update information to other display apparatuses 200 in the live broadcast room except for the display apparatus 200 of the user 1, and these display apparatuses 200 may determine the current number of users again according to the number of users and the user update information received previously, that is, the current number of users is equal to the original number of users + 1. After modifying the current number of users, the display device 200 recalculates the upper limit of the buffer number and the refresh delay time according to the method provided in the above embodiment, that is:

maxChacheCount＝ceil((memberCount+1)/fps)；

delayTime＝maxChacheCount×0.016；

wherein, maxCHacheCount represents the upper limit of the cache number; ceil (… …) represents the return of the smallest integer computation function that is greater than or equal to the specified expression; (memberCount +1) represents the current number of users; fps represents the refresh rate of display 260; delayTime denotes a refresh delay time.

Therefore, through the above calculation method, the display device 200 may reset the upper limit of the buffer amount and the refresh delay time according to the modified current number of users, so that the delay display process of the display device 200 can automatically adapt to the number of users in the live broadcast room, and display smoothness and timeliness are both considered.

Since the behavior of the user entering or exiting the live broadcast is generally the personal behavior of the user, the number of users in the live broadcast room generally changes slowly, and when the number of users changes less, the fluency or timeliness of the display is not significantly affected, so in order to reduce the parameters of frequently updating the message cache list, in some embodiments, the display device 200 may further traverse the user change number in the user update information when setting the cache number upper limit and the refresh delay time according to the modified current number of users, and compare the user change number obtained by the traversal with the preset update threshold.

And if the user variation number is larger than or equal to the updating threshold, setting a cache number upper limit and refreshing delay time according to the modified current user number, and executing a delay display function according to the reset cache number upper limit and refreshing delay time so as to take the fluency and the timeliness into consideration. If the user variation number is smaller than the update threshold, the upper limit of the buffer number and the refresh delay time are maintained, that is, the message buffer list is not modified, so as to avoid frequent operation and excessive consumption of the processing capacity of the display device 200.

For the live interface, the display device 200 may display a live screen and an instant messaging message, and simultaneously display an entry state or an exit state of a user in a live room. For example, when user 1 enters the live room, the live interface may display prompt text such as "user 1 has entered the live room". The prompt information is generally displayed in real time along with the operation of entering or exiting the live broadcast room by the user, and when the number of people in the live broadcast room is large, the display device 200 also needs to refresh the UI interface frequently, which may cause a stuck problem. To this end, in some embodiments, the display device 200 may also enable a delayed display function when the prompt information is displayed, i.e., adding user information that adds the user update information to the current live room to the message cache list.

The message display method provided by the embodiment can reduce the influence of the high concurrent message refreshing process on the main thread by delaying the display of the instant messaging messages when the number of users in the live broadcast room is large, wherein the delayed display process can be triggered by two conditions, and different display control methods can be adopted in the display process under different triggering conditions. That is, in some embodiments, when the number of instant messaging messages in the message cache list is greater than or equal to the upper limit of the cache number, the display device 200 may detect an on state of a local delayed refresh task, where the local delayed refresh task is a task that controls delayed display and may be displayed according to a set delay time after being started. For example, when the delay 1s is set to display the message, the display apparatus 200 may display the contents in the message cache list every 1 s.

And when the instant messaging message number in the message cache list is judged to be greater than or equal to the upper limit of the cache number, the display device 200 is not controlled to finish the delayed display through the local delayed refresh task any more, namely if the starting state of the local delayed refresh task is started, the delayed timing of the local delayed refresh task can be stopped to display the instant messaging message in the message cache list in real time, and the delayed timing of the local delayed refresh task is started after the instant messaging message in the message cache list is displayed.

For example, when the number msgcachelist.count ≧ maxchacechcount in the message cache list is judged, the message of msgCacheList is added to the local message list msglst, at this time, if the local deferred refresh task is already started, the task is cancelled and the live interface is refreshed, and all messages in msgCacheList at this time are displayed.

Similarly, in some embodiments, when it is determined that the number of the instant messaging messages in the message cache list is smaller than the upper limit of the cache number, the display device 200 may also detect an open state of the local deferred refresh task, and if the open state of the local deferred refresh task is not open, open the local deferred refresh task to control the deferred display process according to the local deferred refresh task.

For example, when the number of users in the message cache list is judged to be msgcachelist.count < maxchacheccount, if the local delayed refresh task is not started, the delayed refresh task is started, and the delay time is set to delayTime, so that after the delay time is reached, the live broadcast interface refresh operation is executed, and all messages are displayed.

According to the technical scheme, the high-concurrency message display method provided by the embodiment can reduce the message refreshing frequency in a mode of delaying refreshing the live interface, so that the messages received by the display device 200 are firstly cached, and the message interface is refreshed after delaying for a certain time, thereby improving the fluency of the display process. Meanwhile, in order to avoid untimely display caused by more messages in the delay time, the message interface is refreshed in time after a certain number of buffers are limited so as to display all messages. In addition, the display device 200 can also dynamically adjust the delay refresh time and the maximum cache limit according to the number of users in the live broadcast room, flexibly adjust the refresh frequency, and improve the timeliness of message display to the maximum extent while alleviating the problem of interface refresh jamming caused by message concurrence.

Based on the high concurrency message display method provided by the foregoing embodiment, in some embodiments of the present application, a display device 200 is further provided, where the display device 200 includes: a display 260, a communicator 220, and a controller 250. Wherein the display 260 is used for displaying a user interface; the communicator 220 is configured to enable the display device 200 to establish a communication connection with the server 400; as shown in fig. 12, the controller 250 is configured to perform the following steps:

As can be seen from the foregoing technical solutions, the display device 200 provided in the foregoing embodiment may obtain the current number of users in the live broadcast room after the user controls the display device 200 to enter the live broadcast room, and then create a message cache list for temporarily caching the instant messaging message according to the current number of users, so that the instant messaging message in the message cache list is displayed when the message status in the message cache list meets a specific condition. The specific condition comprises that the number of the instant communication messages in the message cache list is larger than or equal to the upper limit of the cache number, or the storage time of the instant communication messages in the message cache list is larger than or equal to the refresh delay time. The display device 200 can reduce the refreshing times of the live broadcast room picture in a mode of temporarily storing the instant messaging messages through the message cache list when the instant messaging messages are highly concurrent, thereby relieving the problem of interface jamming.

The embodiments provided in the present application are only a few examples of the general concept of the present application, and do not limit the scope of the present application. Any other embodiments extended according to the scheme of the present application without inventive efforts will be within the scope of protection of the present application for a person skilled in the art.

Claims

1. A display device, comprising:

a display configured to display a user interface;

a communicator configured to establish a communication connection with a server;

a controller configured to:

2. The display device of claim 1, wherein the controller is further configured to:

creating a local message list, wherein the local message list is used for displaying instant communication messages in real time;

extracting the receiving time of the control instruction;

requesting a history message from the server according to the receiving time, wherein the history message is an instant messaging message in a preset synchronization period before the receiving time;

adding the history message to the local message list.

3. The display device of claim 2, wherein the controller is further configured to:

in the step of displaying the instant messaging messages in the message cache list, adding the instant messaging messages in the message cache list to the local message list;

refreshing the user interface based on the local message list.

4. The display device of claim 1, wherein the controller is further configured to:

acquiring user updating information of a live broadcast room, wherein the user updating information is used for representing user information of joining or quitting the current live broadcast room;

modifying the number of the current users according to the number updating information;

and setting the upper limit of the cache quantity and the refreshing delay time according to the modified current user quantity.

5. The display device of claim 4, wherein the controller is further configured to:

in the step of setting the upper limit of the cache number and the refresh delay time according to the modified current user number, traversing the user change number in the user update information;

if the user variation number is larger than or equal to an updating threshold value, setting the upper limit of the cache number and the refreshing delay time according to the modified current user number;

adding the user information added into the current live broadcast room in the user updating information to the message cache list;

and if the user variation number is smaller than the updating threshold value, maintaining the upper limit of the cache number and the refreshing delay time.

6. The display device according to claim 1, wherein when the number of instant messaging messages in the message cache list is greater than or equal to the cache number upper limit, the controller is further configured to:

detecting the opening state of a local delayed refreshing task;

if the starting state of the local delayed refreshing task is started, stopping the delayed timing of the local delayed refreshing task so as to display the instant communication message in the message cache list in real time;

and after the instant communication messages in the message cache list are displayed, starting the delay timing of the local delay refreshing task.

7. The display device of claim 1, wherein when the number of instant messaging messages in the message cache list is less than the cache number upper limit, the controller is further configured to:

detecting the opening state of a local delayed refreshing task;

and if the starting state of the local delayed refreshing task is not started, starting the local delayed refreshing task.

8. The display device of claim 1, wherein the controller is further configured to:

before the step of creating the message cache list, comparing the current user number with a user number threshold;

if the current user number is smaller than or equal to the user number threshold value, displaying the instant communication message in real time;

and if the current user number is larger than the user number threshold value, creating a message cache list.

9. The display device of claim 1, wherein the controller is further configured to:

in the step of creating a message cache list, obtaining the refresh frequency of the display;

calculating the ratio of the current user number to the display refresh frequency;

calculating the upper limit of the cache quantity according to the ratio, wherein the upper limit of the cache quantity is the minimum integer which is greater than or equal to the ratio;

calculating a minimum refresh interval according to the refresh frequency;

and calculating the product of the upper limit of the cache number and the minimum refresh interval as the refresh delay time.

10. A high concurrency message display method is applied to a display device, wherein the display device comprises a display, a communicator and a controller, and the method comprises the following steps: