WO2021218555A1

WO2021218555A1 - Information display method and apparatus, and electronic device

Info

Publication number: WO2021218555A1
Application number: PCT/CN2021/084554
Authority: WO
Inventors: 程斌; 盛碧星; 王琛
Original assignee: 北京字节跳动网络技术有限公司
Priority date: 2020-04-30
Filing date: 2021-03-31
Publication date: 2021-11-04
Also published as: CN112312223A

Abstract

Disclosed are an information display method and apparatus, and an electronic device. One particular embodiment of the method comprises: receiving a multimedia information stream, wherein the information stream comprises a multimedia data stream, and chat information sent by a user according to information content corresponding to the multimedia; and displaying the chat information on a display interface which displays the multimedia data stream. A user does not need to distract attention from a display area of a multimedia data stream to a display area of chat information, such that the user, when participating in a conference, can view displayed content of the multimedia data stream and the chat information at the same time.

Description

Information display method, device and electronic equipment

Cross-references to related applications

This application claims the priority of the Chinese patent application filed on April 30, 2020 with the application number 202010366773.7 and the invention title "Information Display Method, Apparatus and Electronic Equipment". The full text of this application is incorporated into this application by reference. .

Technical field

The embodiments of the present disclosure relate to the field of Internet technology, and specifically relate to information display methods, devices, and electronic equipment.

Background technique

The network multimedia conference can realize the real-time transmission of moving images, voice and application data (electronic whiteboards, graphics) and other forms of information between two points and multiple points. Suitable for remote meetings, network discussions, etc. People located in two or more locations can interact through network multimedia conferences.

In a network multimedia conference, information exchange is mainly conducted through voice and video, that is, when a user participates in a multimedia conference, he can listen to the audio information of the multimedia conference and/or browse the video information of the multimedia conference through a terminal device.

Summary of the invention

The present disclosure part is used to introduce concepts in a brief form, and these concepts will be described in detail in the following specific embodiments. The present disclosure part is not intended to identify the key features or essential features of the claimed technical solution, nor is it intended to be used to limit the scope of the claimed technical solution.

Some embodiments of the present disclosure propose information display methods, devices, and electronic equipment.

In the first aspect, some embodiments of the present disclosure provide an information display method, including: receiving a multimedia information stream, the information stream including a multimedia data stream and chat information sent by a user according to the multimedia data stream; The chat information is displayed on the display interface of the multimedia data stream.

In a second aspect, some embodiments of the present disclosure provide an information display device, including: a receiving unit, configured to receive a multimedia information stream, the information stream includes a multimedia data stream, and a participant sends the information according to the multimedia data stream. The chat information; the display unit is used to display the chat information on the display interface that displays the multimedia conference.

In the third aspect, some embodiments of the present disclosure provide an electronic device, including: one or more processors; a storage device, on which one or more programs are stored, when one or more programs are The processor executes, so that one or more processors implement the method of the first aspect.

In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium on which a computer program is stored, where the program is executed by a processor to implement the method of the first aspect.

The information display method, device, and electronic equipment provided by some embodiments of the present disclosure receive a multimedia information stream, the information stream including a multimedia data stream and chat information sent by a user according to the multimedia data stream; when displaying the multimedia data The chat information is displayed on the display interface of the stream. Compared with the existing way of browsing multimedia information, you need to open an instant messaging application to exchange information with other users. The method provided in this application allows users to browse the chats between users on the display interface for displaying multimedia data. The information simplifies the operation of the user to communicate with other users in the process of browsing multimedia information, and improves the user experience.

In addition, in the prior art, the user's instant interaction information can be displayed on one side of the multimedia data stream display window. In these methods, when the user browses the instant interactive information, he shifts his attention from the display area of the display content of the multimedia data stream to the display area of the instant interactive information, and may miss the display content of the multimedia data stream. In this solution, since the chat information is displayed on the display interface for displaying the multimedia data stream, the user can watch the user's chat information when browsing the display content of the multimedia data stream. The user does not need to shift his attention from the display area of the multimedia data stream to the display area of the chat information, so that the participating users can take into account both the display content of the multimedia data stream and the chat information at the same time.

Description of the drawings

The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent in conjunction with the accompanying drawings and with reference to the following specific implementations. Throughout the drawings, the same or similar reference signs indicate the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

Fig. 1 is a flowchart of some embodiments of an information display method according to the present disclosure;

Fig. 2 is a schematic diagram of an application scenario of the information display method according to the present disclosure;

Fig. 3 is a schematic structural diagram of some embodiments of an information display device according to the present disclosure;

FIG. 4 is an exemplary system architecture in which the information display method of an embodiment of the present disclosure can be applied;

Fig. 5 is a schematic structural diagram of an electronic device suitable for implementing some embodiments of the present disclosure.

Detailed ways

Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided for Have a more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are only used for exemplary purposes, and are not used to limit the protection scope of the present disclosure.

It should be understood that the various steps recorded in the method embodiments of the present disclosure may be executed in a different order, and/or executed in parallel. In addition, method implementations may include additional steps and/or omit to perform the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and its variants as used herein are open-ended includes, that is, "including but not limited to". The term "based on" is "based at least in part." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Related definitions of other terms will be given in the following description.

It should be noted that the concepts of "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modifications of "a" and "a plurality of" mentioned in the present disclosure are illustrative and not restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, they should be understood as "one or Multiple".

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes, and are not used to limit the scope of these messages or information.

Please refer to FIG. 1, which shows the flow of some embodiments of the information display method according to the present disclosure. The information display method includes the following steps:

Step 101: Receive a multimedia information stream. The information stream includes a multimedia data stream and chat information sent by a user according to information content corresponding to the multimedia.

The multimedia data stream here may be a multimedia data stream of a multimedia conference, a live data stream of a multimedia conference, or a multimedia data stream including a recorded multimedia body.

The chat information here may be a user who browses the multimedia data stream, and is sent according to the information content of the multimedia to interact with other users who browse the information content of the multimedia. The aforementioned chat information may include, but is not limited to, text, pictures, emoticons, and a combination of text, pictures, and emoticons.

A user browsing a multimedia data stream can use the terminal device he uses to input the above-mentioned chat information in the process of browsing the information content corresponding to the multimedia. The terminal device may send the above-mentioned chat information to the server, and the server will forward the above-mentioned chat information.

The server can provide the above-mentioned multimedia data stream to the user. The server can separately package and transmit the above-mentioned multimedia data stream and the above-mentioned chat information. The user's terminal device can receive the multimedia data stream that is packaged and transmitted separately and the chat information sent by at least one user according to the above multimedia data stream.

In some application scenarios, the foregoing multimedia data stream may be a multimedia data stream of a multimedia conference. Participating users can participate in multimedia conferences through terminal devices. The terminal devices here may include, but are not limited to, smart phones, tablet computers, laptop portable computers, desktop computers, and so on.

The multimedia conference here can be an audio conference or a video conference.

Generally, in a multimedia conference, the terminal device of the participant user can collect the multimedia data stream of the participant user, and interactively transmit the multimedia data stream of the participant user through the network among the participants.

In these application scenarios, in addition to collecting the multimedia data stream of the participant, the terminal device of the participant can also receive the chat information related to the multimedia conference input by the participant. The terminal device can interactively transmit the multimedia data stream and chat information of the participants through the network.

For participants in a multimedia conference, the terminal device of the participant can send the collected multimedia data stream and chat information of the participant to the server. The server can interactively forward the multimedia data stream of each participant among multiple participants, and forward the chat information sent by each participant among multiple participants. For a conference user, the server may separately package and transmit the multimedia data stream sent to the conference user and the chat information sent to the conference user to the terminal device of the conference user.

Step 102: Display the chat information on the display interface for displaying the multimedia data stream.

In this embodiment, after receiving the multimedia data stream and the information stream of the chat information sent by the user according to the multimedia data stream in step 101, a display interface for displaying the multimedia data stream may be displayed on the user's terminal device. The multimedia data stream is displayed in the above-mentioned display interface. And display the user's chat information on the above-mentioned display interface.

In some application scenarios, the above-mentioned chat information may cover part of the display interface used to display the multimedia data stream.

The aforementioned chat information may include text, pictures, emoticons, and a combination of text, pictures and emoticons, and so on.

In this embodiment, the information stream in step 101 includes separately packaged multimedia data streams and chat information sent by the user according to the multimedia data streams. Each frame of data in the multimedia data stream and each piece of chat information in the chat information stream can respectively correspond to the display time. In this way, displaying the chat information on the display interface for displaying the multimedia data stream in step 102 may include: synchronously displaying the multimedia data stream and the chat information according to the respective display time information corresponding to the multimedia data stream and the chat information.

That is, when the multimedia data stream and chat information are displayed on the user's terminal device, the display time corresponding to each frame of multimedia data and the display time corresponding to each piece of chat information are displayed synchronously. Taking a multimedia conference as an example, the display time corresponding to a frame of multimedia data in the multimedia conference is 20 minutes and 30 seconds after the start of the multimedia conference. The chat message of the participant received in minutes and 30 seconds. It can be understood that the area where the chat information is displayed can also display the chat information of the participant users received 20 minutes and 30 seconds before the start of the multimedia conference.

In the information display method provided in this embodiment, by receiving a multimedia information stream, the information stream includes a multimedia data stream and chat information sent by a user according to the information content corresponding to the multimedia; the chat information is displayed on a display interface that displays the multimedia data stream. Compared with the existing way of browsing multimedia information, you need to open an instant messaging application to exchange information with other users. The method provided in this application allows users to browse the chats between users on the display interface for displaying multimedia data. The information simplifies the operation of the user to communicate with other users in the process of browsing multimedia information, and improves the user experience.

In some optional implementation manners of this embodiment, the foregoing step 102 may include displaying the foregoing chat information in a preset chat information display area on the display interface, and the size of the chat information display area is smaller than the size of the foregoing interface.

In some application scenarios, the above-mentioned chat information may be displayed in an area where the amount of multimedia data in the display interface for displaying the multimedia data stream is less. For example, the area in the above-mentioned display interface that does not include the image of the user participating in the conference.

In some application scenarios, the above-mentioned chat information may be displayed in an area near the edge of the display interface in the display interface.

In these alternative implementations, the chat message area is small, which can affect the display effect of the multimedia data stream content as little as possible.

In some optional implementations of this embodiment, the chat information display area for displaying the user's chat information may be located on a different layer from the display interface for displaying the multimedia data stream.

The user here may be a user who browses the multimedia information content corresponding to the multimedia data stream.

In some application scenarios, the user here may be a participant of a multimedia conference, or a user who watches the live data stream of the multimedia conference.

The layer displaying the user's chat information may be located above the layer where the display interface displaying the multimedia data stream is located.

The background layer of the chat information display area may have a preset transparency. The preset transparency here can be, for example, 80-100%.

Set the background layer of the chat information display area to have a preset transparency, so that when browsing each chat message in the chat information display area, you can also use the background layer with preset transparency in the chat message display area. To browse the display content corresponding to the multimedia data stream.

Further optionally, displaying the above-mentioned chat information on the display interface displaying the above-mentioned multimedia data stream in the above-mentioned step 102 includes the following sub-steps:

First, within the first preset time period when new chat information is received, the chat information is displayed with the first opacity on the above-mentioned display interface; and

Secondly, in response to no other new chat information being received after the first preset time period, the chat information is displayed with a second opacity on the display interface; wherein the first opacity is greater than the second opacity.

The first opacity here is the opacity that can clearly display the chat information in the display interface. As a schematic illustration, the first opacity here may be, for example, 80%-100%.

The second opacity here is the opacity of the display content of the multimedia data stream that can be browsed through the chat information. As a schematic illustration, the second opacity here may be, for example, 40%-10%.

The first preset time period here can be 3 minutes, 5 minutes, etc. The length of the specific first preset time period can be set according to specific application scenarios, and is not limited here.

That is, when new chat information is received and within the first preset time period when the new chat information is received, the chat information is displayed relatively clearly on the display interface for displaying the multimedia data stream. The chat information here may include newly received chat information. When no other new chat information is received after the first preset period of time after the new chat information is received, the chat information is gradually made transparent. That is, when the participant is not active in the chat information, the chat information can be automatically made transparent, so that the display content of the multimedia data stream can be displayed more completely.

In some optional implementation manners, displaying the chat information on the display interface for displaying the multimedia data stream in step 102 includes: in response to receiving a first information browsing instruction for instructing browsing chat information, adjusting the The size of the display interface for chat messages.

The above-mentioned first information browsing instruction may include an operation performed by the user. The above-mentioned first information browsing instruction for instructing to browse chat information is generated based on one of the following operations performed by the user on the chat information display area: cursor hovering operation, clicking operation, touch operation, and sliding operation.

In these alternative implementations, when the first information browsing instruction is received, the size of the chat information display interface can be increased to increase the amount of chat information displayed on the display interface. This facilitates the user to browse multiple chat messages.

In some other optional implementation manners, displaying the chat information on the display interface for displaying the multimedia data stream in step 102 includes: adjusting the chat information in response to receiving a first information browsing instruction for instructing to browse chat information. The display style of chat messages.

The display style of the chat information includes: opacity, display size of the chat information, display font; the contrast between the chat information and the background, etc.

In some application scenarios, the above adjusting the display style of the chat information includes: adjusting the display style of multiple pieces of chat information displayed in the display interface of the chat information.

The foregoing adjustment of the display style of the chat information includes at least one of the following:

Increase the opacity of the chat information; increase the display size of the chat content.

The multiple chat messages here may be multiple chat messages displayed in the display interface of the chat information when the first information browsing instruction is received.

As a schematic illustration, when it is received that the user performs a touch control operation on the display interface of the chat information, it can be regarded as receiving the first information browsing instruction. The display size of multiple chat messages displayed on the display interface can be increased according to the information browsing instructions, such as increasing the font size of the text, increasing the size of the picture, etc., so that the user can clearly browse the specific content of the chat message.

In these optional implementation manners, the display style of the chat information is adjusted so that each piece of chat information can be highlighted. Allows users to browse multiple chat messages clearly.

In some other application scenarios, the foregoing adjusting the display style of the chat information includes: adjusting the display style of the target chat information indicated by the information browsing instruction.

The target chat message here can be one chat message or two or more chat messages. The target chat information here can be specified by the above-mentioned information browsing instruction. For example, when the user performs a trigger operation on the area corresponding to a piece of chat information in the display interface of the chat information, only the display style of the piece of chat information may be adjusted.

In these optional implementation manners, when the above-mentioned information browsing instruction is received, it can be deemed that the user desires to watch the chat content. By adjusting the display style of the chat information, the chat information is highlighted, so that the user can clearly view the specific content of the chat information.

It is understandable that in some application scenarios, the above two optional implementation manners can be combined. That is to say, in some application scenarios, if a first information browsing instruction for instructing to browse chat information is received, both the size of the display interface of the chat information and the display style of the chat information can be adjusted. Therefore, the display content of the chat information can be increased, and at least a part of the chat information can be prominently presented.

Further optionally, after displaying the chat information with the second opacity on the display interface, the information display method further includes: in response to receiving a scroll operation performed by the user on the chat information display area, displaying the chat information with the first opacity on the display interface. Transparency display chat information.

When the user performs a scrolling operation on the chat information display area, it can be regarded as the content of the chat information that the user wants to browse. In this way, the chat information can be displayed with the first opacity on the display interface, so that the chat information can be clearly displayed in the above display interface. It is convenient for users to browse the content of chat messages.

In some optional implementation manners of this embodiment, the multimedia data stream is a multimedia conference data stream; the display content of the participating users is displayed on the above-mentioned display interface. The display content of the participants can be the user information of the participants. When the multimedia conference is a video conference, the above-mentioned multimedia data stream may include the video data stream of the users participating in the conference. The display content of the user participating in the conference displayed on the above-mentioned display interface may include the video data stream of the user participating in the conference. The video information of the participant corresponding to the video data stream can be displayed in the display interface for displaying the multimedia data stream. The video information here may include multiple video frames included in the video data stream.

In these optional implementation manners, displaying the above-mentioned chat information on the display interface displaying the above-mentioned multimedia data stream in the above-mentioned step 102 includes:

If a user's switching operation of the display content of the above-mentioned display interface is received, the content information presented in the above-mentioned display interface is switched based on the above-mentioned switching operation, so that the chat information display area used for displaying chat information remains displayed on the switched display interface .

That is, when the multimedia data stream is a multimedia data stream of a multimedia conference, the user can perform a switching operation of switching the display content corresponding to the participant user in the above-mentioned display interface. When the multimedia conference is a video conference, the aforementioned switching operation may include a switching operation on the video display content of each participant. According to the user's switching operation, the video display content corresponding to different users in the conference can be switched in the above-mentioned display interface.

At the same time, in the process of switching the display content corresponding to each of the multiple participating users in the above-mentioned display interface according to the user's operation, the above-mentioned chat information display area may be kept displayed on the above-mentioned display interface.

For example, when the video information of participant A is displayed, the chat information displayed in the chat information display area is L1, L2, and L3. When the video information of participant A is switched to the video information of participant B in the display interface according to the user's operation, the chat information display area is still displayed on the display interface that displays the video information of participant B. In some application scenarios, in the process of switching the video information displayed in the aforementioned display interface from the video information of participant A to the video information of participant B, the chat information L1, L2 displayed in the aforementioned chat information display area is maintained. , L3 remains unchanged.

In these optional implementation manners, the display of chat information is not affected when the displayed content is switched.

In some optional implementation manners of this embodiment, the chat information display area displays the latest N pieces of chat information received by default. N is an integer greater than or equal to 1.

In some application scenarios, N can be less than 6.

Further, the above-mentioned information display method may further include the following steps:

Based on the scroll operation performed by the user on the chat information display area, the historical chat information indicated by the scroll operation is displayed.

That is, when the user wants to view historical chat information, he can view the historical chat information by performing a scrolling operation on the chat information display area.

In some optional implementation manners of this embodiment, the chat information of the user participating in the conference may include a hyperlink. In the foregoing step 102, displaying the chat information on the display interface displaying the foregoing multimedia conference includes: highlighting the foregoing hyperlink.

The highlighting here may include, for example, that the hyperlink display style is different from other chat information display styles. The display style of the hyperlink may include, but is not limited to: display color, font, display height, adding underline, etc.

Further optionally, the information display method further includes: in response to receiving a selection operation performed by the user on the above-mentioned hyperlink, displaying the destination page indicated by the above-mentioned hyperlink.

In these implementation manners, the user obtains the target page indicated by the hyperlink by clicking, touching, and other selection operations on the hyperlink, so as to browse the information corresponding to the target page. Compared with the way that the user copies the above hyperlink, opens the browser, and enters the hyperlink in the browser, so that the destination page corresponding to the hyperlink is displayed in the browser, the above method can reduce the information that the participant obtains the destination page Operation.

In some optional implementation manners of this embodiment, the above-mentioned chat information may include the identification information of the participant who sent the chat information. The above-mentioned information display method may include:

In response to receiving the selection operation performed by the user on the participant user identification information, the personal page corresponding to the participant user who sent the aforementioned chat information is displayed.

The user representation information here may be the user nickname, user name, user icon, etc. of the participating user.

In these optional implementations, the user can obtain the personal page of the participant who sent the chat information by performing a selection operation on the identification information of the participant who sent the chat information, so as to understand the participant who sent the chat information. .

In some optional implementations of this embodiment, a chat information input control is provided on the display interface; and the information display method further includes the following steps:

In response to receiving a preset trigger operation performed by the user on the chat information input control, the chat information input by the user is received.

The chat information input by the user and the collected multimedia data stream of the user are taken as the current information stream of the multimedia conference of the user, and the current information stream is transmitted.

The aforementioned chat information may include text information. The aforementioned chat information input control may include a text information input control. After the user performs a trigger operation on the text information input control, the user can input text information through a text information input device (such as a keyboard) that is communicatively connected with the terminal device.

In some application scenarios, the above-mentioned chat information may include text information, and the above-mentioned chat information input control includes a text information input control. The foregoing response to receiving the preset trigger operation performed by the user on the foregoing chat information input control and receiving the chat information input by the user includes:

In response to receiving a trigger operation performed by the user on the text information input control, displaying a virtual keyboard for inputting text information on the display interface;

Receive text information input by the user through the virtual keyboard.

In these application scenarios, the user can input text information through the above-mentioned virtual keyboard displayed on the terminal device.

In some other application scenarios, the above-mentioned chat information includes expression information, and the above-mentioned chat information input control includes an expression information input control.

The foregoing response to receiving the preset trigger operation performed by the user on the foregoing chat information input control and receiving the chat information input by the user includes:

In response to receiving a trigger operation performed by the user on the aforementioned emoticon information input control, display an emoticon list on the aforementioned display interface;

The target expression selected by the user is determined according to the selection operation performed by the user on the multiple expressions displayed in the expression list.

In these application scenarios, the user can input expression information through the expression information input control.

Please further refer to FIG. 2, which shows a schematic diagram of an application scenario of the information display method according to the present disclosure.

The terminal device 201 of the participant A1 can receive the information stream of the multimedia conference sent by the multimedia conference server. The foregoing information stream may include the multimedia data streams of multiple participants in the conference and the chat information input by the participants in accordance with the multimedia conference. The multimedia conference here can be a video conference. Multimedia data streams include video data streams. The terminal device of the participant A1 can display the multimedia video data stream in the display interface 202 for displaying the multimedia conference on its display. Then, the chat information of the participating users is displayed in the preset chat information display area 203. The preset chat information display area 203 and the display interface 202 may be located on a different layer. The background layer of the chat information display area 203 can be set to be transparent. The chat information input control is set on the above-mentioned display interface. The chat information input control may include a text information input control 204 and an expression information input control 205. The text information input control can display prompt information for prompting that this is a text information input control, such as "say something...". The expression information input control may be displayed as a prompt message for prompting that this is the expression information input control. For example, the like icon in Figure 2. When the conference user A1 triggers the text information input control, the conference user A1 can input text information through a keyboard or a virtual keyboard displayed on the display interface. Participant user A1 can also click on the emoticon information input control to obtain a list of emoticon information on the display interface. The emoticon information list may include multiple preset emoticons. Participant user A1 can select the target expression in the expression information list. The terminal device of the participant A1 can transmit the chat information input by the participant A1 and the collected video data stream and audio data stream of the participant A1 to the server. The server can mix the video data stream and audio data stream of participant A1 with the video data stream and audio data stream of other participants, and mix the chat information of participant A1 with the chat information sent by other participants. To integrate. The mixed video data stream and audio data stream of the multiple participants, and the chat information of the multiple participants after the integration are packaged separately, and transmitted to the participants of the multimedia conference as the information stream of the multimedia conference.

With further reference to FIG. 3, as an implementation of the method shown in FIG. 1, the present disclosure provides some embodiments of an information display device. These device embodiments correspond to those method embodiments shown in FIG. It can be applied to various electronic devices.

As shown in FIG. 3, the information display device of some embodiments includes: a receiving unit 301 and a display unit 302. Among them, the receiving unit 301 is used to receive multimedia information streams, and the above information streams include multimedia data streams and chat information sent by participating users according to the above multimedia data streams; the display unit 302 is used to display the above multimedia conference display interface Show the above chat information.

In this embodiment, the specific processing of the receiving unit 301 and the display unit 302 of the information display device and the technical effects brought about by them can be referred to the relevant descriptions of step 101 and step 102 in the embodiment corresponding to FIG. 1 respectively. Go into details again.

In alternative implementations of some embodiments, the receiving unit 301 is further configured to: receive the multimedia data streams that are packaged and transmitted and the chat information sent by the user according to the information content corresponding to the multimedia; and the display unit 302 is further configured to: The display time information corresponding to each of the multimedia data stream and the above-mentioned chat information is displayed synchronously with the above-mentioned multimedia data stream and the above-mentioned chat information.

In an optional implementation of some embodiments, the display unit 302 is further configured to display the chat information in a preset chat information display area on the display interface, and the size of the chat information display area is smaller than the size of the display interface.

In some optional implementation manners of some embodiments, the chat information display area and the display interface are located on different layers.

In some optional implementation manners of some embodiments, the background layer of the chat information display area has a preset transparency.

In some optional implementation manners of some embodiments, the display unit 302 is further configured to: display the chat information with the first opacity on the above-mentioned display interface within the first preset time period when the new chat information is received; And in response to no other new chat information being received after the first preset time period, the chat information is displayed with a second opacity on the display interface; wherein the first opacity is greater than the second opacity.

In some optional implementations of some embodiments, the display unit 302 is further configured to: after displaying the chat information at the second opacity on the display interface, in response to receiving the scrolling performed by the user on the chat information display area Operation, the chat information is displayed with the first opacity on the above-mentioned display interface.

In some optional implementations of some embodiments, the multimedia data stream is a multimedia conference data stream; the display content of the user participating in the meeting is displayed on the display interface; and the display unit 302 is further configured to: The display content switching operation of the interface switches the content information presented on the above-mentioned display interface based on the above-mentioned switching operation, so that the chat information display area used for displaying the chat information remains displayed on the switched display interface.

In some optional implementations of some embodiments, the chat information display area defaults to display the latest N pieces of chat information received; where N is an integer greater than or equal to 1.

In some optional implementations of some embodiments, the display unit 302 is further configured to display the historical chat information indicated by the aforementioned scrolling operation based on the scrolling operation performed by the user on the aforementioned chatting information display area.

In some optional implementation manners of some embodiments, the above-mentioned chat information includes a hyperlink; and the display unit 302 is further configured to: highlight the above-mentioned hyperlink.

In some optional implementation manners of some embodiments, the display unit 302 is further configured to: in response to receiving a selection operation performed by the user on the above-mentioned hyperlink, display the destination page indicated by the above-mentioned hyperlink.

In some optional implementations of some embodiments, the chat information includes the identification information of the participant who sent the chat information, and the display unit 302 is further configured to: in response to receiving the selection operation performed by the user on the identification information, display the foregoing The personal page corresponding to the participant who sent the above chat information.

In some optional implementations of some embodiments, the foregoing display interface is provided with a chat information input control; the information display device further includes an information input unit (not shown in the figure). The information input unit is configured to: in response to receiving a preset trigger operation performed by the user on the chat information input control, receive the chat information input by the user, and transmit the aforementioned chat information.

In some optional implementations of some embodiments, the chat information includes text information, and the chat information input control includes a text information input control; and the information input unit is further configured to: in response to receiving a user's input to the text information input control, The executed trigger operation displays a virtual keyboard for inputting text information on the above-mentioned display interface; and receives text information input by the user through the above-mentioned virtual keyboard.

In some optional implementation manners of some embodiments, the above-mentioned chat information includes expression information, and the above-mentioned chat information input control includes an expression information input control; To trigger the operation, the expression list is displayed on the above-mentioned display interface; according to the selection operation performed by the user on the multiple expressions displayed in the above-mentioned expression list, the target expression selected by the user is determined.

The information display device provided in this embodiment receives a multimedia information stream through a receiving unit. The information stream includes the multimedia data stream and the chat information sent by the participant users according to the multimedia data stream; the display unit is displayed on the display interface of the multimedia conference. Show the above chat information. Compared with the existing way of browsing multimedia information, you need to open an instant messaging application to exchange information with other users. The method provided in this application allows users to browse the chats between users on the display interface for displaying multimedia data. The information simplifies the operation of the user to communicate with other users in the process of browsing multimedia information, and improves the user experience.

With further reference to FIG. 4, FIG. 4 shows an exemplary system architecture of an information display method or an information display device to which some embodiments of the present disclosure can be applied.

As shown in FIG. 4, the system architecture may include

terminal devices

401, 402, and 403, a network 404, and a server 405. The network 404 is used to provide a medium for communication links between the

terminal devices

401, 402, 403 and the server 405. The network 404 may include various connection types, such as wired, wireless communication links, or fiber optic cables, and so on.

The

terminal devices

401, 402, and 403 can interact with the server 405 via the network 404 to receive or send messages and so on. Various client applications may be installed on the

terminal devices

401, 402, and 403, such as web browser applications, search applications, news information, multimedia conference applications and other applications. The client applications in the

terminal devices

401, 402, and 403 can receive instructions from the user, and perform corresponding functions according to the instructions of the user, for example, add corresponding information to the information according to the instructions of the user.

The

terminal devices

401, 402, and 403 may be hardware or software. When the

terminal devices

401, 402, and 403 are hardware, they can be various electronic devices that have a display screen and support web browsing, including but not limited to smart phones, tablet computers, e-book readers, and MP3 players (Moving Picture Experts Group). Audio Layer III, Motion Picture Experts compress standard audio layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, Motion Picture Experts compress standard audio layer 4) Players, laptop portable computers and desktop computers, etc. When the

terminal devices

401, 402, and 403 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or as a single software or software module. There is no specific limitation here.

The server 405 may be a server that provides various services, such as receiving multimedia conference information streams sent by the

terminal devices

401, 402, 403, and analyzing and processing the information streams, and sending the analyzed and processed information streams to the

terminal devices

401, 402 , 403.

It should be noted that the information display method provided in the embodiments of the present disclosure may be executed by a terminal device, and accordingly, the information display apparatus may be set in the

terminal devices

401, 402, and 403. In addition, the information display method provided by the embodiment of the present disclosure may also be executed by the server 405, and accordingly, the information display device may be set in the server 405.

It should be understood that the numbers of terminal devices, networks, and servers in FIG. 4 are merely illustrative. There can be any number of terminal devices, networks, and servers according to implementation needs.

Next, refer to FIG. 5, which shows a schematic structural diagram of an electronic device (such as the server or terminal device in FIG. 4) suitable for implementing some embodiments of the present disclosure. The terminal devices in some embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals, etc. (E.g. car navigation terminals) and other mobile terminals and fixed terminals such as digital TVs, desktop computers, etc. The terminal device/server shown in FIG. 5 is only an example, and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG. 5, the electronic device may include a processing device (such as a central processing unit, a graphics processor, etc.) 501, which may be loaded into a random access memory according to a program stored in a read-only memory (ROM) 502 or from a storage device 508 (RAM) The program in 503 executes various appropriate actions and processing. In RAM 503, various programs and data required for the operation of electronic devices are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to the bus 504.

Generally, the following devices can be connected to the I/O interface 505: including input devices 506 such as touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, liquid crystal display (LCD), speakers, vibration An output device 507 such as a device; a storage device 508 such as a magnetic tape, a hard disk, a memory card, etc.; and a communication device 509. The communication device 509 may allow the electronic device to perform wireless or wired communication with other devices to exchange data. Although FIG. 5 shows an electronic device with various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may be implemented alternatively or provided with more or fewer devices. Each block shown in FIG. 5 may represent one device, or may represent multiple devices as needed.

In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In some such embodiments, the computer program may be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the methods of some embodiments of the present disclosure are executed.

It should be noted that the computer-readable medium described in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable signal medium may send, propagate or transmit the program for use by or in combination with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate with any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. Communication (e.g., communication network) interconnects. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any currently known or future research and development network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device. The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: The chat information sent by the information content corresponding to the multimedia; the chat information is displayed on the display interface that displays the multimedia data stream.

The computer program code used to perform the operations of some embodiments of the present disclosure can be written in one or more programming languages or a combination thereof, the programming languages including object-oriented programming languages-such as Java, Smalltalk, C++ , Also includes conventional procedural programming languages-such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user’s computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to Connect via the Internet).

The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions, and operations of the system, method, and computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logic function. Executable instructions. It should also be noted that, in some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks shown one after another can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations Or it can be realized by a combination of dedicated hardware and computer instructions.

The units described in some embodiments of the present disclosure may be implemented in software or hardware. Among them, the name of the unit does not constitute a limitation on the unit itself under certain circumstances. For example, the receiving unit can also be described as a "unit for receiving multimedia information streams".

The functions described above in this document may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.

In the context of the present disclosure, a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.

The above description is only some preferred embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solution formed by the specific combination of the above technical features, and should also cover the above-mentioned inventive concept without departing from the above-mentioned inventive concept. Other technical solutions formed by any combination of technical features or their equivalent features. For example, the above-mentioned features and the technical features disclosed in the embodiments of the present disclosure (but not limited to) having similar functions are replaced with each other to form a technical solution.

Claims

An information display method, characterized in that it comprises:

Receiving a multimedia information stream, the information stream including a multimedia data stream and chat information sent by a user according to the information content corresponding to the multimedia;

The chat information is displayed on a display interface that displays the multimedia data stream.
The method according to claim 1, wherein the receiving multimedia information stream comprises:

Receiving the multimedia data stream separately packaged and transmitted and the chat information sent by the user according to the information content corresponding to the multimedia; and

The displaying the chat information on the display interface displaying the multimedia data stream includes:

According to the display time information corresponding to each of the multimedia data stream and the chat information, the multimedia data stream and the chat information are displayed synchronously.
The method according to claim 1, wherein the displaying the chat information on a display interface displaying the multimedia data stream comprises:

The chat information is displayed in a preset chat information display area on the display interface, and the size of the chat information display area is smaller than the size of the display interface.
The method according to claim 3, wherein the chat information display area and the display interface are located on different layers.
The method according to claim 4, wherein the background layer of the chat information display area has a preset transparency.
The method of claim 1, wherein:

The displaying the chat information on the display interface displaying the multimedia data stream includes:

During the first preset time period when new chat information is received, display the chat information with the first opacity on the display interface; and

In response to not receiving other new chat information after the first preset time period, display the chat information with a second opacity on the display interface; wherein the first opacity is greater than the second opacity .
The method according to claim 6, wherein after displaying the chat information with a second opacity on the display interface, the method further comprises:

In response to receiving the scrolling operation performed by the user on the chat information display area, the chat information is displayed with the first opacity on the display interface.
The method according to claim 1, wherein the multimedia data stream is a multimedia conference data stream; the display interface displays the display content of the participating users; and

The displaying the chat information on the display interface displaying the multimedia data stream includes:

If a user's display content switching operation on the display interface is received, the content information presented on the display interface is switched based on the switching operation, so that the chat information display area used to display chat information remains displayed in the switched display Interface.
The method according to claim 3, wherein the chat information display area displays the latest N pieces of chat information received by default; wherein N is an integer greater than or equal to 1.
The method according to claim 9, wherein the method further comprises:

Based on the scroll operation performed by the user on the chat information display area, the historical chat information indicated by the scroll operation is displayed.
The method according to claim 1, wherein the chat information includes a hyperlink; and

The displaying the chat information on the display interface displaying the multimedia conference includes:

Highlight the hyperlink.
The method according to claim 11, wherein the method further comprises:

In response to receiving the selection operation performed by the user on the hyperlink, the destination page indicated by the hyperlink is displayed.
The method according to claim 1, wherein the chat information includes identification information of a participant who sent the chat information, and

The method also includes:

In response to receiving the selection operation performed by the user on the identification information, the personal page corresponding to the participant who sent the chat information is displayed.
The method according to claim 1, wherein the display interface is provided with a chat information input control; and

The method also includes:

In response to receiving a preset trigger operation performed by the user on the chat information input control, the chat information input by the user is received, and the chat information is transmitted.
The method according to claim 14, wherein the chat information comprises text information, and the chat information input control comprises a text information input control; and

The receiving the chat information input by the user in response to receiving the preset trigger operation performed by the user on the chat information input control includes:

In response to receiving a trigger operation performed by the user on the text information input control, displaying a virtual keyboard for inputting text information on the display interface;

Receive text information input by the user through the virtual keyboard.
The method according to claim 14, wherein the chat information includes expression information, and the chat information input control includes an expression information input control; and

The receiving the chat information input by the user in response to receiving the preset trigger operation performed by the user on the chat information input control includes:

In response to receiving a trigger operation performed by the user on the emoticon information input control, displaying an emoticon list on the display interface;

According to the selection operation performed by the user on the multiple expressions displayed in the expression list, the target expression selected by the user is determined.
The method according to claim 1, wherein the displaying the chat information on a display interface displaying the multimedia data stream comprises:

In response to receiving the first information browsing instruction for instructing to browse the chat information, adjust the size of the display interface of the chat information; and/or

Adjust the display style of the chat information.
The method according to claim 17, wherein the first information browsing instruction for instructing to browse chat information is generated based on one of the following operations performed by the user on the chat information display area: cursor hovering operation, click Operation, touch operation, sliding operation.
The method according to claim 17, wherein the adjusting the display style of the chat information comprises one of the following:

Adjust the display style of multiple chat messages displayed in the chat message display interface;

Adjusting the display style of the target chat information indicated by the first information browsing instruction.
The method according to claim 17, wherein the adjusting the display style of the chat information comprises at least one of the following:

Increase the opacity of the chat information;

Increase the display size of the chat information.
An information display device, characterized in that it comprises:

A receiving unit, configured to receive a multimedia information stream, the information stream including a multimedia data stream and chat information sent by a participant user according to the multimedia data stream;

The display unit is configured to display the chat information on the display interface for displaying the multimedia conference.
An electronic device, characterized in that it comprises:

One or more processors;

Storage device for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1-20.
A computer-readable medium with a computer program stored thereon, wherein the program is executed by a processor to implement the method according to any one of claims 1-20.