WO2024093937A1

WO2024093937A1 - Method and apparatus for viewing audio-visual content, device, and storage medium

Info

Publication number: WO2024093937A1
Application number: PCT/CN2023/127880
Authority: WO
Inventors: 郑康; 和君; 张鼎; 刘敬晖; 李继超; 李想
Original assignee: 北京字跳网络技术有限公司
Priority date: 2022-10-31
Filing date: 2023-10-30
Publication date: 2024-05-10
Also published as: CN117993357A

Abstract

Provided in embodiments of the present disclosure are a method and apparatus for viewing audio-visual content, a device, and a storage medium. The method comprises: providing a viewing interface for audio-visual content, the viewing interface comprising a playback control for playing back the audio-visual content, and the audio-visual content corresponding to a record of a historical activity; and presenting an interaction identifier at a target position associated with a time axis of the playback control, the interaction identifier being used for indicating that an interaction event corresponding to the interaction identifier occurs at a target moment indicated by the historical activity at the target position. In this way, the embodiments of the present disclosure help a user to more conveniently understand an event occurring in a historical activity corresponding to audio-visual content.

Description

Method, apparatus, device and storage medium for viewing audiovisual content

This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and storage media for viewing audiovisual content” and application number 202211351621.5 filed on October 31, 2022, and the entire contents of which are incorporated by reference into this application.

Technical Field

Example embodiments of the present disclosure relate generally to the field of computers, and more particularly to methods, devices, apparatuses, and computer-readable storage media for viewing audiovisual content.

Background technique

With the development of computer technology, the Internet has become the main platform for people to obtain and share content. For example, people can use the Internet to publish a variety of content, or receive content shared by other users.

In the content sharing based on the Internet, the sharing of audiovisual content (e.g., audio content or video content) has become one of the most important forms. For example, people can use a player to play a video or audio recording of a speech or a meeting shared by other users. However, such video or audio recordings are difficult to effectively reflect the historical interaction events that occurred.

Summary of the invention

In a first aspect of the present disclosure, a method for viewing audio-visual content is provided. The method comprises: providing a viewing interface for audio-visual content, the viewing interface comprising a playback control for playing the audio-visual content, the audio-visual content corresponding to a record of a historical activity; and presenting an interaction mark at a target position associated with a timeline of the playback control, the interaction mark being used to indicate that an interaction event corresponding to the interaction mark has occurred in the historical activity at a target time indicated by the target position. Piece.

In a second aspect of the present disclosure, a method for viewing audio-visual content is provided. The method includes: providing a viewing interface for the audio-visual content, the viewing interface including a play control for playing the audio-visual content, the audio-visual content corresponding to a record of a historical activity; and presenting visualization information of a target document associated with the audio-visual content in the viewing interface, the visualization information being used to characterize a structure of the target document.

In a third aspect of the present disclosure, a device for viewing audio-visual content is provided. The device includes a first providing module, configured to provide a viewing interface for audio-visual content, the viewing interface including a playback control for playing the audio-visual content, the audio-visual content corresponding to a record of a historical activity; a viewing interface for a meeting record of a meeting is provided, the viewing interface including a playback control for playing the audio-visual content of the meeting record; and a first presenting module, configured to present an interaction identifier at a target position associated with a timeline of the playback control, the interaction identifier being used to indicate that an interaction event corresponding to the interaction identifier has occurred at a target time indicated by the target position in the historical activity.

In a fourth aspect of the present disclosure, a device for viewing audio-visual content is provided. The device includes a second providing module configured to provide a viewing interface for audio-visual content, the viewing interface including a playback control for playing the audio-visual content, the audio-visual content corresponding to a record of a historical activity; a viewing interface for a meeting record of a meeting is provided, the viewing interface including a playback control for playing the audio-visual content of the meeting record; and a second presenting module configured to present visual information of a target document associated with the audio-visual content in the viewing interface, the visual information being used to characterize the structure of the target document.

In a fifth aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect or the second aspect.

In a sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and when the program is executed by a processor, the method of the first aspect or the second aspect is implemented.

It should be understood that the contents described in the summary of the present invention are not intended to limit the present disclosure. The key features or important features of the embodiments of the present invention are not intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

FIG1 shows an example interface of a conventional audio-visual content viewing;

2A and 2B are schematic diagrams showing example interfaces for viewing audiovisual content according to some embodiments of the present disclosure;

3A to 3D are schematic diagrams showing an interaction process of an example interface for viewing audio-visual content according to some embodiments of the present disclosure;

FIG4 shows an interactive schematic diagram of an example interface for viewing audio-visual content according to yet other embodiments of the present disclosure;

5A to 5D are schematic diagrams showing an interaction process of an example interface for viewing audio-visual content according to other embodiments of the present disclosure;

FIG6 is a schematic diagram showing an example interface for viewing audio-visual content according to yet other embodiments of the present disclosure;

FIG7 is a schematic diagram showing an example interface for viewing audio-visual content according to yet other embodiments of the present disclosure;

FIG8 illustrates a flow chart of an example process for viewing audiovisual content according to some embodiments of the present disclosure;

FIG9 is a flowchart showing an example process of viewing audiovisual content according to other embodiments of the present disclosure;

FIG10 shows a block diagram of an apparatus for viewing audiovisual content according to some embodiments of the present disclosure;

FIG. 11 shows a block diagram of an apparatus for viewing audiovisual content according to some embodiments of the present disclosure; and

FIG. 12 shows a block diagram of a device capable of implementing various embodiments of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

As discussed above, people can use players to obtain audio-visual content. Figure 1 shows a schematic diagram of a conventional audio-visual content player 100. Such audio-visual content may be a record of historical activities.

As an example, such audio-visual content may be, for example, an audio or video recording of an online meeting. Such an audio or video recording can facilitate people to review the relevant content of the meeting later. In some other scenarios, the audio-visual content may also be, for example, an audio or video recording of a speech.

For people, for example, they not only pay attention to the audio or video playback of historical activities, but also pay attention to some specific interactive events that occurred in historical activities. Taking online meetings as an example, document sharing has become an important form of collaboration in meetings. People are also paying more and more attention to the relevant information about the shared documents in the meeting. However, traditional meeting records are difficult to provide records of documents shared in meetings, which makes it difficult for people to efficiently obtain relevant information about document sharing in meetings.

In a first aspect of the present disclosure, an embodiment of the present disclosure provides a solution for viewing audio-visual content. In the solution, a viewing interface for the audio-visual content may be provided, wherein the viewing interface includes a playback control for playing the audio-visual content, and the audio-visual content corresponds to a historical Furthermore, an interaction identifier may be presented at a target position associated with the timeline of the play control, wherein the interaction identifier is used to indicate that an interaction event corresponding to the interaction identifier occurred at a target time indicated by the target position in the historical activity.

Based on this approach, the embodiments of the present disclosure can enable users to quickly obtain interactive events that occurred in historical activities corresponding to audio-visual content, thereby improving the efficiency of users in obtaining information.

In a second aspect of the present disclosure, an embodiment of the present disclosure further provides a solution for viewing audio-visual content. In this solution, a viewing interface for the audio-visual content can be provided, wherein the viewing interface includes a play control for playing the audio-visual content, and the audio-visual content corresponds to a record of historical activities. Further, visual information of a target document associated with the audio-visual content can be presented in the viewing interface, wherein the visual information is used to characterize the structure of the target document.

Based on this approach, the embodiments of the present disclosure enable users to quickly obtain relevant information about documents associated with historical activities (for example, files shared in online meetings, or documents used in presentations), and enable users to conveniently obtain structural information of documents (for example, chapters, etc.).

The following will describe in detail an example scheme according to an embodiment of the present disclosure in conjunction with the accompanying drawings. It should be understood that, for the purpose of convenience of description only, the example interface below uses a meeting as an example of a historical activity and a meeting record as an example of audio-visual content. The audio-visual content provided by the embodiment of the present disclosure may also include audio or video recordings of other historical activities, for example, audio or video recordings of online or offline speeches, etc.

Sample viewing interface for audiovisual content

In some embodiments, embodiments of the present disclosure can provide information about documents shared in a meeting in a viewing interface of audio-visual content.

FIG2A shows an example viewing interface 200A for audiovisual content according to some embodiments of the present disclosure. As shown in FIG2A , the viewing interface 200A may include a play control for playing audiovisual content (e.g., audio content or video content) related to the historical activity. The viewing interface 200A may be provided by, for example, an appropriate electronic device. Examples may include, but are not limited to: desktop computers, laptop computers, smart phones, tablet computers, personal digital assistants, or smart wearable devices.

As shown in FIG2A , the playback control may include a timeline 210, which may be used, for example, to indicate the playback progress of the audiovisual content. In some embodiments, as shown in FIG2A , the timeline 210 may present graphical information corresponding to the audio waveform of the audiovisual content. In this way, the user can more easily understand which parts of the audiovisual content are worth paying attention to, and which parts, such as those with less audio waveforms, can be temporarily ignored. Thus, the viewing interface 200 can improve the efficiency of the user in acquiring content.

In some embodiments, as shown in Figure 2A, viewing interface 200A may further include document identifiers 220-1 and 220-2 (individually or collectively referred to as document identifiers 220). In some embodiments, document identifiers 220 may be presented at a position associated with timeline 210 to indicate that the corresponding document is shared to the meeting at a time corresponding to the position.

In some embodiments, as shown in FIG. 2A , the document identifier 220 may be presented in the upper area of the timeline 210 , and its horizontal offset may indicate the time point when the corresponding document is shared in the meeting.

In some embodiments, the document identifier 220 may also be presented at other appropriate locations, for example, superimposed above the timeline 210 , or displayed below the timeline 210 , etc.

In some embodiments, as shown in Figure 2A, the style of the document identifier 220 can be determined based on the type of document shared in the meeting. For example, the document identifier 220-1 can indicate that a text document (e.g., a cloud document) is shared in the meeting, while the document identifier 220-2 can indicate that a presentation document (e.g., a PPT file) is shared in the meeting.

In this way, the embodiments of the present disclosure can enable users to intuitively understand which documents were shared in a meeting and when, thereby improving the efficiency of users in obtaining meeting information. For example, if a user wants to obtain an introduction to a specific document in a meeting, he or she can quickly adjust the playback control to play from the corresponding moment.

In some embodiments, in addition to file or document sharing, the timeline 210 may also present, for example, interaction markers 230 corresponding to other interaction behaviors in the online meeting. Such interaction markers 230 may be set at positions associated with the timeline 210 to indicate that corresponding interaction behaviors occurred at corresponding moments. Graphics can correspond to different interactive behaviors.

In some embodiments, the timeline 210 may include, for example, an interactive identifier 230 for indicating an online chat in an online conference. The online chat herein refers to any appropriate chat based on text, emoticons, images, and/or audio, for example, using an instant messaging tool of an online conference. Accordingly, the graphic identifier of the interactive identifier 230 may be determined, for example, based on the content of the online chat. Alternatively, the graphic identifier of the interactive identifier 230 may be determined, for example, by a graphic identifier (e.g., an avatar) of a user participating in the chat.

In some embodiments, when the user selects the interactive mark 230, the playback control can guide the user to obtain descriptive information about the online chat. For example, when the user hovers over the interactive mark 230, the playback control can indicate the information of the online chat, such as the participants of the online chat, the chat content, etc., in a floating window. In another example, if the user clicks the interactive mark 230, the playback control can guide the user to obtain the complete content of the online chat, such as guiding the user to jump to the viewing interface of the chat content in the meeting.

In some embodiments, the timeline 210 may include, for example, an interactive identifier 230 for indicating comments in an online conference. The comments here may include, for example, any appropriate comments based on text, expressions, images, and/or audio. For example, a user's like may also be understood as a comment on the corresponding content. Accordingly, the graphic identifier of the interactive identifier 230 may be determined, for example, based on the content and/or type of the comment. For example, if it is a comment based on an expression, the graphic representation of the interactive identifier 230 may be generated based on the expression.

In some embodiments, when the user selects the interactive mark 230, the playback control can guide the user to obtain descriptive information about the comment. For example, when the user hovers over the interactive mark 230 with a mouse, the playback control can indicate the information of the comment, such as the commenter, comment time, and comment reply, etc., in a floating window. In another example, if the user clicks the interactive mark 230, the playback control can guide the user to jump to the interface for viewing the comment to obtain more abundant information about the comment.

In some embodiments, as shown in FIG. 2B , for a document identifier 220 , when a preset operation (eg, a hover operation) for the document identifier 220 is received, the playback control may present description information 240 for the document shared in the meeting.

In some embodiments, such description information 240 may be presented in a floating window. The floating window may no longer be presented when the hovering operation stops or after a predetermined time period after the stop.

In some embodiments, as shown in FIG2B , such description information 240 may include, for example, a document identifier (e.g., a file name) of the document. Alternatively or additionally, such description information 240 may also include a sharing party of the document. Alternatively or additionally, such description information 240 may also include a sharing time of the document, for example, a sharing start time (e.g., the 8th minute after the meeting starts), a sharing time period (e.g., 08:00-20:30).

Alternatively or additionally, such description information 240 may also include the administrator of the document, such as the creator or owner of the document. Alternatively or additionally, such description information 240 may also include the document type of the document, such document type may include, for example, the format type of the document (e.g., the suffix of the document) or the style type of the document (e.g., a plan, a weekly report, etc.).

Based on this approach, the embodiments of the present disclosure can enable users to more quickly obtain relevant information about documents shared in a meeting.

Visual presentation of documents

In some embodiments, embodiments of the present disclosure may also provide visualization content of documents shared in a meeting, so as to facilitate users to more conveniently obtain information about documents shared in a meeting. Such visualization content may be used to indicate or characterize the structure of a document, for example.

In some embodiments, the visual content of the document may be presented in response to a preset operation (e.g., a click operation) for the document identifier 220 as discussed in FIG2A. Alternatively, as will be discussed below with reference to FIG6, the visual content of the document may always be presented, or presented in response to the corresponding audiovisual content portion starting to be played.

The following will discuss the presentation of visual content of documents in combination with text documents and presentation documents.

Text Documents

In this disclosure, "text document" is used to refer to a document based on local or online text editing. Documents created for work, such as WORD documents, TXT documents, WPS documents, cloud documents, etc. In some cases, such "text documents" may have a certain chapter structure, for example.

Fig. 3A shows an example viewing interface 300A of a conference record according to some embodiments of the present disclosure. As shown in Fig. 3A, after receiving a preset operation (eg, a click operation) for the document identifier 220-1, the playback control may present the visual content 310 of the document.

As shown in FIG3A , the visualized content 310 may include a document identifier 320 of the document. Additionally, the document identifier 320 may be used as an entry for online access to the document or downloading the document. When a user clicks on the document identifier 320, the playback control may direct the user to the online access page of the document, or to the download interface of the document, or directly cause the document to be downloaded locally.

Additionally, as shown in FIG. 3A , the visualization content 310 may also include at least one descriptive item 340 for representing the structure of the document. Such a descriptive item 340 may correspond to one or more structural parts (e.g., chapters) of a document. For example, as shown in FIG. 3A , a descriptive item 340 may correspond to a chapter of a text-based document. In some embodiments, such a descriptive item 340 may, for example, include textual description information, such as a chapter title of a corresponding chapter. Additionally, such a descriptive item 340 may, for example, also include image information, such as a screenshot of a chapter or a representative diagram in a chapter, etc.

Thus, the user can intuitively understand the structure of the shared document, for example, chapter information, through the visualized content 310 of the text document.

In some embodiments, for a cloud document, the server may, for example, maintain a chapter structure of the cloud document. Accordingly, the description item 340 may be generated by the server or the terminal device based on the chapter structure maintained by the server.

In some embodiments, for a local text document shared in a conference, a terminal device or a server of a conference system can extract or identify the chapter structure of the document. It should be understood that the way the chapter structure is determined varies based on the different creation tools or formats of the text document. For example, a .doc document provides an application programming interface (API) for determining the chapters of a document.

It should be understood that appropriate tools can be adopted or developed depending on the type of document. Extracting the chapter structure of a text document, the present disclosure does not intend to limit the specific method of determining the chapter structure of the document.

In some embodiments, a text document may include a chapter structure of multiple levels. For example, it may include multiple large chapters, each of which may include one or more subsections. In such a case, the playback control may, for example, only present the chapter information corresponding to a specific level.

For example, a document may include the following chapter structures "Chapter 1" and "Chapter 2", "Chapter 1" also includes "Section 1.1 and Section 1.2", and "Chapter 2" also includes "Section 2.1 and Section 2.2".

In this case, the visual content of the document may correspond to the "Chapter" level, for example, including two description items corresponding to "Chapter 1" and "Chapter 2". In other cases, the visual content of the document may correspond to the "Section" level, for example, including four description items corresponding to "Section 1.1", "Section 1.2", "Section 2.1" and "Section 2.2".

In some embodiments, the playback control may only present description items of sections whose corresponding audio-visual content has a duration greater than a predetermined threshold. For example, taking a document including "Section 1.1", "Section 1.2", "Section 2.1" and "Section 2.2" as an example, if the duration of "Section 1.2" being shared in a meeting is, for example, less than a predetermined threshold, then its corresponding description item may not be presented in the viewing interface of the meeting record, for example. Thus, the embodiments of the present disclosure can further improve the efficiency of users in obtaining content related to document sharing in a meeting.

In some embodiments, if the visual content of the document includes multiple description items, the multiple description items can be presented in the viewing interface in a predetermined order. For example, as shown in FIG3A , multiple description items 340 can be presented sequentially based on the structural order of corresponding structural parts (e.g., chapters) in the document.

Alternatively, the presentation order of multiple description items in the visual content of the document in the viewing interface can also be based on the order in which the corresponding structural parts (e.g., chapters) are shared in the meeting. For example, if the sharer first shares "Section 1.1" and then jumps to share "Section 2.2", the description items corresponding to "Section 2.2" can be presented along with the description items of "Section 1.1" without considering their structural order in the document.

Alternatively, the presentation order of multiple description items in the visual content of the document in the viewing interface can also be based on the order of the sharing time of the corresponding structural parts (e.g., chapters) in the meeting. For example, if the sharing party spent the most time sharing "Section 1.2" in the meeting, the description item corresponding to "Section 1.2" can be presented first, regardless of its structural order in the document.

In some embodiments, as shown in FIG. 3B , upon receiving a preset operation (eg, a hover operation) regarding a description item 340 , the playback control may present description information 350 of a structural portion (eg, a corresponding chapter) corresponding to the description item 340 .

In some embodiments, such description information 350 may include, for example, an identifier of the corresponding structure part, such as a chapter title. Alternatively or additionally, such description information 350 may also include, for example, a sharing time corresponding to the structure part, such as a start time, an end time and/or a duration.

Based on this approach, the embodiments of the present disclosure can help users more quickly understand the sharing status of each part of the document.

In some embodiments, the display style of the visual content of the document can also change accordingly with the playback of the audio-visual content. In some embodiments, when a portion of the audio-visual content associated with a specific structural portion is being played, its corresponding description item can be highlighted, for example. For example, the text can be accelerated or highlighted to indicate that the audio-visual content associated with the corresponding chapter is being played.

FIG3C shows an example viewing interface 300C according to some embodiments of the present disclosure. As shown in FIG3C , the description item 340 may also include a play indication control 330. When the audio-visual content associated with the chapter corresponding to the description item 340 is being played, the style of the play indication control 330 may be adjusted. For example, when the audio-visual content associated with the chapter corresponding to the description item 340 is not being played, the play indication control 330 may, for example, have a style as shown in FIG3A ; when the audio-visual content associated with the chapter corresponding to the description item 340 is being played, the play indication control 330 may, for example, be adjusted to a style as shown in FIG3C .

In some embodiments, the play control can indicate that the corresponding chapter-related audiovisual content is being played by adjusting an appropriate display style of the play indication control 330 , such as color, grayscale, size, shape, etc.

3D shows an example viewing interface 300D according to some other embodiments of the present disclosure. Different from the style of the play indicator control 330 shown in FIG3C , when the audio-visual content associated with the chapter corresponding to the description item 340 is being played, the style of the play indicator control 330 can be adjusted to the style shown in FIG3D to indicate the playback progress of the portion of the audio-visual content associated with the chapter.

For example, taking FIG. 3D as an example, the description item 340 may be associated with the section "Part 2" of the document, and the portion of the audiovisual content corresponding to the section has a duration of "60 seconds". Thus, the play indication control 330 may also indicate the play progress of the portion of the audiovisual content by, for example, a progress bar and/or text style, to indicate that the current playback reaches "25 seconds" of "60 seconds".

In some embodiments, the user can also quickly jump to the portion of the audiovisual content corresponding to the corresponding chapter through the description item 340. In some embodiments, upon receiving a preset operation (e.g., a click or double-click operation) of the description item 340, the play control can jump to the start time (e.g., 09:00) of the portion of the audiovisual content related to the chapter (e.g., the second part) corresponding to the description item 340 and start playing.

In some other embodiments, the playback control may also consider the location where the preset operation occurs. For example, when the user clicks the center position of the playback indicator control 330 of the description item 340, the playback control may start playing the portion of the audiovisual content related to the "second part" from the time corresponding to the center position (e.g., 09:30).

Based on this approach, the embodiments of the present disclosure can enrich the user's interaction logic, so that the playback position of the audio-visual content can be quickly controlled through the description items of the document, thereby improving the efficiency of obtaining information.

In some embodiments, the viewing interface may also provide, for example, a text control for presenting text content corresponding to the meeting record. For example, FIG4 shows a viewing interface 400 for meeting records according to some embodiments of the present disclosure.

As shown in Fig. 4, the interface 400 may be integrated with the playback controls discussed above, and further include a text control 410 for providing text content. In some embodiments, the text content presented in the text control 410 may be determined based on speech recognition of the audiovisual content.

In some embodiments, as discussed above, when a user, for example, performs a preset operation (e.g., clicking or double-clicking) on a description item 340 or when audiovisual content associated with a structural portion associated with the description item 340 is being played, the text control 410 can cause target text content 420 associated with the structural portion (e.g., "second portion") in the text content to be highlighted relative to other text content 430.

In some embodiments, making the target text content 420 highlighted relative to other text content 430 may include, for example, increasing the prominence of the target text content 420 displayed in the text control 420. For example, the display style (e.g., text color, background color, boldness, font size, underline) of the target text content 420 may be adjusted to be more prominent. For example, the target text content 420 may be bolded or highlighted.

Alternatively, making the target text content 420 highlighted relative to other text content 430 may also include, for example, reducing the prominence of the other text content 430 displayed in the text control. For example, the display style (e.g., text color, background color, boldness, font size, underline) of the other text content 430 may be adjusted to be non-prominent. For example, as shown in FIG. 4 , the text color of the other text content 430 may be adjusted to gray, thereby forming a contrast with the black target text content 420.

Based on this approach, the implementation of the present disclosure can enable users to more quickly obtain text content corresponding to the portion of interest.

In some embodiments, the viewing interface of the conference record may also support, for example, a query about the description item 340. Exemplarily, the viewing interface may provide a query entry (not shown in the figure) for querying a specific chapter.

After the user selects the entry, the user may, for example, input one or more keywords desired to be retrieved to initiate a query request. Further, the terminal device and/or the server may determine one or more matching structural parts (eg, chapters) based on the acquired one or more keywords.

In some embodiments, the terminal device and/or the server may determine the matched one or more chapters based on the matching of the description information (e.g., chapter title, author of the chapter, etc.) associated with at least one structural part of the document with the keyword. For example, a user may enter the user ID of a specific user to find a chapter drafted by the user among multiple chapters. or multiple chapters.

In some embodiments, the terminal device and/or the server may determine the matched one or more chapters based on the matching of the text content associated with at least one structural part of the document and the keywords. Such associated text content may, for example, include the text content of the chapter in the document. Alternatively, such associated text content may also include, for example, the text transcription of the audiovisual content corresponding to the chapter.

For example, the user may only be able to remember that a specific chapter was discussed intensely in the meeting, and can only recall specific keywords in the discussion, but cannot recall the chapter name of the chapter. In this case, the user can enter keywords to find out which chapters' audio-visual content includes the queried keywords, thereby helping the user to locate the information he or she wants to obtain more quickly.

Based on the approach discussed above, for text documents shared in a meeting, the embodiments of the present disclosure can provide information about the structure of the text documents through visual content, thereby improving the efficiency of users in obtaining information.

Presentation

In the present disclosure, a "presentation document" is also referred to as a "presentation", which is used to represent a document used for presentation, such as a slide, which generally has a page-organized structure. Examples of common "presentation documents" may include, for example, a .ppt document and a .dps document.

Fig. 5A shows an example viewing interface 500A of a conference record according to some embodiments of the present disclosure. As shown in Fig. 5A, after receiving a preset operation (eg, a click operation) for the document identifier 220-2, the playback control may present the visual content 510 of the document.

As shown in FIG5A , the visualized content 510 may include a document identifier 520 of the document. Additionally, the document identifier 520 may also be used as an entry for online access to the document or downloading the document. When a user clicks on the document identifier 520, for example, the playback control may guide the user to jump to the online access page of the document, or to the download interface of the document, or directly cause the document to be downloaded locally.

Additionally, as shown in FIG5A , the visualization content 510 may also include at least one descriptive item 530 for representing the structure of the document. Such a descriptive item 530 may correspond to One or more structural parts (e.g., pages) of a document. For example, as shown in FIG. 5A , a description item 530 may correspond to a specific page of a presentation document. In some embodiments, such a description item 530 may, for example, include image description information, such as a screenshot or thumbnail of the page. Additionally, such a description item 530 may, for example, also include text description information, such as a title of the page, etc.

Thus, the user can intuitively understand the structure of the shared document, for example, the page content of different pages, through the visual content 510 of the presentation document.

In some embodiments, for a presentation document, a terminal device or a server of a conference system may render and obtain page contents of different pages in the document based on the contents of the presentation document.

Alternatively, the terminal device and/or the server of the conference system may determine the page content of different pages in the document based on images associated with the sharing process of the presentation document in the conference. For example, the terminal device and/or the server of the conference system may obtain a screen recording file of the conference, and determine the page content of different pages based on changes in the page number portion of the screen recording file after the presentation document sharing begins, or determine the page content of different pages based on the degree of difference between the previous and next frames.

In some embodiments, the playback control may only present the description items of the pages whose corresponding audio-visual content has a duration greater than a predetermined threshold. For example, if a presentation document includes multiple pages, if the duration of a particular page being shared in a meeting is, for example, less than a predetermined threshold, then its corresponding description item may not be presented in the viewing interface of the meeting record, for example. Thus, the embodiments of the present disclosure can further improve the efficiency of users in obtaining content related to document sharing in a meeting.

In some embodiments, if the visual content of the document includes multiple description items, the multiple description items can be presented in the viewing interface in a predetermined order. For example, as shown in Figure 5A, multiple description items 530 can be presented sequentially based on the structural order of the corresponding multiple pages in the document.

Alternatively, the presentation order of the multiple description items 530 in the visual content of the document in the viewing interface may also be based on the order in which the corresponding structural parts (e.g., pages) are shared in the meeting. For example, if the sharing party first shares "page 3" in the presentation document, and then jumps to share "page 6" through a hyperlink, the description item corresponding to "page 6" may be displayed in the viewing interface. to be presented with the description item "Page 3", regardless of their structural order in the presentation document.

Alternatively, the presentation order of multiple description items in the visual content of the document in the viewing interface can also be based on the order of the sharing time of the corresponding structural parts (e.g., pages) in the meeting. For example, if the sharing party spent the most time in the meeting sharing "Page 5" in the presentation document, the description item corresponding to "Page 5" can be presented first, regardless of its structural order in the document.

In some embodiments, as shown in FIG. 5B , upon receiving a preset operation (eg, a hover operation) regarding the description item 530 , the playback control may present description information 540 of a structural portion (eg, a corresponding page) corresponding to the description item 530 .

In some embodiments, such description information 540 may include, for example, an identifier of the corresponding structure part, such as a page number. Alternatively or additionally, such description information 540 may also include, for example, a sharing time corresponding to the structure part, such as a start time, an end time and/or a duration.

Based on this approach, the embodiments of the present disclosure can help users more quickly understand the sharing status of each part of a document.

In some embodiments, the display style of the visual content of the document can also change accordingly with the playback of the audio-visual content. In some embodiments, when a portion of the audio-visual content associated with a specific structural portion is being played, its corresponding description item can be, for example, highlighted. For example, description item 530 can be adjusted to have a highlighted border.

FIG5C shows an example viewing interface 500C according to some embodiments of the present disclosure. As shown in FIG5C , the description item 540 may also include a play indication control 550. When the audio-visual content associated with the page corresponding to the description item 530 is being played, the style of the play indication control 550 may be adjusted. For example, when the audio-visual content associated with the page corresponding to the description item 530 is not being played, the play indication control 550 may not be presented; when the audio-visual content associated with the page corresponding to the description item 530 is being played, the play indication control 550 may be adjusted to a style as shown in FIG5C .

In some embodiments, the play control can indicate the corresponding page related content by adjusting the appropriate display style such as color, grayscale, size, shape, etc. of the play indicator control 550. The audio-visual content is being played.

5D shows an example viewing interface 500D according to some other embodiments of the present disclosure. Different from the style of the play indicator control 550 shown in FIG5C, when the audio-visual content associated with the page corresponding to the description item 540 is being played, the style of the play indicator control 550 can be adjusted to the style shown in FIG5D to indicate the playback progress of the portion of the audio-visual content associated with the page.

For example, taking FIG. 5D as an example, description item 530 may be associated with "page 3" of the document, and the portion of audiovisual content corresponding to the page has a duration of "60 seconds". Thus, the play indication control 550 may also indicate the play progress of the portion of audiovisual content through, for example, a progress bar and/or text style, to indicate that the current playback reaches "25 seconds" of "60 seconds".

In some embodiments, the user can also quickly jump to the portion of audiovisual content corresponding to the corresponding page through the description item 530. In some embodiments, upon receiving a preset operation (e.g., a click or double-click operation) of the description item 530, the play control can jump to the start time (e.g., 46:00) of the portion of audiovisual content related to the page (e.g., page 3) corresponding to the description item 530 and start playing.

In some other embodiments, the playback control may also consider the location where the preset operation occurs. For example, when the user clicks a specific location of the playback indication control 550 of the description item 530, the playback control may start playing a portion of the audiovisual content related to the corresponding page (e.g., page 3) from the moment corresponding to the specific location.

In some embodiments, as discussed above, the viewing interface may also provide, for example, a text control for presenting text content corresponding to the meeting minutes. Similar to the process discussed above with respect to FIG. 4 , when the user, for example, performs a preset operation (e.g., click or double-click) on the description item 530 or when the audiovisual content associated with the structural part associated with the description item 530 is being played, the text control may cause the target text content associated with the structural part (e.g., “the second part”) in the text content to be highlighted relative to other text content. Show.

In some embodiments, making the target text content highlighted relative to other text content may include, for example, increasing the prominence of the target text content displayed in the text control. For example, the display style (e.g., text color, background color, boldness, font size, underline) of the target text content may be adjusted to be more prominent. For example, the target text may be bolded or highlighted.

Alternatively, making the target text content highlighted relative to other text content may also include, for example, reducing the prominence of other text content displayed in the text control. For example, the display style (e.g., text color, background color, boldness, font size, underline) of other text content may be adjusted to be less prominent. For example, the text color of other text content may be adjusted to gray, thereby forming a contrast with the black target text content.

In some embodiments, similar to the above discussion with reference to text documents, the viewing interface of the conference record may also support, for example, a query about the description item 550. Exemplarily, the viewing interface may provide a query entry (not shown) for querying a specific page.

After the user selects the entry, the user may, for example, input one or more keywords desired to be retrieved to initiate a query request. Further, the terminal device and/or the server may determine one or more matching structural parts (eg, pages) based on the acquired one or more keywords.

In some embodiments, the terminal device and/or server may determine the matched one or more pages based on a match between descriptive information associated with at least one structural portion of the document (eg, a page title, a page number, etc.) and keywords.

In some embodiments, the terminal device and/or the server may determine the matched one or more pages based on the matching of the text content associated with at least one structural part of the document and the keyword. Such associated text content may include, for example, the text content of the page in the document. Such text content may be generated based on text recognition of the text in the screen recording. Alternatively, such associated text content may also include, for example, the text content of the page in the document. Corresponding textual transcription of the audiovisual content.

For example, the user may only be able to recall that a particular page was discussed intensely in a meeting, and only be able to recall specific keywords in the discussion. In this case, the user can enter keywords to find out which pages' audio-visual content includes the queried keywords, thereby helping the user locate the information he or she desires to obtain more quickly.

Or, the user may only be able to recall that there are some specific texts in a particular page. In this case, the user can find out which pages' text content includes the queried keyword by inputting the keyword, thereby helping the user to locate the information he or she desires to obtain faster.

Based on the approach discussed above, for a presentation document shared in a meeting, the embodiments of the present disclosure can provide information about the structure of the presentation document through visual content, thereby improving the efficiency of users in obtaining information.

Other sample viewing interfaces

In some embodiments, the visual content of the document may be presented at all times, or may be presented in response to the corresponding audiovisual content portion starting to be played.

FIG6 shows an example viewing interface 600 of a conference record according to some embodiments of the present disclosure. As shown in FIG6 , the viewing interface 600 may, for example, include a playback control 610 for playing the audiovisual content of the conference record of the meeting. In addition, the interface 600 may also include a visualization content 620 of the document shared in the meeting. The specific implementation of the playback control 610 can refer to the part discussed above with respect to FIGS. 3A to 3D, 4, and 5A to 5D, which will not be repeated here.

In addition, it should be understood that the presentation method and interaction logic of the visualization content 620 can be designed accordingly with reference to the parts discussed above with reference to FIGS. 3A to 3D, 4, and 5A to 5D, and the difference may only be that its display position is not under the timeline, and the triggering logic of the presentation may not depend on the interaction with the document identifier 220. Therefore, the presentation method and interaction logic of the visualization content 620 will not be described in detail here.

Regarding the presentation of the visualization content 620, in some embodiments, the viewing interface 600 may always present the visualization content of all documents shared in the corresponding meeting. Alternatively, the viewing interface 600 may present the visualization content of the documents shared in the meeting that can obtain the structural information. content.

In other embodiments, when the audiovisual content corresponding to the document starts to be played, the viewing interface 600 starts to present the visual content 620 of the document. Additionally, when the corresponding audiovisual content ends playing, the visual content 620 can stop being presented.

Based on this approach, the embodiments of the present disclosure enable users to quickly obtain relevant information about document sharing in a meeting, and enable users to conveniently obtain structural information of shared documents (for example, chapter information of text documents or page information of presentation documents, etc.).

Presentation of hotly discussed events

In some embodiments, embodiments of the present disclosure can provide relevant information about hot discussions in historical activities on a viewing interface of audio-visual content.

FIG7 shows an example viewing interface 700 of audiovisual content according to some embodiments of the present disclosure. As shown in FIG7 , the viewing interface 700 may include a play control for playing audiovisual content (e.g., audio content or video content) related to the historical activity. The viewing interface 200A may be provided by, for example, an appropriate electronic device, examples of which may include, but are not limited to, a desktop computer, a laptop computer, a smart phone, a tablet computer, a personal digital assistant, or a smart wearable device.

As shown in FIG. 7 , the playback control may include a timeline 710, which may be used, for example, to indicate the playback progress of the audio-visual content. In some embodiments, as shown in FIG. 7 , the timeline 210 may present graphical information corresponding to the audio waveform of the audio-visual content. In this way, the user may more easily understand which parts of the audio-visual content are worthy of attention and which parts, such as those with less audio waveforms, may be temporarily ignored. Thus, the viewing interface 700 may improve the efficiency of the user in acquiring content.

In some embodiments, as shown in FIG. 7 , the viewing interface 700 may further include a hot discussion mark 720 , and such a hot discussion mark 720 may be used to indicate that the discussion heat of the corresponding target time period is greater than a threshold heat.

In some embodiments, the display style of the hot discussion mark 720 may be determined based on the speaker marks of multiple speakers who participated in the hot discussion during the target time period. For example, the hot discussion mark 720 may present image marks (eg, avatars) of multiple speakers.

In some embodiments, if the number of speakers is greater than a threshold number, the hot discussion identifier 720 may present, for example, speaker identifiers of a predetermined number of speakers among the plurality of speakers.

In some embodiments, the discussion heat can be determined based on the number of speakers who participated in the speech within a predetermined time period. For example, if the number of speakers within a unit time period (e.g., every 30 seconds) is greater than a threshold number, then the discussion heat can be determined to be greater than the threshold heat.

In some embodiments, the discussion heat can also be determined based on audio parameter information associated with a predetermined duration. Exemplarily, such audio parameter information may include, for example, sound intensity. Exemplarily, if the average sound intensity within a unit duration (e.g., every 30 seconds) is greater than a threshold intensity, then the discussion heat can be determined to be greater than the threshold heat.

In this way, the embodiments of the present disclosure can enable users to intuitively understand which time periods in the audio-visual content have experienced intense discussions, thereby helping users to more quickly understand the key parts of the audio-visual content.

In some embodiments, after receiving a preset operation for the hot discussion identifier 720 (for example, appropriate operations such as clicking, sliding, double-clicking or hovering), the viewing interface 700 can also present discussion description information 730 associated with the hot discussion identifier 720.

In some embodiments, the discussion description information 730 may indicate time description information about the target time period. For example, the discussion description information 730 may indicate at least one of the time length, start time, and end time of the target time corresponding to the hot topic discussion.

Alternatively or additionally, the discussion description information 730 may indicate speaker description information of multiple speakers associated with the target time period. Such speaker description information may, for example, indicate the number of multiple speakers, a graphic identifier (e.g., avatar) and/or a text identifier (e.g., nickname or user name) of each speaker.

Alternatively or additionally, the discussion description information 730 may indicate content description information about the speech contents of multiple speakers. For example, such content description information may be a text transcription of all speech contents about the target period, or a text summary automatically generated based on all speech contents. As another example, such content description information may also be a text transcription of all speech contents about the target period. It may indicate a text transcription of the speech content of each speaker, or a text summary generated based on the speech content of each speaker.

In this way, the embodiments of the present disclosure can enable users to more quickly obtain relevant content of the hot discussion section, thereby improving the efficiency of user information acquisition.

It should be understood that the various layouts and styles shown in FIG. 2A to FIG. 7 are for exemplary purposes, and those skilled in the art may conceive of adopting other appropriate layout variations and/or style variations without violating the spirit of the present disclosure.

Example Process

FIG8 shows a flow chart of an example process 800 for viewing audiovisual content according to some embodiments of the present disclosure. Process 800 may be implemented at a suitable electronic device. Examples of such electronic devices may include, but are not limited to, desktop computers, laptop computers, smart phones, tablet computers, personal digital assistants, or smart wearable devices.

As shown in FIG. 8 , in block 810 , the electronic device provides a viewing interface for audio-visual content, where the viewing interface includes a play control for playing the audio-visual content, where the audio-visual content corresponds to a record of a historical activity.

In box 820, the electronic device presents an interaction identifier at a target position associated with the timeline of the playback control, where the interaction identifier is used to indicate that an interaction event corresponding to the interaction identifier has occurred in the historical activity at the target time indicated by the target position.

In some embodiments, the audiovisual content includes a meeting record for a meeting, and the interaction identifier includes a document identifier, where the document identifier is used to indicate that the target document is shared into the meeting at a target time indicated by the target position.

In some embodiments, the method further includes: in response to a first preset operation for the document identifier, presenting first description information for the target document. In some embodiments, the first description information includes at least one of the following: a document identifier of the target document, a sharing party of the target document, a sharing time of the target document, an administrator of the target document, and a document type of the target document.

In some embodiments, the method further includes: in response to a second preset operation for the document identification, presenting a visualization content of the target document shared in the meeting, the visualization content being used to Characterizes the structure of the target document.

In some embodiments, the visualization content includes at least one description item corresponding to at least one structural part of the target document. In some embodiments, the at least one description item includes: text description information and/or image description information.

In some embodiments, the presentation order of at least one description item is determined based on at least one of the following: the structural order of at least one structural part in the target document, the sharing order of at least one structural part in the conference, and the sharing duration of at least one structural part in the conference.

In some embodiments, at least one structure portion is shared in the conference for a duration greater than a predetermined threshold.

In some embodiments, the method further includes: in response to a portion of the audiovisual content associated with a first structural part of the at least one structural part being played, causing a first description item corresponding to the first structural part to be highlighted.

In some embodiments, the first descriptive item includes a play indication control, and causing the first descriptive item corresponding to the first structural portion to be highlighted includes: adjusting a display style of the play indication control to indicate that a portion of the audiovisual content associated with the first structural portion is being played.

In some embodiments, the display style of the play indicator control is adjusted to indicate the play progress of the portion of the audiovisual content.

In some embodiments, the method also includes: in response to a third preset operation for a second description item in at least one description item, presenting second description information for a second structural part corresponding to the second description item, wherein the second description information includes: an identifier of the second structural part and/or a sharing time of the second structural part.

In some embodiments, the method further includes: in response to a fourth preset operation on a third description item among the at least one description item corresponding to the third structural portion, causing the audiovisual content associated with the third structural portion to be played.

In some embodiments, the viewing interface also includes a text control, which is used to present text content corresponding to the audio-visual content. The method also includes: causing target text content associated with the third structural part in the text content to be highlighted in the text control relative to other text content.

In some embodiments, causing target text content associated with the third structural portion in the text content to be highlighted relative to other text content in the text control includes: increasing the prominence of the target text content displayed in the text control; and/or decreasing the prominence of other text content displayed in the text control.

In some embodiments, the method further includes: in response to receiving a query request indicating a target keyword, determining a target structural part that matches the target keyword from at least one structural part; and providing a target description item corresponding to the target structural part as a response to the query request.

In some embodiments, the target structural portion is determined based on a comparison between the target keyword and descriptive information and/or textual content associated with at least one structural portion.

In some embodiments, the target document is a text document, at least one structural part corresponds to at least one chapter of the text document, and at least one description item is generated based on a chapter identifier of the at least one chapter.

In some embodiments, the text document is a cloud document, and the chapter identifier of at least one chapter is determined based on the chapter structure of the cloud document.

In some embodiments, the target document is a presentation document, the at least one structural portion corresponds to at least one page of the presentation document, and the at least one description item is generated based on page content of the at least one page.

In some embodiments, the page content of at least one page is determined based on an image associated with the sharing process of the presentation document in the meeting.

In some embodiments, the method further includes: providing a portal for viewing or downloading the target document.

In some embodiments, the audio-visual content includes a meeting record for a meeting, and the interaction identifier includes a hot discussion identifier, which is used to indicate that the discussion heat of the meeting in the target time period indicated by the target location is greater than a threshold heat.

In some embodiments, the hot discussion identifier is determined based on speaker identifiers of multiple speakers associated with the target time period.

In some embodiments, the method further includes: in response to a fifth preset operation for the hot discussion identifier, presenting discussion description information associated with the hot discussion identifier.

In some embodiments, the discussion description information indicates at least one of the following: time description information about the target time period, speaker description information about multiple speakers associated with the target time period, and content description information about speech content of the multiple speakers.

In some embodiments, discussion interest is determined based at least on the number of speakers associated with the target time period.

In some embodiments, the timeline also presents graphical information corresponding to the audio waveform of the audiovisual content.

In some embodiments, the interaction event includes: online chat and/or comments occurring during the meeting.

FIG9 shows a flow chart of an example process 900 for viewing audiovisual content according to some embodiments of the present disclosure. Process 900 may be implemented at a suitable electronic device. Examples of such electronic devices may include, but are not limited to, desktop computers, laptop computers, smart phones, tablet computers, personal digital assistants, or smart wearable devices.

As shown in FIG. 9 , in block 910 , the electronic device provides a viewing interface for audio-visual content, where the viewing interface includes a play control for playing the audio-visual content, where the audio-visual content corresponds to a record of a historical activity.

In block 920 , the electronic device presents visualization information of a target document associated with the audiovisual content in a viewing interface, where the visualization information is used to represent a structure of the target document.

In some embodiments, the audio-visual content includes a meeting record of a meeting, and the target document is a document shared in the meeting.

In some embodiments, the visualization content includes at least one description item corresponding to at least one structural part of the target document, and the at least one description item includes: text description information and/or image description information.

In some embodiments, the presentation order of at least one description item is based on: the structural order of at least one structural part in the target document, the sharing order of at least one structural part in the conference, or the sharing duration of at least one structural part in the conference.

In some embodiments, the method further comprises: in response to at least one structural portion A portion of the audiovisual content associated with the first structural portion is being played, so that the first description item corresponding to the first structural portion is highlighted.

In some embodiments, the target document is a text document, and at least one structural part is The at least one description item corresponds to at least one section of the text document, and the at least one description item is generated based on the section identifier of the at least one section.

In some embodiments, the timeline of the playback control also presents graphical information corresponding to the audio waveform of the audiovisual content.

In some embodiments, the method further includes: presenting, in association with the timeline of the playback control, an interaction identifier corresponding to the interaction behavior in the meeting, the interaction behavior including at least one of the following: file sharing, online chatting, and commenting.

In some embodiments, presenting visualization information of the target document shared in the meeting in the viewing interface includes: in response to a portion of the audiovisual content associated with the target document starting to be played, presenting visualization information of the target document shared in the meeting in the viewing interface.

Example devices and equipment

The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Fig. 10 shows a schematic structural block diagram of a device 1000 for viewing audio-visual content according to some embodiments of the present disclosure.

As shown in FIG. 10 , the apparatus 1000 includes a first providing module 1010 configured to provide a viewing interface for audio-visual content, the viewing interface including a play control for playing the audio-visual content, and the audio-visual content corresponds to a record of a historical activity.

In addition, the device 1000 also includes a first presentation module 1020, which is configured to present an interaction identifier at a target position associated with the timeline of the playback control, and the interaction identifier is used to indicate that an interaction event corresponding to the interaction identifier has occurred in the historical activity at a target time indicated by the target position.

In some embodiments, the first presentation module 1020 is further configured to present first description information for the target document in response to a first preset operation for the document identifier. In some embodiments, the first description information includes at least one of the following: the document identifier of the target document, the sharing party of the target document, the sharing time of the target document, the management party of the target document, and the document type of the target document.

In some embodiments, the first presentation module 1020 is further configured to: in response to a second preset operation for document identification, present visual content of the target document shared in the meeting, where the visual content is used to characterize the structure of the target document.

In some embodiments, the first presentation module 1020 is further configured to: in response to a portion of audiovisual content associated with a first structural part of at least one structural part being played, cause a first description item corresponding to the first structural part to be highlighted.

In some embodiments, the first description item includes a play indication control, and the first presentation module 1020 is further configured to: adjust the display style of the play indication control to indicate that a portion of the audiovisual content associated with the first structural portion is being played.

In some embodiments, the first presentation module 1020 is further configured to: in response to a third preset operation on a second description item in the at least one description item, present a description item related to the second description item; The second description information of the second structural part corresponding to the item, wherein the second description information includes: an identifier of the second structural part and/or a sharing time of the second structural part.

In some embodiments, the first presentation module 1020 is further configured to: in response to a fourth preset operation on a third description item in at least one description item corresponding to the third structural portion, cause the audiovisual content associated with the third structural portion to be played.

In some embodiments, the viewing interface also includes a text control, which is used to present text content corresponding to the audio-visual content. The first presentation module 1020 is also configured to: cause the target text content associated with the third structural part in the text content to be highlighted in the text control relative to other text content.

In some embodiments, the first presentation module 1020 is further configured to: increase the prominence of the target text content displayed in the text control; and/or reduce the prominence of other text content displayed in the text control.

In some embodiments, the first presentation module 1020 is further configured to: in response to receiving a query request indicating a target keyword, determine a target structural part that matches the target keyword from at least one structural part; and provide a target description item corresponding to the target structural part as a response to the query request.

In some embodiments, the first presentation module 1020 is further configured to: provide a The entry to view or download the target document.

In some embodiments, the first presentation module 1020 is further configured to: in response to a fifth preset operation for the hot discussion identifier, present discussion description information associated with the hot discussion identifier.

FIG. 11 shows a schematic structural block diagram of an apparatus 1100 for viewing audio-visual contents according to other embodiments of the present disclosure.

As shown in FIG. 11 , the apparatus 1100 includes a second providing module 1110 configured to provide a viewing interface for audio-visual content, the viewing interface including a play control for playing the audio-visual content, and the audio-visual content corresponds to a record of a historical activity.

In addition, the apparatus 1100 further includes a second presentation module 1120 configured to present visual information of a target document associated with the audio-visual content in the viewing interface, where the visual information is used to represent the structure of the target document.

In some embodiments, the visualization content includes at least one structural component of the target document. At least one description item corresponding to each of the description items, wherein the at least one description item includes: text description information and/or image description information.

In some embodiments, the second presentation module 1120 is further configured to: in response to a portion of audiovisual content associated with a first structural part of at least one structural part being played, cause a first description item corresponding to the first structural part to be highlighted.

In some embodiments, the first description item includes a play indication control, and the second presentation module 1120 is further configured to adjust a display style of the play indication control to indicate that a portion of the audiovisual content associated with the first structural portion is being played.

In some embodiments, the second presentation module 1120 is further configured to: in response to a third preset operation for a second description item in at least one description item, present second description information for a second structural part corresponding to the second description item, wherein the second description information includes: an identifier of the second structural part and/or a sharing time of the second structural part.

In some embodiments, the second presentation module 1120 is further configured to: in response to a fourth preset operation on a third description item in at least one description item corresponding to the third structural portion, cause the audiovisual content associated with the third structural portion to be played.

In some embodiments, the viewing interface also includes a text control, which is used to present text content corresponding to the audio-visual content. The second presentation module 1120 is also configured to: cause the target text content associated with the third structural part in the text content to be highlighted in the text control relative to other text content.

In some embodiments, the second presentation module 1120 is further configured to: increase the prominence of the target text content displayed in the text control; and/or reduce the prominence of other text content displayed in the text control.

In some embodiments, the second presentation module 1120 is further configured to: in response to receiving a query request indicating a target keyword, determine a target structural part that matches the target keyword from at least one structural part; and provide a target description item corresponding to the target structural part as a response to the query request.

In some embodiments, the second presentation module 1120 is further configured to present interaction identifiers corresponding to interaction behaviors in the meeting in association with the timeline of the playback control, the interaction behaviors including at least one of the following: file sharing, online chatting, and commenting.

In some embodiments, the second presentation module 1120 is further configured to present visual information of the target document shared in the meeting in the viewing interface in response to the portion of the audio-visual content associated with the target document starting to be played.

The units included in the apparatus 1000 and/or the apparatus 1100 may be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units may be implemented using software and/or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in the apparatus 1000 and/or the apparatus 1100 may be implemented at least in part by one or more Hardware logic components are used to implement the system. By way of example and not limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

12 shows a block diagram of a computing device/server 1200 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the computing device/server 1200 shown in FIG12 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein.

As shown in Figure 12, computing device/server 1200 is in the form of a general computing device. The components of computing device/server 1200 may include, but are not limited to, one or more processors or processing units 1210, memory 1220, storage device 1230, one or more communication units 1240, one or more input devices 1260, and one or more output devices 1260. Processing unit 1210 may be an actual or virtual processor and is capable of performing various processes according to a program stored in memory 1220. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to increase the parallel processing capabilities of computing device/server 1200.

The computing device/server 1200 typically includes a plurality of computer storage media. Such media may be any available media accessible to the computing device/server 1200, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1220 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1230 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and/or data (e.g., training data for training) and may be accessed within the computing device/server 1200.

The computing device/server 1200 may further include additional removable/non-removable, volatile/non-volatile storage media. Although not shown in FIG. 12 , a magnetic disk drive for reading or writing from a removable, non-volatile magnetic disk (e.g., a “floppy disk”) and an optical disk drive for reading or writing from a removable, non-volatile optical disk may be provided. In this case, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1220 may include a computer program product 1225 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

The communication unit 1240 enables communication with other computing devices via a communication medium. Additionally, the functionality of the components of the computing device/server 1200 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the computing device/server 1200 can operate in a networked environment using logical connections to one or more other servers, a network personal computer (PC), or another network node.

Input device 1250 may be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1260 may be one or more output devices, such as a display, speaker, printer, etc. Computing device/server 1200 may also communicate with one or more external devices (not shown) as needed, such as storage devices, display devices, etc., with one or more devices that enable a user to interact with computing device/server 1200, or with any device that enables computing device/server 1200 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.) through communication unit 1240. Such communication may be performed via an input/output (I/O) interface (not shown).

According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which one or more computer instructions are stored, wherein the one or more computer instructions are executed by a processor to implement the method described above.

Various aspects of the present disclosure are described herein with reference to the flowcharts and/or block diagrams of the methods, devices (systems) and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and/or block diagram and the combination of each box in the flowchart and/or block diagram can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, A device is generated to implement the functions/actions specified in one or more boxes in the flowchart and/or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions make the computer, programmable data processing device and/or other equipment work in a specific way, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions/actions specified in one or more boxes in the flowchart and/or block diagram.

Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions/actions specified in one or more boxes in the flowchart and/or block diagram.

The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the marketplace, or to enable other persons of ordinary skill in the art to understand the implementations disclosed herein.

Claims

A method for viewing audiovisual content, comprising:

providing a viewing interface for audio-visual content, the viewing interface including a play control for playing the audio-visual content, the audio-visual content corresponding to a record of historical activity; and

An interaction identifier is presented at a target position associated with the timeline of the playback control, wherein the interaction identifier is used to indicate that an interaction event corresponding to the interaction identifier has occurred in the historical activity at a target time indicated by the target position.
The method according to claim 1, wherein the audio-visual content includes a meeting record for a meeting, and the interaction identifier includes a document identifier, wherein the document identifier is used to indicate that a target document is shared into the meeting at a target time indicated by the target location.
The method according to claim 2, further comprising:

In response to a first preset operation for the document identification, first description information for the target document is presented.
According to the method of claim 3, the first description information includes at least one of the following: the document identification of the target document, the sharing party of the target document, the sharing time of the target document, the manager of the target document, and the document type of the target document.
The method according to claim 2, further comprising:

In response to a second preset operation for the document identification, visual content of the target document shared in the conference is presented, where the visual content is used to represent the structure of the target document.
The method according to claim 5, wherein the visualization content includes at least one description item corresponding to at least one structural part of the target document.
The method according to claim 6, wherein the at least one description item comprises: text description information and/or image description information.
The method according to claim 6, wherein the presentation order of the at least one description item is determined based on at least one of the following:

The structural order of the at least one structural part in the target document,

the order in which the at least one structural part is shared in the conference, and

The duration for which the at least one structural part is shared in the conference.
The method according to claim 6, wherein the at least one structural part is shared in the conference for a time period greater than a predetermined threshold.
The method according to claim 6, further comprising:

In response to a portion of audiovisual content associated with a first structural portion of the at least one structural portion being played, a first description item corresponding to the first structural portion is highlighted.
The method according to claim 10, wherein the first description item includes a play indicator control, and causing the first description item corresponding to the first structural portion to be highlighted comprises:

The display style of the play indication control is adjusted to indicate that the portion of the audio-visual content associated with the first structural portion is being played.
The method according to claim 11, wherein the display style of the play indication control is adjusted to indicate the play progress of the portion of the audio-visual content.
The method according to claim 6, further comprising:

In response to a third preset operation on a second description item of the at least one description item, presenting second description information on a second structural portion corresponding to the second description item,

The second description information includes: an identifier of the second structural part and/or a sharing time of the second structural part.
The method according to claim 6, further comprising:

In response to a fourth preset operation on a third description item among the at least one description item corresponding to the third structural portion, the audiovisual content associated with the third structural portion is played.
The method according to claim 14, wherein the viewing interface further comprises a text control, wherein the text control is used to present text content corresponding to the audiovisual content, and the method further comprises:

Make the target text content associated with the third structural part in the text content The text content is highlighted relative to other text contents in the text control.
The method according to claim 15, wherein causing the target text content associated with the third structural part in the text content to be highlighted relative to other text content in the text control comprises:

Improving the prominence of the target text content displayed in the text control; and/or

The prominence with which the other text content is displayed in the text control is reduced.
The method according to claim 6, further comprising:

In response to receiving a query request indicating a target keyword, determining a target structural part matching the target keyword from the at least one structural part; and

A target description item corresponding to the target structure portion is provided as a response to the query request.
The method of claim 17, wherein the target structural portion is determined based on a comparison between the target keyword and descriptive information and/or text content associated with the at least one structural portion.
The method according to claim 6, wherein the target document is a text document, the at least one structural part corresponds to at least one chapter of the text document, and the at least one description item is generated based on the chapter identifier of the at least one chapter.
The method according to claim 19, wherein the text-based document is a cloud document, and the chapter identifier of the at least one chapter is determined based on the chapter structure of the cloud document.
The method according to claim 6, wherein the target document is a presentation document, the at least one structural part corresponds to at least one page of the presentation document, and the at least one description item is generated based on the page content of the at least one page.
The method of claim 21, wherein the page content of the at least one page is determined based on an image associated with the sharing process of the presentation document in the conference.
The method according to claim 2, further comprising:

A portal is provided for viewing or downloading the target document.
According to the method according to claim 1, the audio-visual content includes a meeting record for a meeting, and the interactive identifier includes a hot discussion identifier, and the hot discussion identifier is used to indicate that the discussion heat of the meeting in the target time period indicated by the target location is greater than a threshold heat.
The method according to claim 24, wherein the hot discussion identifier is determined based on speaker identifiers of multiple speakers associated with the target time period.
The method according to claim 24, further comprising:

In response to a fifth preset operation for the hot discussion identifier, discussion description information associated with the hot discussion identifier is presented.
The method of claim 26, wherein the discussion description information indicates at least one of the following:

Time description information about the target period,

speaker description information about a plurality of speakers associated with the target time period, and

Content description information about the speech contents of the multiple speakers.
The method of claim 24, wherein the discussion heat is determined based at least on the number of speakers associated with the target time period.
The method of claim 1, wherein the timeline also presents graphical information corresponding to an audio waveform of the audiovisual content.
The method according to any one of claims 2 to 29, wherein the interaction event comprises: online chat and/or comments occurring in the meeting.
A method for viewing audiovisual content, comprising:

providing a viewing interface for audio-visual content, the viewing interface including a play control for playing the audio-visual content, the audio-visual content corresponding to a record of historical activity; and

Visual information of a target document associated with the audio-visual content is presented in the viewing interface, where the visual information is used to represent the structure of the target document.
The method according to claim 31, wherein the audio-visual content includes a meeting record for a meeting, and the target document is a document shared in the meeting.
The method according to claim 31, wherein the target document is a presentation document, and the visual content includes at least one descriptive item corresponding to at least one structural part of the presentation document.
According to the method of claim 33, the at least one structural part corresponds to at least one page of the presentation document, and the at least one description item is generated based on the page content of the at least one page.
The method of claim 34, wherein the page content of the at least one page is determined based on an image associated with a sharing process of the presentation document in a conference.
The method of claim 31, wherein the audiovisual content comprises a meeting record for a meeting, and the method further comprises:

Discussion description information associated with the conference is presented in the viewing interface.
The method of claim 36, wherein the discussion description information indicates at least one of the following:

Speaker description information about the multiple speakers participating in the discussion, and

Content description information about the speech contents of the multiple speakers.
A device for viewing audio-visual content, comprising:

A first providing module is configured to provide a viewing interface for audio-visual content, the viewing interface including a play control for playing the audio-visual content, the audio-visual content corresponding to a record of a historical activity; and

The first presentation module is configured to present an interaction identifier at a target position associated with the timeline of the playback control, wherein the interaction identifier is used to indicate that an interaction event corresponding to the interaction identifier has occurred at a target time indicated by the target position in the historical activity.
A device for viewing audio-visual content, comprising:

a second providing module configured to provide a viewing interface for audio-visual content, the viewing interface comprising a play control for playing the audio-visual content, the audio-visual content corresponding to a record of a historical activity; and

The second presentation module is configured to present visual information of a target document associated with the audio-visual content in the viewing interface, wherein the visual information is used to represent the target document. The structure of the document.
An electronic device, comprising:

at least one processing unit; and

At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to perform a method according to any one of claims 1 to 30 or 31 to 37.
A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the method according to any one of claims 1 to 30 or 31 to 37 is implemented.