CN116980631A

CN116980631A - File processing method, apparatus, program product, computer device, and medium

Info

Publication number: CN116980631A
Application number: CN202211439957.7A
Authority: CN
Inventors: 黄铁鸣; 曾键; 叶波; 李斌; 彭向阳
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2022-11-17
Filing date: 2022-11-17
Publication date: 2023-10-31

Abstract

The application discloses a file processing method, a device, a program product, a computer device and a medium, wherein the method comprises the following steps: in the live broadcast process, if the operation of opening the multimedia file in the live broadcast interface is detected, acquiring the file interface; the file interface contains the file content of the opened target multimedia file; and embedding the file interface into the live interface to display the file content of the target multimedia file in the live interface. By adopting the method and the device, the mode of displaying the file content of the target multimedia file in the live broadcast process can be enriched, and the convenience of the live broadcast target multimedia file is improved.

Description

File processing method, apparatus, program product, computer device, and medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a file processing method, apparatus, program product, computer device, and medium.

Background

With the development of live broadcasting technology, net lessons are also emerging. In the existing application, if a teacher needs to live ppt (presentation) for watching students in the live course of surfing the net by live broadcasting, then additional operation is generally needed to share the whole screen with the students, so that the students can watch the ppt opened interface in the screen, and the live ppt operation is complicated in the live broadcasting process.

Disclosure of Invention

The application provides a file processing method, a device, a program product, computer equipment and a medium, which can enrich the mode of displaying the file content of a target multimedia file in the live broadcast process and improve the convenience of the live broadcast target multimedia file.

In one aspect, the present application provides a method for processing a file, including:

in the live broadcast process, if the operation of opening the multimedia file in the live broadcast interface is detected, acquiring the file interface; the file interface contains the file content of the opened target multimedia file;

and embedding the file interface into the live interface to display the file content of the target multimedia file in the live interface.

In one aspect, the present application provides another method for processing a file, including:

displaying a live broadcast interface;

in response to an operation of opening the multimedia file in the live interface, file contents of the opened target multimedia file are displayed in the live interface.

In one aspect, the present application provides a document processing apparatus, including:

the acquisition module is used for acquiring a file interface if detecting the operation of opening the multimedia file in the live interface in the live broadcast process; the file interface contains the file content of the opened target multimedia file;

And the embedding module is used for embedding the file interface into the live interface so as to display the file content of the target multimedia file in the live interface.

The live interface is displayed based on the first thread; if the operation of opening the multimedia file in the live interface is detected, the mode of acquiring the file interface by the acquisition module comprises the following steps:

if the operation of opening the multimedia file in the live interface is detected, calling a first thread Cheng Chuangjian and a second thread;

and calling a second thread to acquire a file interface.

The method for embedding the file interface into the live interface by the embedding module comprises the following steps:

invoking a second thread to submit the acquired file interface to the first thread;

and calling the first thread to embed the file interface into the live interface.

The method for calling the second thread to acquire the file interface by the embedded module comprises the following steps:

calling a second thread to acquire a target multimedia file to be opened;

calling a second thread to acquire a control object of a file opening program;

and calling a file opening program to open the target multimedia file based on the control object, and creating a file interface containing file contents of the opened target multimedia file.

Creating a space occupying view of a file interface in a live interface;

setting the live interface as a parent interface of the file interface, and displaying the file interface at a space occupying view in the parent interface;

the display size of the file interface is the same as the view size of the occupied view.

Wherein, the device is also used for:

if the view size of the occupied view changes, acquiring the view size of the occupied view after the change;

and adjusting the display size of the file interface in the live interface to be the changed view size.

The target multimedia file is a target document, wherein the target document comprises N pages of document contents, and N is a positive integer; the device is also used for:

responding to the label starting operation for the target document, and displaying a transparent interface on the displayed file interface; the transparent interface is an interface which is independently displayed on the file interface, and the interface size of the transparent interface is the same as the interface size of the file interface;

if the ith page of document content in the N pages of document content is currently displayed in the file interface, generating the labeling content for the ith page of document content on the displayed transparent interface in response to the labeling operation for the displayed ith page of document content on the transparent interface; i is a positive integer less than or equal to N;

And associating the annotation content with the ith page of document content, and storing the annotation content after associating with the ith page of document content.

Wherein, the device is also used for:

recording the file interface embedded in the live broadcast interface to obtain a recorded video of the file interface;

transmitting the recorded video to the audience terminal, so that the audience terminal plays the recorded video.

Wherein, the device is also used for:

generating a switching mark for the multimedia file in response to an operation of switching the multimedia file on the live interface;

reporting the switching mark to a live broadcast background, so that the live broadcast background pushes the switching mark to a spectator terminal;

the audience terminal is used for displaying switching prompt information for the multimedia file according to the switching mark.

Wherein, after responding to the operation of switching to open the multimedia file in the live interface, the device is further used for:

acquiring other multimedia files for switching the target multimedia file, and acquiring a target interface containing file contents of the opened other multimedia files;

and switching the file interface embedded in the live interface into a target interface.

Canceling the display of the live broadcast picture in the live broadcast interface, and embedding the file interface into the live broadcast interface without displaying the live broadcast picture;

independently displaying a live sub-interface on a live interface embedded with a file interface; the display size of the live broadcast sub-interface is smaller than that of the file interface;

and displaying the live broadcast picture in the live broadcast sub-interface.

In one aspect, the present application provides another document processing apparatus, including:

the first display module is used for displaying a live broadcast interface;

and the second display module is used for responding to the operation of opening the multimedia file in the live interface and displaying the file content of the opened target multimedia file in the live interface.

The file content of the opened target multimedia file is contained in a file interface, and the file interface is displayed in a live broadcast interface;

if the display position of the live broadcast interface changes, the display position of the file interface changes along with the change of the display position of the live broadcast interface, so that the relative position between the display position before the change of the file interface and the display position before the change of the live broadcast interface is the same as the relative position between the display position after the change of the file interface and the display position after the change of the live broadcast interface.

if the display size of the live broadcast interface changes, the display size of the file interface changes along with the change of the display size of the live broadcast interface, so that the size ratio between the display size before the change of the file interface and the display size before the change of the live broadcast interface is equal to the size ratio between the display size after the change of the file interface and the display size after the change of the live broadcast interface.

The live interface also comprises a control for operating the file content of the displayed target multimedia file;

wherein the control for operating the file content of the displayed target multimedia file comprises at least one of the following: the method comprises the steps of adjusting the display progress of the file content of the displayed target multimedia file, zooming the file content of the displayed target multimedia file, and editing the file content of the displayed target multimedia file.

Wherein, after opening the target multimedia file in the live interface, the above device is further used for:

displaying a live sub-interface on the live interface;

The live broadcast sub-interface is an interface which is independently displayed on the live broadcast interface.

Wherein, the device is also used for:

and responding to the moving operation of the live sub-interface, and displaying the live sub-interface to the moved interface position.

Wherein, the device is also used for:

and displaying the content for marking the file content of the target multimedia file in response to the marking operation for the file content of the target multimedia file displayed in the live interface.

Wherein, the device is also used for:

responding to the switching operation of the opened target multimedia file, and displaying a file selection interface;

and switching and displaying the file content of the target multimedia file displayed in the live broadcast interface as the file content of other multimedia files selected in the file selection interface.

Wherein, the live broadcast process of the live broadcast interface is initiated in the group; the device is also used for:

and in response to a sharing operation for the target multimedia file opened in the live interface, sharing the target multimedia file into the group.

The target multimedia file is a presentation file, the presentation file comprises M pages of file contents, and j and M are positive integers, wherein j is smaller than or equal to M, and j is the j page file content currently displayed in the M pages of file contents in the live interface;

The device is also used for:

and responding to page turning operation for the presentation file, switching and displaying the j-th file content displayed in the live broadcast interface as the next file content or the last file content of the j-th file content in the M-page file contents.

responding to the content editing operation, and displaying an editing interface on the live broadcast interface; the editing interface is an interface independently displayed on the live interface;

in response to an editing operation in the editing interface, edited content is displayed in the editing interface.

The device is also used for:

and in response to the sharing operation of the editing interface containing the edited content, sharing the screenshot of the editing interface to the target object.

In one aspect the application provides a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the method of one aspect of the application.

An aspect of the present application provides a computer readable storage medium storing a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of the above aspect.

According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in the various alternatives of the above aspect and the like.

In the live broadcast process, if the operation of opening the multimedia file in the live broadcast interface is detected, acquiring the file interface; the file interface contains the file content of the opened target multimedia file; and embedding the file interface into the live interface to display the file content of the target multimedia file in the live interface. Therefore, in the live broadcast process, when the multimedia file is required to be live broadcast, the method provided by the application can only acquire the file interface containing the file content of the opened target multimedia file, and can embed the file interface into the live broadcast interface for display, so that the mode of live broadcasting the multimedia file in the live broadcast process is enriched, and the operation of opening the multimedia file can be directly executed on the live broadcast interface, and the convenience of live broadcasting the multimedia file in the live broadcast process is also improved.

Drawings

In order to more clearly illustrate the application or the technical solutions of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it being obvious that the drawings in the description below are only some embodiments of the application, and that other drawings can be obtained from them without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of a network architecture according to the present application;

FIG. 2 is a schematic view of an interface display provided by the present application;

FIG. 3 is a schematic flow chart of a document processing method provided by the application;

FIGS. 4 a-4 b are schematic views of a scene of an interface follow-up change provided by the present application;

FIG. 5 is a schematic view of a scenario illustrating a positional relationship provided by the present application;

FIG. 6 is a schematic view of another interface display provided by the present application;

FIG. 7 is a schematic flow chart of a file acquisition interface provided by the application;

FIG. 8 is a schematic flow chart of a method for displaying a file in a switching manner;

FIG. 9 is a flow chart of another method for processing files according to the present application;

FIG. 10 is an interface schematic of a live interface provided by the present application;

FIG. 11 is a schematic diagram of a document processing apparatus according to the present application;

FIG. 12 is a schematic view of another document processing apparatus according to the present application;

fig. 13 is a schematic structural diagram of a computer device according to the present application.

Detailed Description

The following description of the embodiments of the present application will be made more apparent and fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the application are shown. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The application relates to cloud technology. Cloud Technology (Cloud Technology) refers to a hosting Technology that unifies serial resources such as hardware, software, network and the like in a wide area network or a local area network to realize calculation, storage, processing and sharing of data.

The cloud technology is based on the general names of network technology, information technology, integration technology, management platform technology, application technology and the like applied by the cloud computing business mode, can form a resource pool, and is flexible and convenient as required. Cloud computing technology will become an important support. Background services of technical networking systems require a large amount of computing, storage resources, such as video websites, picture-like websites, and more portals. Along with the high development and application of the internet industry, each article possibly has an own identification mark in the future, the identification mark needs to be transmitted to a background system for logic processing, data with different levels can be processed separately, and various industry data needs strong system rear shield support and can be realized only through cloud computing.

In the application, data interaction can be carried out through the cloud between the live broadcast end and the live broadcast background and between the live broadcast background and the audience end.

Firstly, it should be noted that, in the present application, before collecting relevant data of a user (such as user data of a multimedia file and a live broadcast picture) and during collecting relevant data of a user, a prompt interface or a popup window may be displayed, where the prompt interface or the popup window is used to prompt the user that relevant data is currently being collected, so that the present application only starts to execute a relevant step of obtaining relevant data of the user after obtaining a confirmation operation sent by the user to the prompt interface or the popup window, otherwise (i.e. when no confirmation operation sent by the user to the prompt interface or the popup window is obtained), ends the relevant step of obtaining relevant data of the user, i.e. no relevant data of the user is obtained. In other words, all user data collected by the present application is collected with the consent and authorization of the user, and the collection, use and processing of relevant user data requires compliance with relevant laws and regulations and standards of the relevant country and region.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a network architecture according to the present application. As shown in fig. 1, the network architecture may include a server 200 and a cluster of terminal devices, which may include one or more terminal devices, the number of which will not be limited here. As shown in fig. 1, the plurality of terminal devices may specifically include a terminal device 100a, a terminal device 101a, terminal devices 102a, …, a terminal device 103a; as shown in fig. 1, the terminal device 100a, the terminal device 101a, the terminal devices 102a, …, and the terminal device 103a may be connected to the server 200 through a network, so that each terminal device may interact with the server 200 through the network connection.

The server 200 shown in fig. 1 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, basic cloud computing services such as big data and artificial intelligence platforms, and the like. The terminal device may be: intelligent terminals such as smart phones, tablet computers, notebook computers, desktop computers, intelligent televisions and the like. A specific description of an embodiment of the present application will be made below taking communication among the terminal device 100a, the terminal device 101a, and the server 200 as an example.

Referring to fig. 2, fig. 2 is a schematic view of an interface display scene provided by the present application. As shown in fig. 2, the terminal device 100a may be a device where a live broadcast end is located, that is, the terminal device 100a may be a device where a live broadcast is initiated, the terminal device 101a may be a device where a live broadcast end is located, that is, the terminal device 101a may be a device for watching a live broadcast initiated by the terminal device 100a, the server 200 may be a background device (may be simply referred to as a live broadcast background) of the live broadcast end and the live broadcast end, the live broadcast end and the live broadcast end may be the same client (e.g., both are a certain communication application) on different terminal devices, and the live broadcast end have the same background, only the live broadcast end initiates a live broadcast, and the live broadcast end may watch a live broadcast initiated by the live broadcast end.

The operations performed by the subsequent terminal device 100a may be performed by the live side. After the terminal device 100a initiates live broadcast, a live broadcast interface may be displayed, where the live broadcast interface may have live broadcast pictures that the terminal device 100a calls the camera to capture in real time. The live broadcast of the live broadcast end belongs to a process, and an operation of opening a PPT (presentation) in a live broadcast interface can be initiated in the terminal device 100a, and further, the process of opening the PPT can be initiated, and an interface where the opened PPT is located (i.e., a PPT interface here) can be embedded and displayed in the live broadcast interface. The process can be described specifically with reference to the following description of the corresponding embodiment of fig. 3.

Furthermore, the terminal device 100a may record the PPT interface embedded in the display in real time, so as to obtain a video stream recorded in real time on the PPT interface, and the terminal device 100a may transmit the video stream to the server 200, so that the server 200 may transmit the video stream to the terminal device 101a, so that the viewer end in the terminal device 101a may play the video stream, so as to realize viewing of the PPT live on the live broadcast end at the viewer end.

The method provided by the application can embed and display the PPT interface in the live interface, enriches the modes of live broadcasting the multimedia file in the live broadcasting process, and improves the convenience of live broadcasting the multimedia file in the live broadcasting process because the operation of opening the multimedia file can be directly executed in the live broadcasting interface.

Referring to fig. 3, fig. 3 is a flow chart of a file processing method provided by the present application. The execution subject in the embodiment of the application can be a live broadcast terminal, and the live broadcast terminal can be any client capable of initiating live broadcast (i.e. performing live broadcast), and the client can be a webpage client, a software client, an applet client or the like, and the live broadcast terminal can be in a computer device, and the computer device can be a terminal device or any other device capable of performing live broadcast. As shown in fig. 3, the method may include:

step S101, in the live broadcast process, if the operation of opening the multimedia file in the live broadcast interface is detected, acquiring the file interface; the file interface contains the file content of the opened target multimedia file.

Specifically, the live broadcast terminal can display a live broadcast interface in the live broadcast process, the live broadcast interface can be a live broadcast interface, the equipment where the live broadcast terminal is located is provided with a camera, a live broadcast picture can be displayed in the live broadcast interface, and the live broadcast picture can be a picture shot in real time through the camera of the equipment where the live broadcast terminal is located.

Optionally, the live broadcast initiated by the live broadcast terminal may be a net lesson live broadcast initiated by a teacher, or the live broadcast initiated by the live broadcast terminal may be a conference live broadcast, or the like. The specific content of the initiated live broadcast can be determined according to the actual application scene, and the method is not limited.

The object to which the live end belongs may be referred to as a live object (e.g., a user holding the live end for live in the live end). In the live broadcasting process of the live broadcasting terminal, the live broadcasting object can execute the operation of opening the multimedia file in the live broadcasting interface through the live broadcasting terminal.

Optionally, the live interface of the live end may have a control for opening the multimedia file, where the operation performed by the live object on the live end to open the multimedia file in the live interface may be performed by the live object through the control, and the control may be a touch control (such as a clickable control) or the control may also be a voice control, and the control is not limited to this.

Alternatively, the live interface may be a live window, or may be another type of interface. The live object of watching live object at live end can be spectator, spectator can watch live end live broadcast through spectator's end, live end can be with live picture (can be in the form of video stream storage) transmission that the camera shot to spectator's end play (for example will shoot live picture's video stream and give spectator's end and play), in order to let spectator watch live end live broadcast. The number of the audience terminals is not limited, and one or more audience terminals can be provided. Alternatively, the viewer end and the live end may be the same client end on different devices (the client end has the functions of initiating live broadcast and watching live broadcast simultaneously), but the live end is the client end initiating live broadcast, and the viewer end is the client end watching live broadcast initiated by the live broadcast end.

If the live terminal detects the operation of opening the multimedia file in the live interface, the live terminal can acquire a file interface, wherein the file interface can contain the content (which can be called as file content) of the opened multimedia file (which can be called as target multimedia file). The file interface may be a file window or may be another form of interface.

The file interface may be an interface in which the target multimedia file created by the file opening program is opened after the file opening program is called to open the target multimedia file. The file opening program may be a program embedded in the live end, or the file opening program may be another independent program outside the live end, and the another independent program may also exist in the device where the live end is located.

Optionally, the target multimedia file may be any file that needs to be live in the live broadcast process. For example, if the target multimedia file is a PPT (presentation file), the file interface may be an interface (such as a PPT window) where the PPT is opened, the file content of the target multimedia file included in the file interface may be a slide included in the PPT, and the file opening program may be software, a plug-in, or a component for opening the PPT.

For another example, if the target multimedia file is a word document (an electronic document), the file interface may be an interface where the word document is opened, the file content of the target multimedia file included in the file interface may be a page of the document content included in the word document, and the file opening program may be software, a plug-in, a component, or the like for opening the word document.

For example, if the target multimedia file is a video, the file interface may be an interface where the video is opened, and the file content of the target multimedia file included in the file interface may be a video frame included in the video, and the file opening program may be software, a plug-in, a component, or the like for opening the video.

Optionally, the determining process of the target multimedia file may include: after detecting the operation of opening the multimedia file in the live interface, the live terminal can output an interface (which can be called a file selection interface) for selecting the multimedia file to be opened, the live object can select the multimedia file to be opened through the file selection interface and execute the confirmation operation, and the multimedia file selected and confirmed by the live object in the file selection interface can be the target multimedia file to be opened.

The target multimedia file may be a multimedia file selected by the live object through a file selection interface in a local storage space (e.g., a local storage space of a device where the live end is located), or the target multimedia file may also be a multimedia file selected by the live object through the file selection interface in a storage space of the live end (e.g., a multimedia file imported and stored at the live end), where a source of the target multimedia file selected and confirmed in the file selection interface may be determined according to an actual application scenario, which is not limited.

Step S102, embedding the file interface into the live interface to display the file content of the target multimedia file in the live interface.

Specifically, the live terminal may embed the obtained file interface (which may be a window where the target multimedia file is opened) into the live interface for displaying, so as to display the file content of the target multimedia file in the live interface, which may be described in detail below.

The live terminal can create a space occupying view of the file interface in the live interface, wherein the space occupying view can be a view for displaying the file interface, and the space occupying view can be a blank view when the file interface is not displayed.

The live broadcast terminal can set the live broadcast interface (which can be a main window) as a father interface (such as a father window) of the file interface, and can display the file interface at the position of the occupied view in the father interface (i.e. the live broadcast interface), so that the effect of embedding the file interface into the live broadcast interface for displaying is achieved, and the effect of opening the target multimedia file in the live broadcast interface is achieved. And, the display position and display size of the file interface will be the same as the display position and display size of the placeholder view all the time, so that the position and size of the file interface will also change correspondingly along with the change of the position and size of the live interface, as described in the following.

By setting the live interface as the father interface of the file interface, the display position of the file interface embedded in the live interface can also follow the change when the display position of the live interface changes, and the display size (i.e. the interface size) of the file interface embedded in the live interface can also follow the change when the display size (i.e. the interface size) of the live interface changes, namely the position and the size of the file interface follow the change of the position and the size of the live interface, so that the live interface and the file interface are unified in the sense of a live object, the live object perceives that the live end directly opens a target multimedia file in the live interface, the live object can not perceive the existence of the file interface, and can not perceive that the file interface is opened by additionally calling a file playing program.

The file interface changes along with the change of the position and the size of the live interface, and the change can be performed through a space occupying view. The display position and the interface size of the file interface may be the same as the display position and the view size of the placeholder view.

The live broadcast terminal can set a callback event for the occupied view, and the display position and the view size of the occupied view also change along with the change of the display position and the interface size of the live broadcast interface, so that when the display position of the live broadcast interface changes, the display position of the occupied view also changes, and when the interface size of the live broadcast interface changes, the view size of the occupied view also changes.

Therefore, if the display position of the live interface is changed, and the display position of the occupied view is changed, the callback event can be triggered, and the display position of the changed occupied view can be callback to the live terminal. The live broadcast terminal can also change the display position of the file interface according to the obtained display position after the change of the occupied view, namely, the display position of the file interface embedded in the live broadcast interface is adjusted to be the display position after the change of the occupied view, so that the display position after the change of the file interface is the same as the display position after the change of the occupied view.

Similarly, if the interface size of the live interface is changed, so that the view size of the occupied view is also changed, the callback event can be triggered, and the view size after the change of the occupied view can be recalled to the live end. The live broadcast terminal can also change the interface size of the file interface according to the acquired view size after the change of the occupied view, namely, the display size (namely, the interface size) of the file interface embedded in the live broadcast interface is adjusted to be the view size after the change of the occupied view, so that the interface size after the change of the file interface is the same as the view size after the change of the occupied view.

It should be emphasized that regardless of the display position and the interface size of the live interface, the placeholder view is always in the live interface, i.e. the live interface includes a placeholder view, and the view size of the placeholder view is smaller than or equal to the interface size of the live interface. The manner in which the view size and view position of the placeholder view changes with changes in the interface size and interface position of the live interface is illustrated below.

Alternatively, the placeholder view may be rectangular, the view size of the placeholder view being equal to the product between the length of the placeholder view and the width of the placeholder view; likewise, the live interface may also be rectangular, with the interface size of the live interface being equal to the product of the length of the live interface and the width of the live interface. The live terminal can acquire the interface size of the live interface at each time, namely the live terminal can know the length and width of the live interface at each time.

Wherein, there may be a proportional relationship between the length of the placeholder view and the length of the live interface, e.g., the ratio between the length of the live interface and the length of the placeholder view may be 5: and 4, when the length of the live broadcast interface is changed, the length of the occupied view is changed, so that the ratio between the changed length of the live broadcast interface and the changed length of the occupied view is always unchanged (namely, always the originally set ratio relationship is 5:4).

Similarly, there may be a proportional relationship between the width of the placeholder view and the width of the live interface, e.g., the ratio between the width of the live interface and the width of the placeholder view may be 6: and 5, when the width of the live broadcast interface is changed, the width of the occupied view is changed, so that the ratio between the width of the live broadcast interface after the change and the width of the occupied view after the change is always unchanged (namely, the ratio relationship is always the originally set ratio relationship, such as 6:5).

By the process, the view size of the occupied view is changed along with the change of the interface size of the live interface, and the interface size of the file interface is changed along with the change of the interface size of the live interface. The visual effect achieved may be that if the interface size of the live interface becomes larger, the interface size of the file interface also becomes larger. Otherwise, if the interface size of the live interface is smaller, the interface size of the file interface is also smaller.

More, the horizontal distance from the upper left corner of the placeholder view to the upper left corner of the live broadcast interface may be equal to half of the difference obtained by subtracting the length of the placeholder view from the length of the live broadcast interface, so that the horizontal distance from the upper right corner of the placeholder view to the upper right corner of the live broadcast interface may also be equal to half of the difference obtained by subtracting the length of the placeholder view from the length of the live broadcast interface, and finally, the sum of the horizontal distance from the upper left corner of the placeholder view to the upper left corner of the live broadcast interface, the horizontal distance from the upper right corner of the placeholder view to the upper right corner of the live broadcast interface and the length of the placeholder view is equal to the length of the live broadcast interface. It can be deduced that the sum of the horizontal distance from the lower left corner of the placeholder view to the lower left corner of the live broadcast interface, the horizontal distance from the lower right corner of the placeholder view to the lower right corner of the live broadcast interface, and the length of the placeholder view is also equal to the length of the live broadcast interface.

Or, the horizontal distance from the left upper corner of the occupied view to the left upper corner of the live broadcast interface may not be equal to the length of the live broadcast interface minus half of the difference obtained by subtracting the length of the occupied view from the length of the live broadcast interface, the horizontal distance from the right upper corner of the occupied view to the right upper corner of the live broadcast interface may not be equal to the length of the live broadcast interface minus half of the difference obtained by subtracting the length of the occupied view from the length of the live broadcast interface, and the horizontal distance from the left upper corner of the occupied view to the right upper corner of the live broadcast interface may be arbitrarily set according to the actual application scenario.

Similarly, the vertical distance from the upper left corner of the placeholder view to the upper left corner of the live broadcast interface may be equal to half of the difference obtained by subtracting the width of the placeholder view from the width of the live broadcast interface, so that the vertical distance from the lower left corner of the placeholder view to the lower left corner of the live broadcast interface may also be equal to half of the difference obtained by subtracting the width of the placeholder view from the width of the live broadcast interface, and finally, the sum of the vertical distance from the upper left corner of the placeholder view to the upper left corner of the live broadcast interface, the vertical distance from the lower left corner of the placeholder view to the lower left corner of the live broadcast interface, and the width of the placeholder view is equal to the width of the live broadcast interface. It can be deduced that the sum of the vertical distance from the upper right corner of the placeholder view to the upper right corner of the live interface, the vertical distance from the lower right corner of the placeholder view to the lower right corner of the live interface, and the width of the placeholder view is also equal to the width of the live interface.

Or, the vertical distance from the upper left corner of the occupied view to the upper left corner of the live broadcast interface may not be equal to half of the difference obtained by subtracting the width of the occupied view from the width of the live broadcast interface, the vertical distance from the lower left corner of the occupied view to the lower left corner of the live broadcast interface may not be equal to half of the difference obtained by subtracting the width of the occupied view from the width of the live broadcast interface, the vertical distance from the upper left corner of the occupied view to the upper left corner of the live broadcast interface and the vertical distance from the lower left corner of the occupied view to the lower left corner of the live broadcast interface may be set at will according to the actual application scenario, and in such a scenario, the sum of the vertical distance from the upper left corner of the occupied view to the upper left corner of the live broadcast interface (may be referred to as a first vertical distance) and the vertical distance from the lower left corner of the occupied view to the lower left corner of the live broadcast interface (may be referred to as a second vertical distance) is equal to the width of the live broadcast interface minus the width of the occupied view.

By setting the relationship between the positions of the 4 corners of the occupied view and the positions of the 4 corners of the live broadcast interface (which can be determined by the length of the occupied view, the width of the occupied view, the length of the live broadcast interface and the width of the live broadcast interface), the position of the occupied view in the live broadcast interface can be determined, and when the display position of the live broadcast interface changes, the display position of the occupied view also changes, so that the relationship between the positions of the 4 corners of the live broadcast interface after the change of the display position and the positions of the 4 corners of the occupied view after the change of the display position is unchanged, and the relationship can be the relationship described above. Furthermore, when the display position of the live broadcast interface is changed, the display position of the file interface displayed at the occupied view can also be changed. The relationship between the 4-corner position of the file interface and the 4-corner position of the live interface is the same as the relationship between the 4-corner position of the placeholder view and the 4-corner position of the live interface.

Referring to fig. 4 a-4 b, fig. 4 a-4 b are schematic views of a scene of an interface following change provided by the present application. As shown in fig. 4a, when the display position of the live interface changes, the display position of the file interface embedded in the live interface also changes, and the file interface is always displayed in the live interface. As shown in fig. 4b, when the interface size of the live interface changes, the interface size of the file interface embedded and displayed in the live interface also changes, and the file interface is always displayed in the live interface. The file interface is perceptively integral to the live interface.

Referring to fig. 5, fig. 5 is a schematic view of a scenario illustrating a positional relationship according to the present application. As shown in fig. 5, the relative position between the file interface and the live interface, that is, the relative position is determined by setting the distance relationship (including the horizontal distance and the vertical distance) between the 4 corners (including the upper left corner, the lower left corner, the upper right corner, and the lower right corner) of the file interface and the 4 corners (including the upper left corner, the lower left corner, the upper right corner, and the lower right corner) of the live interface.

The above-described manner in which the view size and the view position of the occupied view change along with the change of the interface size and the interface position of the live interface is merely by way of example, and how the view size and the view position of the occupied view specifically change along with the change of the interface size and the interface position of the live interface may be arbitrarily set according to the actual application scenario, which is not limited. The view size and the view position of the occupied view are changed along with the change of the interface size and the interface position of the live broadcast interface, so that the interface size and the interface position of the file interface are changed along with the change of the interface size and the interface position of the live broadcast interface, the file interface and the live broadcast interface are integrated and unified, a live broadcast object can only sense one interface of the live broadcast interface, and the experience and convenience of a user for opening a multimedia file in a live broadcast process are improved.

The method for embedding the display file interface in the live interface can further comprise: the live broadcast terminal can cancel the display of the live broadcast picture in the live broadcast interface, can embed the file interface into the live broadcast interface without the live broadcast picture, the live broadcast terminal can also independently display a live broadcast sub-interface on the live broadcast interface embedded with the file interface, the live broadcast sub-interface can be a small window displayed on the live broadcast interface, the display position of the live broadcast sub-interface on the live broadcast interface can be dragged, the live broadcast sub-interface can be displayed at the position of the right upper corner of the live broadcast interface by default, and the display size of the live broadcast sub-interface can be smaller than the display size of the file interface. Furthermore, the live terminal can display the live image in the live sub-interface.

That is, when the multimedia file needs to be opened in the live interface, the live interface may be embedded with the file interface displaying the file content including the opened multimedia file, instead of displaying the live screen, and the live screen may be displayed in a small window independently displayed on the live interface, for example, in the live sub-interface.

Referring to fig. 6, fig. 6 is a schematic view of another interface display provided in the present application. As shown in fig. 6, a display file interface may be embedded in the live broadcast interface, where the file content of the target multimedia file is displayed in the file interface, and a live broadcast sub-interface may be displayed in the position of the upper right corner of the file interface, where a live broadcast picture photographed in real time may be displayed in the live broadcast sub-interface. Alternatively, the live sub-interface may not be displayed, that is, when the live interface is embedded in the display file interface, the live screen may not be displayed.

The live object can close the target multimedia file opened in the live interface (for example, through a related control), and the live end can close the file interface, namely, cancel embedding the display file interface in the live interface, cancel the display of the live sub-interface, and display the current live image in the live interface again.

More, if the target multimedia file displayed in the file interface embedded in the live interface needs to be marked, a transparent interface (may be a transparent window) may be displayed on the file interface in a covering manner, and the interface size and the interface position of the transparent interface are the same as the interface size and the interface position of the file interface, that is, the transparent interface is always displayed on the file interface.

It can be understood that the content of the labeling of the target multimedia file in the transparent interface may be not directly labeled on the file content of the target multimedia file, but labeled in the transparent interface, and subsequently, the content labeled in the transparent interface and the position of the content may be associated with the target multimedia file and stored, so that when the file content of the target multimedia file is displayed, the labeled content may also be displayed at the file content of the same position of the target multimedia file through the associated stored labeled content, thereby realizing the labeling accuracy.

By displaying the transparent interface on the file interface, the live broadcast interface can label the file content of the target multimedia file displayed in the file interface in the transparent interface, so that the related compatibility problem that the live broadcast end labels the file interface of the file opening program in live broadcast under certain scenes can be solved, the live broadcast object labels the opened multimedia file more flexibly under the live broadcast scenes, and the control force on the opened multimedia file is stronger.

The live object can exhale the virtual electronic pen (exhale through voice, gesture or control) in the transparent interface, and can randomly mark (such as drawing horizontal lines, drawing curves, writing, circling, drawing symbols and the like) on the transparent interface through the virtual electronic pen. Or/and, the transparent interface can be provided with a plurality of controls for marking the file content, the marking of the file content displayed in the file interface on the transparent interface can be realized through the controls, the type of the controls can be determined according to the actual application scene, for example, the marked controls can comprise an arrowed control, a circled control, a control for highlighting the selected content, and the like.

For example, the file content displayed by the file interface embedded in the live interface may be a target document, that is, the target multimedia file is a target document (may be any document, such as any PPT or word document), where the target document may include N pages of document content, N is a positive integer, and the specific value of N may be determined according to the actual application scenario.

Therefore, the live side can respond to the document content (i.e. the document content) annotation enabling operation (i.e. the operation performed by the live object for starting the annotation) of the target document displayed in the file interface, and display a transparent interface on the displayed file interface, wherein the transparent interface is independently displayed on the file interface, and the interface size of the transparent interface is the same as that of the file interface.

If the file interface is currently the ith page of document content displayed in the N pages of document content (i.e. displayed on the device screen), the ith page of document content can be any page of document content in the N pages of document content, i is a positive integer less than or equal to N, the live broadcast end can respond to the marking operation (which can be executed by the above-mentioned expired virtual electronic pen or can also be executed by a control used for marking in transparency) of the live broadcast object on the transparent interface for the displayed ith page of document content, and the marking content (such as a line drawn by the live broadcast object in the transparent interface) of the live broadcast object for the ith page of document content is generated and displayed on the displayed transparent interface, and the marking content can be displayed in an overlaying manner on the document content.

Furthermore, the live broadcast end can correlate the annotation content with the ith page of document content, store the annotation content correlated with the ith page of document content, and store the annotation position of the annotation content relative to the ith page of document content, and subsequently, when the document content displayed on other pages is displayed back to the ith page of document content, the annotation content correlated with the ith page of document content can be displayed at the corresponding position (namely, the position of the live broadcast object for annotating the ith page of document content).

Wherein, the content marked on the file content of the target multimedia file also supports to be deleted. The live object can not sense the existence of the transparent interface, and the file content of the displayed multimedia file can be directly marked in the live interface under the sense of the live object.

More, the live broadcast terminal can record the file interface embedded and displayed in the live broadcast interface in real time to obtain the recorded video (which can exist in the form of video stream) of the file interface. Optionally, the live broadcast sub-interface may be displayed on the file interface, so that a recording picture (which may be a video frame of the recorded video) obtained by recording the file interface may also include a live broadcast sub-interface displayed on the file interface, and the live broadcast end may send the recorded video to the live broadcast background, so that the live broadcast background may push the recorded video to each viewer end watching live broadcast, and each viewer end may play the received recorded video, so that each viewer of live broadcast may watch the target multimedia file of live broadcast.

More, if the live object needs to switch to display the currently opened target multimedia file as other multimedia files, the live object can be realized through a switching control in the live interface. For example, the live side may generate a switch flag (for indicating that the opened multimedia file needs to be switched) for the multimedia file in response to an operation of switching the opened multimedia file in the live interface (the operation may be performed through the switch control).

The live broadcast interface may report the switching flag to a live broadcast background (i.e., a background of a live broadcast end and a viewer end), and the live broadcast background may push the switching flag to each viewer end, where each viewer end may display switching prompt information for the multimedia file after receiving the switching flag (e.g., the switching prompt information may be "switch multimedia file, please wait"). Because the live broadcast end may be longer in the process of switching the multimedia file, the viewer end is usually a blank interface (for example, the file content of the switched multimedia file is not displayed, and the live broadcast picture is not displayed), so the process requires the viewer to perceive that the multimedia file is being switched (the viewer can perceive through the switching prompt information displayed by the viewer end), thereby improving the experience of the viewer.

After responding to the operation of switching and opening the multimedia file in the live interface, the live end can also acquire other multimedia files for switching the currently opened target multimedia file, and can acquire a target interface containing the file content of the other multimedia files, wherein the acquisition mode and principle of the target interface are the same as those of the file interface.

And after detecting the operation of switching and opening the multimedia file in the live interface, the live end can cancel the display of the embedded file interface in the live interface, and after acquiring the target interface for switching the file interface, the live end can embed the target interface in the live interface so as to display the file content of other multimedia files for switching the target multimedia file in the live interface, and the principle of embedding the target interface into the live interface is the same as that of embedding the file interface into the live interface. Subsequently, the live broadcast terminal can record the target interface embedded in the live broadcast interface in real time to obtain the recorded video (which can be a video stream) of the target interface, and the recorded video of the target interface can be pushed to the audience terminal through the live broadcast background, so that the audience terminal plays the recorded video of the target interface.

Or after the live broadcast end detects the operation of switching and opening the multimedia file in the live broadcast interface and before the live broadcast end acquires the target interface for switching the file interface, the live broadcast end can continuously display the file interface (namely the interface where the file content of the target multimedia file is located) in the live broadcast interface, and when the target interface is acquired, the file interface embedded in the live broadcast interface is switched and displayed as the target interface.

According to the method and the device, the file interface of the opened multimedia file is embedded into the live broadcast interface for display, so that a live broadcast object has no sense of rupture in vision and operation between the opening and live broadcast processes of the multimedia file, and the experience effect is better. In addition, by adopting the method provided by the application, only the multimedia file to be opened (such as the file content of the target multimedia file to be opened is only contained in the displayed file interface) can be live-broadcast in the live-broadcast process, other content which does not need live broadcast in the screen of the equipment where the live broadcast terminal is located can not be live-broadcast, and the data privacy of the live-broadcast object on the equipment where the live broadcast terminal is located is protected.

Referring to fig. 7, fig. 7 is a flow chart of a file acquisition interface provided by the present application. The execution body in the embodiment of the present application may be the live broadcast end. As shown in fig. 7, the process may include:

in step S201, if an operation of opening the multimedia file in the live interface is detected, the first thread Cheng Chuangjian and the second thread are invoked.

In particular, it should be noted that the live interface is created and displayed by the first thread, which may be understood as the live interface is maintained and managed by the first thread, and may be referred to as the main thread.

If the live side detects an operation of opening the multimedia file in the live interface, the live side may call the first thread Cheng Chuangjian to a second thread, which may be understood as a child of the first thread. The second thread is a thread for acquiring and opening multimedia files. The first thread may also display a hint that the multimedia file is being opened.

Step S201, call the second thread to obtain the file interface.

Specifically, the live terminal may call the second thread to obtain the target multimedia file to be opened, for example, call the second thread to obtain the target multimedia file selected locally by the device where the live object is located at the live terminal. The live side may also call the second thread to obtain a control object of the file opening program (a program for opening the multimedia file), where the control object is used to call the file opening program to perform a corresponding operation.

The device where the live broadcast end is located may have an external interface of the file opening program, where the external interface may be called by other programs (such as the live broadcast end) to obtain an external service (such as a service for opening a multimedia file) of the file opening program. Therefore, the control object can be obtained by the live broadcast end through calling the external interface of the file opening program.

The control object may include an object for calling a file open program to open a multimedia file (may be referred to as a file open object). Therefore, the second thread can call the file opening program through the file opening object to execute the operation of opening the target multimedia file, and then the file opening program can create the file interface containing the file content of the opened target multimedia file, and after the second thread takes the file interface, the file interface can be submitted to the first thread, so that the first thread embeds the file interface into the live interface for display.

Further, the control object may further include an object for operating the file interface or the file content of the target multimedia file displayed in the file interface, and if the target multimedia file is a document, the control object may further include a control object for turning a page of the file content of the target multimedia file (may be referred to as a page-turning object), a control object for zooming the file content of the target multimedia file (may be referred to as a zoom display object), a control object for eye-protection display of the file interface, a control object for editing the file content of the target multimedia file (such as editing of a font change, or a line space change), and the like, which are all control objects to be used.

Therefore, the live broadcast terminal can display various controls for operating the file content of the target multimedia file displayed in the file interface in the live broadcast interface embedded with the file interface, and when the live broadcast object clicks a certain control in the various controls, the live broadcast terminal can call a control object corresponding to the operation initiated by the control (for example, the control object corresponding to the page turning operation is a page turning object, etc.), so as to call the file opening program to perform corresponding operation on the file content of the target multimedia file displayed in the file interface.

The operations of generating the switch flag and reporting the switch flag to the live background may be performed by the first thread. The acquiring the target interface may be performed by a second thread, the second thread may submit the acquired target interface to the first thread, so that the first thread embeds the target interface into the live interface for displaying, after the first thread switches and displays the file interface in the live interface as the target interface, the first thread may submit a switch completion flag to the live background, the live background may push the switch completion flag to the audience, and after each audience receives the switch completion flag, the audience may display a switch completion prompt message, where the switch completion prompt message may be "multimedia file switch complete".

Referring to fig. 8, fig. 8 is a flow chart of a file switching display method provided by the present application. As shown in fig. 8, the method may include:

1. when triggering the operation of switching the currently opened PPT (such as the operation of switching the opened multimedia file in the live interface), the live broadcast terminal can call the first thread to report the in-switching mark (namely the above-mentioned switching mark) to the live broadcast background.

2. The live broadcast end can execute a flow of switching on the PPT, such as a flow of calling a second thread to acquire the target interface and then switching and displaying the file interface embedded and displayed in the live broadcast interface as a related flow of the target interface.

3. The live background may push the acquired switch flag to the viewer.

4. After the audience terminal acquires the mark in the switching, a waiting interface can be displayed, wherein the waiting interface can be an interface displaying prompt information of the switching PPT so as to prompt the audience, and the live broadcast object is switching the PPT.

5. After the live broadcast terminal switches and displays the file interface embedded and displayed in the live broadcast interface as a target interface, the first thread can be called to report a switching completion mark to a live broadcast background, and the switching completion mark is used for indicating that the PPT cut flower is successfully opened.

6. The live background can push the acquired switching completion mark to the audience terminal.

7. After receiving the switch completion mark, the viewer terminal can display prompt information of the completion of the PPT switch, and can display a switched PPT interface (namely a PPT picture here), wherein the PPT interface can be a video stream which is transmitted by a live broadcast terminal played by the viewer terminal and is obtained by recording an interface for opening the PPT.

By adopting the method provided by the application, because the interface (such as the file interface and the target interface) for acquiring the file content of the opened multimedia file can take longer, the second thread of the first thread Cheng Chuangjian can be used for acquiring and opening the multimedia file to be opened and the first thread is used for displaying the live interface, the opening of the multimedia file and the displaying of the live interface are asynchronously carried out, so that the efficiency of opening the multimedia file can be improved, the display fluency of the live interface can be improved, and the user experience can be improved.

Referring to fig. 9, fig. 9 is a flow chart of another file processing method provided by the present application. As shown in fig. 9, the method may include:

step S301, displaying a live interface.

Specifically, after the live broadcasting terminal initiates the live broadcasting operation, a live broadcasting interface can be displayed, and live broadcasting pictures of the live broadcasting terminal, which are shot by the live broadcasting terminal in real time, can be displayed in the live broadcasting interface.

In step S302, in response to an operation of opening a multimedia file in the live interface, file contents of the opened target multimedia file are displayed in the live interface.

Specifically, the live terminal may respond to the operation of opening the multimedia file in the live interface, and display the file content of the opened target multimedia file in the live interface.

Optionally, the file interface including the file content of the opened target multimedia file can be acquired first, and the file interface is embedded into the live interface of the live terminal for display, so that the file content of the opened target multimedia file is displayed in the live interface. This process can also be seen from the above detailed description of the corresponding embodiment of fig. 3.

It should be noted that, if the display position of the live broadcast interface in the screen of the device where the live broadcast end is located changes, the display position of the file interface in the screen also changes along with the change of the display position of the live broadcast interface, so that the relative position between the display position before the change of the file interface and the display position before the change of the live broadcast interface is the same as the relative position between the display position after the change of the file interface and the display position after the change of the live broadcast interface.

The live broadcast end can know the display position of the live broadcast interface at each time, and further, the display position of the varied occupation view (namely the file interface or the target interface) can be determined through the display position of the live broadcast interface at each time and the length and the width of the live broadcast interface. For example, the relative position between the display position of the file interface and the display position of the live interface may be determined by the horizontal distance and the vertical distance between the 4 corners of the file interface and the 4 corners of the live interface, for example, the relative position may be determined by the horizontal distance from the left upper corner of the file interface to the left upper corner of the live interface being equal to half the difference obtained by subtracting the length of the file interface from the length of the live interface, the horizontal distance from the right upper corner of the file interface to the right upper corner of the live interface being equal to half the difference obtained by subtracting the length of the file interface from the length of the live interface, the vertical distance from the left upper corner of the file interface to the left upper corner of the live interface being equal to half the difference obtained by subtracting the width of the file interface from the width of the live interface, and the vertical distance from the left lower corner of the file interface to the left lower corner of the live interface being equal to half the difference obtained by subtracting the width of the file interface from the width of the live interface.

More, if the display size (i.e., the interface size) of the live interface is changed, the display size of the file interface also changes along with the change of the display size (i.e., the interface size) of the live interface, so that the size ratio between the display size before the change of the file interface and the display size before the change of the live interface is equal to the size ratio between the display size after the change of the file interface and the display size after the change of the live interface. If the display size is changed, the ratio between the length of the file interface and the length of the live broadcast interface is equal, and the ratio between the width of the file interface and the width of the live broadcast interface is also equal, so that the ratio between the display size of the file interface and the display size of the live broadcast interface is unchanged.

The live broadcast interface may further include a control for operating the file content of the displayed target multimedia file (may be displayed in the file interface), where the control may include a control for adjusting the display progress of the file content of the displayed target multimedia file (such as a control for turning a page or turning a page down), a control for scaling the file content of the displayed target multimedia file, a control for editing the file content of the displayed target multimedia file, and the like.

Referring to fig. 10, fig. 10 is an interface schematic diagram of a live interface according to the present application. As shown in fig. 10, a PPT interface (i.e., a file interface) may be embedded and displayed in the live interface, and related controls for operating the PPT displayed in the file interface may also be displayed in the live interface, including a control for "full screen display" (for full screen display of a slide of the PPT in the file interface, i.e., each slide is displayed full screen separately), a control for "page up" (for displaying a current slide to a previous slide of the slide), a control for "page down" (for displaying a next slide of the slide from the current slide), a control for "enabling a label" (for initiating the above-mentioned label enabling operation to label the PPT by calling out a transparent interface), and a control for "switching PPT" (for initiating an operation of switching PPT on the live interface to switch PPT on).

More, after the target multimedia file is opened in the live broadcast interface, that is, after the file content of the target multimedia file is displayed in the live broadcast interface, a live broadcast sub-interface can be displayed on the live broadcast interface, wherein the live broadcast sub-interface is an interface independently displayed on the live broadcast interface, the live broadcast sub-interface can be displayed on the file content displayed in the live broadcast interface, and live broadcast pictures shot on live broadcast objects in real time can be displayed in the live broadcast sub-interface.

The live terminal may also respond to a movement operation (such as a drag operation) of the live object on the live sub-interface, and display the live sub-interface to an interface position moved by the movement operation (such as a position moved from a position in an upper right corner to a position in a lower left corner of the live interface).

In a possible implementation manner, the live broadcast terminal may further respond to a labeling operation (such as a horizontal line drawing or a related symbol adding operation) of the live broadcast object on the file content of the target multimedia file displayed in the live broadcast interface, and display the content (i.e. the labeling content) for labeling the file content of the target multimedia file on the displayed file content. The labeling process can be to display a transparent interface on the file interface in the live broadcast interface, so as to realize the labeling of the displayed file content on the transparent interface.

The live broadcast terminal can also respond to the switching operation (which can be initiated by a switching control) of the target multimedia file opened in the live broadcast interface, display a file selection interface, and support the live broadcast object to select other multimedia files for switching the target multimedia file in the file selection interface, so that the live broadcast terminal can switch and display the file content of the target multimedia file displayed in the live broadcast interface as the file content of the other multimedia files selected by the live broadcast object in the file selection interface (such as switching and displaying the file interface as the target interface).

In addition, the live broadcast process of the live broadcast interface may be initiated in a certain group (such as a student group) of the live broadcast end, that is, the live broadcast of the live broadcast end may be initiated in the group, so the live broadcast end may also respond to a sharing operation (a live broadcast object may be a teacher) for a target multimedia file opened in the live broadcast interface, the sharing operation may be initiated by the teacher through a control in the live broadcast interface for sharing the opened multimedia file, so that other members (such as students) in the group may refer to the target multimedia file, and at this time, the target multimedia file may be a PPT of a courseware.

Wherein, the target multimedia file may be a presentation file (i.e., PPT), the presentation file may contain M pages of file content, M being a positive integer, and the multi-page file content may be a multi-page slide. Assuming that the j-th page of the M-page document contents is currently displayed in the live broadcast interface, the j-th page of the M-page document contents is any page of the M-page document contents, i is a positive integer less than or equal to M, the live broadcast end may also switch and display the j-th page of the direct interface to be displayed as the previous page of the j-th page of the M-page document contents (when the page-turning operation is the page-turning operation) or the next page of the j-th page of the M-page document contents (when the page-turning operation is the page-turning operation) in response to the page-turning operation (such as the page-turning operation or the page-turning operation) of the live broadcast object for the presentation document.

The above-mentioned page turning operation may be any operation, such as a gesture sliding operation (e.g., a page up operation in the live interface may be a page up operation, a page down operation in the live interface may be a page down operation), or an operation performed by providing a control (page up control, page down control) in the live interface. The live broadcasting terminal can call a control object for turning pages corresponding to the file opening program through the executed page turning operation, and can realize page turning (page turning up or page turning down) of the manuscript content displayed in the live broadcasting interface through the called control object for turning pages.

After the live broadcast interface opens the target multimedia file, the live broadcast end can also respond to the content editing operation (which can be the operation executed by a gesture or the operation executed by a related control (such as an editing control) in the live broadcast interface), and the editing interface can be understood as a small window displayed on the live broadcast interface, and is an interface independently displayed on the live broadcast interface, and the display size of the editing interface can be smaller than that of the live broadcast interface, and the display size of the editing interface can also be smaller than that of the file interface.

The editing interface can be a blank drawing board, so that the live object can be supported to edit any content (such as a deduction process of a teacher on a problem or a schematic drawing of any drawing) in the editing interface, and the live end can respond to the editing operation (such as the operations of writing by a virtual painting brush or drawing) of the live object in the editing interface to display the content edited by the live object in the editing interface.

By providing the editing interface for the live broadcast object, the live broadcast object can conveniently carry out corresponding explanation (such as problem explanation) on the audience through the content edited by the editing interface, and the editing interface can be displayed on the file interface (namely on the display demonstration periphery of the file interface in the live broadcast interface), so that when the live broadcast end records the file interface, the editing interface can be recorded for the audience end to watch, and the live broadcast picture seen by the audience through the audience end is the file interface and the editing interface is arranged on the file interface.

More, the live object is supported to share the content edited in the editing interface. The live broadcast terminal can respond to the sharing operation (initiated by gestures, related controls or shortcut keys) of the editing interface containing the edited content, and can capture the screenshot of the editing interface to obtain the screenshot of the editing interface and share the screenshot to the target object selected by the live broadcast object. The target object may be a friend or a group selected by the live object in the live end, or the target object may be a user or a group selected by the live object in other communication platforms, which is not limited.

In the live broadcast process, when the multimedia file is required to be live broadcast, the method can only acquire the file interface containing the file content of the opened target multimedia file, and can embed the file interface into the live broadcast interface for display, so that the mode of live broadcasting the multimedia file in the live broadcast process is enriched, and the operation of opening the multimedia file can be directly executed on the live broadcast interface, so that the convenience of live broadcasting the multimedia file in the live broadcast process is improved.

Referring to fig. 11, fig. 11 is a schematic structural diagram of a document processing apparatus according to the present application. The file processing means may be a computer program (comprising program code) running in a computer device, for example the file processing means is an application software, which may be used to perform the corresponding steps in the method provided by the embodiments of the application. As shown in fig. 11, the document processing apparatus 1 may include: an acquisition module 11 and an embedding module 12.

The acquiring module 11 is configured to acquire a file interface if an operation of opening a multimedia file in a live interface is detected during a live broadcast process; the file interface contains the file content of the opened target multimedia file;

An embedding module 12, configured to embed the file interface into a live interface, so as to display file contents of the target multimedia file in the live interface.

The live interface is displayed based on the first thread; if an operation of opening a multimedia file in a live interface is detected, the obtaining module 11 obtains a file interface mode, including:

and calling a second thread to acquire a file interface.

The manner in which the embedding module 12 embeds the file interface into the live interface includes:

The manner in which the embedding module 12 invokes the second thread to obtain the file interface includes:

calling a second thread to acquire a target multimedia file to be opened;

calling a second thread to acquire a control object of a file opening program;

Creating a space occupying view of a file interface in a live interface;

Wherein the device 1 is further configured to:

The target multimedia file is a target document, wherein the target document comprises N pages of document contents, and N is a positive integer; the above device 1 is also used for:

Wherein the device 1 is further configured to:

Wherein, after responding to the operation of switching to open the multimedia file in the live interface, the above device 1 is further configured to:

and displaying the live broadcast picture in the live broadcast sub-interface.

According to an embodiment of the present application, the steps involved in the file processing method shown in fig. 3 may be performed by respective modules in the file processing apparatus 1 shown in fig. 11. For example, step S101 shown in fig. 3 may be performed by the acquisition module 11 in fig. 11, and step S102 shown in fig. 3 may be performed by the embedding module 12 in fig. 11.

In the live broadcast process, if the operation of opening the multimedia file in the live broadcast interface is detected, acquiring the file interface; the file interface contains the file content of the opened target multimedia file; and embedding the file interface into the live interface to display the file content of the target multimedia file in the live interface. Therefore, in the live broadcast process, when the multimedia file is required to be live broadcast, the device provided by the application can only acquire the file interface containing the file content of the opened target multimedia file, and can embed the file interface into the live broadcast interface for display, so that the mode of live broadcasting the multimedia file in the live broadcast process is enriched, and the operation of opening the multimedia file can be directly executed on the live broadcast interface, so that the convenience of live broadcasting the multimedia file in the live broadcast process is improved.

According to an embodiment of the present application, each module in the file processing apparatus 1 shown in fig. 11 may be formed by combining one or several units separately or all, or some (some) of the units may be further split into a plurality of sub-units with smaller functions, so that the same operation may be implemented without affecting the implementation of the technical effects of the embodiment of the present application. The above modules are divided based on logic functions, and in practical applications, the functions of one module may be implemented by a plurality of units, or the functions of a plurality of modules may be implemented by one unit. In other embodiments of the application, the file processing device 1 may also comprise other units, and in practical applications, these functions may also be implemented with the assistance of other units, and may be implemented by cooperation of a plurality of units.

According to an embodiment of the present application, the file processing apparatus 1 shown in fig. 11 may be constructed by running a computer program (including program code) capable of executing the steps involved in the respective methods shown in fig. 3 on a general-purpose computer device such as a computer including a processing element such as a Central Processing Unit (CPU), a random access storage medium (RAM), a read only storage medium (ROM), and the like, and a storage element, and the file processing method of the embodiment of the present application is implemented. The computer program may be recorded on, for example, a computer-readable recording medium, and loaded into and executed by the computing device via the computer-readable recording medium.

Referring to fig. 12, fig. 12 is a schematic structural diagram of another document processing apparatus according to the present application. The file processing means may be a computer program (comprising program code) running in a computer device, for example the file processing means is an application software, which may be used to perform the corresponding steps in the method provided by the embodiments of the application. As shown in fig. 12, the document processing apparatus 2 may include: a first display module 21 and a second display module 22.

A first display module 21 for displaying a live interface;

and a second display module 22 for displaying file contents of the opened target multimedia file in the live interface in response to an operation of opening the multimedia file in the live interface.

Wherein, after opening the target multimedia file in the live interface, the above device 2 is further configured to:

displaying a live sub-interface on the live interface;

Wherein the device 2 is further configured to:

Wherein, the live broadcast process of the live broadcast interface is initiated in the group; the device 2 described above is also used for:

The device 2 described above is also used for:

According to an embodiment of the present application, the steps involved in the file processing method shown in fig. 9 may be performed by respective modules in the file processing apparatus 2 shown in fig. 12. For example, step S301 shown in fig. 9 may be performed by the first display module 11 in fig. 12, and step S302 shown in fig. 9 may be performed by the second display module 12 in fig. 12.

According to an embodiment of the present application, each module in the file processing apparatus 2 shown in fig. 12 may be formed by combining one or several units separately or all, or some (some) of the units may be further split into a plurality of sub-units with smaller functions, so that the same operation may be implemented without affecting the implementation of the technical effects of the embodiment of the present application. The above modules are divided based on logic functions, and in practical applications, the functions of one module may be implemented by a plurality of units, or the functions of a plurality of modules may be implemented by one unit. In other embodiments of the application, the file processing device 2 may also comprise other units, and in practical applications, these functions may also be implemented with the assistance of other units, and may be implemented by cooperation of a plurality of units.

According to an embodiment of the present application, the file processing apparatus 2 as shown in fig. 12 may be constructed by running a computer program (including program code) capable of executing the steps involved in the respective methods as shown in fig. 3 on a general-purpose computer device such as a computer including a processing element such as a Central Processing Unit (CPU), a random access storage medium (RAM), a read only storage medium (ROM), and the like, and a storage element, and implementing the file processing method of the embodiment of the present application. The computer program may be recorded on, for example, a computer-readable recording medium, and loaded into and executed by the computing device via the computer-readable recording medium.

Referring to fig. 13, fig. 13 is a schematic structural diagram of a computer device according to the present application. As shown in fig. 13, the computer device 1000 may include: processor 1001, network interface 1004, and memory 1005, in addition, computer device 1000 may further comprise: a user interface 1003, and at least one communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display (Display), a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface, among others. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 1005 may also optionally be at least one storage device located remotely from the processor 1001. As shown in fig. 13, an operating system, a network communication module, a user interface module, and a device control application program may be included in the memory 1005, which is one type of computer storage medium.

In the computer device 1000 shown in FIG. 13, the network interface 1004 may provide network communication functions; while user interface 1003 is primarily used as an interface for providing input to a user; and the processor 1001 may be used to invoke a device control application stored in the memory 1005 to implement:

In one possible implementation, the live interface is displayed based on the first thread; the processor 1001 may also be used to invoke a device control application stored in the memory 1005 to implement:

and calling a second thread to acquire a file interface.

In one possible implementation, the processor 1001 may also be used to invoke a device control application stored in the memory 1005 to implement:

calling a second thread to acquire a target multimedia file to be opened;

Calling a second thread to acquire a control object of a file opening program;

creating a space occupying view of a file interface in a live interface;

In one possible implementation, the target multimedia file is a target document, the target document containing N pages of document content, N being a positive integer; the processor 1001 may also be used to invoke a device control application stored in the memory 1005 to implement:

In one possible implementation, the processor 1001 may be further configured to invoke a device control application stored in the memory 1005 to implement, after responding to a switch-over operation to open a multimedia file in a live interface: :

And displaying the live broadcast picture in the live broadcast sub-interface.

displaying a live broadcast interface;

In one possible implementation, after opening the target multimedia file in the live interface, the processor 1001 may also be configured to invoke a device control application stored in the memory 1005 to implement:

displaying a live sub-interface on the live interface;

In one possible implementation, the live process of the live interface is initiated in a group; the processor 1001 may also be used to invoke a device control application stored in the memory 1005 to implement:

In one possible implementation, the target multimedia file is a presentation file, the presentation file includes M pages of file contents, and j and M are positive integers and j is less than or equal to M, where j is the j page of file contents currently displayed in the M pages of file contents in the live interface;

The processor 1001 may also be used to invoke a device control application stored in the memory 1005 to implement:

It should be understood that the computer device 1000 described in the embodiment of the present application may perform the description of the above-mentioned document processing method in the embodiment corresponding to fig. 3 and the description of the above-mentioned document processing method in the embodiment corresponding to fig. 9, and may also perform the description of the above-mentioned document processing apparatus 1 in the embodiment corresponding to fig. 11 and the description of the above-mentioned document processing apparatus 2 in the embodiment corresponding to fig. 12, which are not repeated herein. In addition, the description of the beneficial effects of the same method is omitted.

Furthermore, it should be noted here that: the present application also provides a computer readable storage medium, in which the aforementioned computer programs executed by the file processing device 1 and the file processing device 2 are stored, and the computer programs include program instructions, when executed by a processor, are capable of executing the descriptions of the file processing method in the corresponding embodiments of fig. 3 and fig. 9, and therefore, the descriptions will not be repeated here. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the embodiments of the computer storage medium according to the present application, please refer to the description of the method embodiments of the present application.

As an example, the above-described program instructions may be executed on one computer device or on a plurality of computer devices disposed at one site, or alternatively, on a plurality of computer devices distributed at a plurality of sites and interconnected by a communication network, which may constitute a blockchain network.

The computer readable storage medium may be the file processing apparatus provided in any one of the foregoing embodiments or an internal storage unit of the computer device, for example, a hard disk or a memory of the computer device. The computer readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash card (flash card) or the like, which are provided on the computer device. Further, the computer-readable storage medium may also include both internal storage units and external storage devices of the computer device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

The present application provides a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the description of the above file processing method in the corresponding embodiment of fig. 3 and fig. 9, and thus, a detailed description will not be given here. In addition, the description of the beneficial effects of the same method is omitted. For technical details not disclosed in the embodiments of the computer-readable storage medium according to the present application, please refer to the description of the method embodiments of the present application.

The terms first, second and the like in the description and in the claims and drawings of embodiments of the application are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the term "include" and any variations thereof is intended to cover a non-exclusive inclusion. For example, a process, method, apparatus, article, or device that comprises a list of steps or elements is not limited to the list of steps or modules but may, in the alternative, include other steps or modules not listed or inherent to such process, method, apparatus, article, or device.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied in electronic hardware, in computer software, or in a combination of the two, and that the elements and steps of the examples have been generally described in terms of function in the foregoing description to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The method and related apparatus provided in the embodiments of the present application are described with reference to the flowchart and/or schematic structural diagrams of the method provided in the embodiments of the present application, and each flow and/or block of the flowchart and/or schematic structural diagrams of the method may be implemented by computer program instructions, and combinations of flows and/or blocks in the flowchart and/or block diagrams. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or structural diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or structures.

The foregoing disclosure is illustrative of the present application and is not to be construed as limiting the scope of the application, which is defined by the appended claims.

Claims

1. A method of processing a document, the method comprising:

in the live broadcast process, if the operation of opening the multimedia file in the live broadcast interface is detected, acquiring the file interface; the file interface comprises file contents of the opened target multimedia file;

embedding the file interface into the live interface so as to display the file content of the target multimedia file in the live interface.

2. The method of claim 1, wherein the live interface is displayed based on a first thread; and if the operation of opening the multimedia file in the live interface is detected, acquiring the file interface, wherein the operation comprises the following steps:

if the operation of opening the multimedia file in the live interface is detected, calling the first thread Cheng Chuangjian and the second thread;

and calling the second thread to acquire the file interface.

3. The method of claim 2, wherein the embedding the file interface into the live interface comprises:

Invoking the second thread to submit the acquired file interface to the first thread;

4. The method of claim 2, wherein the invoking the second thread to obtain the file interface comprises:

calling the second thread to acquire the target multimedia file to be opened;

calling the second thread to acquire a control object of a file opening program;

and calling the file opening program to open the target multimedia file based on the control object, and creating the file interface containing the file content of the opened target multimedia file.

5. The method of claim 1, wherein the embedding the file interface into the live interface comprises:

creating a placeholder view of the file interface in the live interface;

setting the live broadcast interface as a parent interface of the file interface, and displaying the file interface at the position of the occupied view in the parent interface;

and the display size of the file interface is the same as the view size of the occupied view.

6. The method of claim 5, wherein the method further comprises:

if the view size of the occupied view is changed, acquiring the view size of the occupied view after the change;

and adjusting the display size of the file interface in the live broadcast interface to the changed view size.

7. The method of claim 1, wherein the target multimedia file is a target document, the target document comprising N pages of document content, N being a positive integer; the method further comprises the steps of:

responding to the annotation enabling operation for the target document, and displaying a transparent interface on the displayed file interface; the transparent interface is an interface which is independently displayed on the file interface, and the interface size of the transparent interface is the same as the interface size of the file interface;

if the ith page of document content in the N pages of document content is currently displayed in the file interface, generating labeling content for the ith page of document content on the displayed transparent interface in response to labeling operation for the displayed ith page of document content on the transparent interface; i is a positive integer less than or equal to N;

8. The method according to claim 1, characterized in that the method comprises:

transmitting the recorded video to a spectator terminal, so that the spectator terminal plays the recorded video.

9. The method according to any one of claims 1-8, further comprising:

10. The method of claim 9, wherein after responding to the operation of switching open multimedia files in the live interface, the method further comprises:

And switching the file interface embedded in the live interface into the target interface.

11. The method of claim 1, wherein the embedding the file interface into the live interface comprises:

canceling the display of the live broadcast picture in the live broadcast interface, and embedding the file interface into the live broadcast interface without the live broadcast picture;

independently displaying a live sub-interface on the live interface embedded with the file interface; the display size of the live broadcast sub-interface is smaller than that of the file interface;

and displaying a live broadcast picture in the live broadcast sub-interface.

12. A method of processing a document, the method comprising:

displaying a live broadcast interface;

and responding to the operation of opening the multimedia file in the live interface, and displaying the file content of the opened target multimedia file in the live interface.

13. The method of claim 12, wherein after opening the target multimedia file in the live interface, the method further comprises:

displaying a live sub-interface on the live interface;

and the live broadcast sub-interface is an interface independently displayed on the live broadcast interface.

14. The method of claim 13, wherein the method further comprises:

15. The method according to claim 12, wherein the method further comprises:

and responding to the labeling operation of the file content of the target multimedia file displayed in the live broadcast interface, and displaying the content for labeling the file content of the target multimedia file.

16. The method according to claim 12, wherein the method further comprises:

17. The method of claim 12, wherein the live process of the live interface is initiated in a group; the method further comprises the steps of:

and responding to the sharing operation of the target multimedia file opened in the live interface, and sharing the target multimedia file into the group.

18. The method of claim 12, wherein the target multimedia file is a presentation, the presentation comprising M pages of presentation content, j and M being positive integers and j being less than or equal to M, the j pages of presentation content currently displayed in the live interface to the M pages of document content;

the method further comprises the steps of:

and responding to page turning operation for the presentation file, and switching and displaying the j-th page file content displayed in the live broadcast interface as the next page file content or the last page file content of the j-th page file content in the M-page file content.

19. The method of claim 12, wherein after opening the target multimedia file in the live interface, the method further comprises:

responding to the content editing operation, and displaying an editing interface on the live broadcast interface; the editing interface is an interface independently displayed on the live broadcast interface;

and displaying edited content in the editing interface in response to an editing operation in the editing interface.

20. The method of claim 19, wherein the method further comprises:

and responding to the sharing operation of the editing interface containing the edited content, and sharing the screenshot of the editing interface to a target object.

21. A document processing apparatus, the apparatus comprising:

the acquisition module is used for acquiring a file interface if detecting the operation of opening the multimedia file in the live interface in the live broadcast process; the file interface comprises file contents of the opened target multimedia file;

and the embedding module is used for embedding the file interface into the live broadcast interface so as to display the file content of the target multimedia file in the live broadcast interface.

22. A document processing apparatus, the apparatus comprising:

the first display module is used for displaying a live broadcast interface;

23. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the method of any of claims 1-20.

24. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the method of any of claims 1-20.

25. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program adapted to be loaded by a processor and to perform the method of any of claims 1-20.