CN112329403A

CN112329403A - Live broadcast document processing method and device

Info

Publication number: CN112329403A
Application number: CN202011294997.8A
Authority: CN
Inventors: 李杨
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-11-18
Filing date: 2020-11-18
Publication date: 2021-02-05

Abstract

The embodiment of the application discloses a live broadcast document processing method and a live broadcast document processing device; the method and the device for displaying the live document editing page can display the live document editing page, wherein the live document editing page comprises a content editing area, and the content editing area comprises at least one content element of a live document; and displaying an editing control corresponding to the content element in response to the operation aiming at the content element, and displaying an edited live broadcast document in a live broadcast process based on the editing operation aiming at the editing control, wherein the edited live broadcast document is a live broadcast document obtained by replacing the content element with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation. The scheme can improve the processing efficiency of the live broadcast document, and improve the processing mode of the live broadcast document, so that the live broadcast can be efficiently carried out.

Description

Live broadcast document processing method and device

Technical Field

The application relates to the technical field of computers, in particular to a live broadcast document processing method and device.

Background

The network live broadcast is a social network mode, absorbs and continues the advantages of the internet, and can be combined with live broadcast documents to carry out online live broadcast in a video mode. The webcast can distribute product display, related meetings, background introduction, scheme evaluation, conversation interview, online training and other contents on the internet on site. The live broadcast effect of the activity is enhanced by utilizing the characteristics of intuition, rapidness, good expression form, rich content, strong interactivity, unlimited region, divisible audiences and the like of the Internet.

In the research and practice process of the related art, the inventor of the present application finds that various types of live documents are widely used in the application scene of the network live broadcast. When editing operations such as element replacement are required to be performed on content elements in an on-air document, the current processing method is inefficient and needs to be improved, for example, element replacement is currently achieved by adding new content elements after deleting the content elements to be replaced, which not only needs to cost a lot, but also causes the original document content in the original on-air document to be damaged. Therefore, the processing efficiency and processing mode of the current live documents need to be improved.

Disclosure of Invention

The embodiment of the application provides a live broadcast document processing method and device, which can improve the processing efficiency of live broadcast documents and improve the processing mode of the live broadcast documents, so that live broadcast can be efficiently carried out.

The embodiment of the application provides a live broadcast document processing method, which comprises the following steps:

displaying a live document editing page, wherein the live document editing page comprises a content editing area, and the content editing area comprises at least one content element of a live document;

and displaying an editing control corresponding to the content element in response to the operation aiming at the content element, and displaying an edited live broadcast document in a live broadcast process based on the editing operation aiming at the editing control, wherein the edited live broadcast document is a live broadcast document obtained by replacing the content element with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

Correspondingly, an embodiment of the present application further provides a live document processing apparatus, including:

the system comprises a page display unit, a content editing unit and a display unit, wherein the page display unit is used for displaying a live document editing page, the live document editing page comprises a content editing area, and the content editing area comprises at least one content element of a live document;

the document display unit is used for responding to the operation aiming at the content element, displaying an editing control corresponding to the content element, and displaying an edited live broadcast document in a live broadcast process based on the editing operation aiming at the editing control, wherein the edited live broadcast document is a live broadcast document obtained by replacing the content element with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

In one embodiment, the document display unit includes:

a list display subunit, configured to display, in response to an operation on the content element, a replacement control list on the live document editing page, where the replacement control list includes at least one element replacement control;

a metadata generation subunit configured to generate additional metadata describing a target replacement effect based on an element replacement operation for the element replacement control;

an adding subunit, configured to add the additional metadata to the content element to obtain an edited live broadcast document;

and the document display subunit is used for displaying the edited live broadcast document in the live broadcast process.

In an embodiment, the list display subunit is configured to:

displaying an editing control list on the live document editing page in response to the editing operation aiming at the content element, wherein the editing control list comprises a replacement triggering control; and responding to a replacement triggering operation aiming at the replacement triggering control, and displaying a replacement control list on the live document editing page, wherein the replacement control list comprises an element replacement control corresponding to at least one data acquisition module, and the data acquisition module is used for acquiring display data in a target replacement content element.

In one embodiment, the live document editing page includes an editing control menu, the editing control menu including at least one editing control; the list display subunit is configured to:

displaying a replacement trigger control in the editing control menu in response to an editing operation for the content element; and responding to the replacement triggering operation aiming at the replacement triggering control, and displaying a replacement control list on the live document editing page, wherein the replacement control list comprises at least one element replacement control corresponding to the element display mode.

In an embodiment, the metadata generation subunit is configured to:

determining private description data describing the target replacement content element based on an element replacement operation for the element replacement control, wherein the private description data comprises a type attribute and content information of the target replacement content element; generating additional metadata describing a target replacement effect according to the content element, the type attribute, and the content information.

In an embodiment, the replacement control list includes an element replacement control corresponding to at least one data acquisition module, where the data acquisition module is configured to acquire real-time data shown in the target replacement content element; the metadata generation subunit is specifically configured to:

determining a type attribute of the target replacement content element in response to an element replacement operation for the element replacement control; displaying a device selection window required by the determined data acquisition device on the live document editing page, wherein the device selection window comprises at least one candidate data acquisition device; determining a target data acquisition device selected by a user from the device selection window; and in response to a device selection completion operation for the device selection window, determining content information corresponding to the target replacement content element, wherein the content information includes acquisition path information of the real-time data.

In an embodiment, the replacement control list includes an element replacement control corresponding to at least one data acquisition module, where the data acquisition module is configured to acquire offline data shown in the target replacement content element; the metadata generation subunit is specifically configured to:

determining a type attribute of the target replacement content element in response to an element replacement operation for the element replacement control; displaying an offline file selection window required for acquiring the offline data on the live document editing page; determining an offline file selected by a user through the offline file selection window, wherein the offline file comprises the offline data; and in response to a file selection completion operation for the offline file selection window, determining content information corresponding to the target replacement content element, wherein the content information includes acquisition path information of the offline file.

In an embodiment, the replacement control list includes at least one element replacement control corresponding to the element display mode; the metadata generation subunit is specifically configured to:

determining a type attribute of the target replacement content element in response to an element replacement operation for the element replacement control; and determining content information corresponding to the target replacement content element based on an element display mode corresponding to the target replacement content element, wherein the content information comprises display effect information corresponding to the target replacement content element in the element display mode.

In an embodiment, the metadata generation subunit is specifically configured to:

acquiring a metadata generation template of information to be injected according to the content elements, wherein the metadata generation template comprises at least one identification node; according to the type attribute, carrying out type marking on the identification node to obtain a marked metadata generation template; and injecting the content information into the marked metadata generation template to generate additional metadata describing the target replacement effect.

In one embodiment, the document display subunit is configured to:

acquiring the edited live broadcast document, wherein the edited live broadcast document comprises content elements, and the content elements are added with additional metadata describing a target replacement effect; analyzing the additional metadata based on the identification node in the additional metadata to determine the type attribute and the content information of the target replacement content element; generating a target replacement content element of the content element according to the type attribute and the content information; and replacing the content element with the target replacement content element to obtain a replaced live broadcast document so that the live broadcast client displays the replaced live broadcast document in the live broadcast process.

In an embodiment, the document display subunit is specifically configured to:

determining the element type of the target replacement content element according to the type attribute; determining display data corresponding to the target replacement content element of the element type based on the content information; and filling the display data into the target replacement content element of the element type to generate a target replacement content element of the content elements.

In one embodiment, the page display unit includes:

the system comprises a first preparation display subunit, a second preparation display subunit and a display unit, wherein the first preparation display subunit is used for displaying a live broadcast preparation page of a live broadcast client, and the live broadcast preparation page comprises a document import trigger control of a live broadcast document;

and the first page display subunit is used for displaying a live document editing page based on the importing triggering operation aiming at the document importing triggering control.

In one embodiment, the page display unit includes:

the live broadcast display subunit is used for displaying a live broadcast page of a live broadcast client in a live broadcast process, wherein the live broadcast page comprises a content display area of a live broadcast document and a document editing control aiming at the live broadcast document;

and the second page display subunit is used for responding to the document editing operation aiming at the document editing control and displaying the live document editing page.

In one embodiment, the page display unit includes:

the second preparation display subunit is used for displaying a live broadcast preparation page of a live broadcast client, wherein the live broadcast preparation page comprises document link information of at least one live broadcast document;

and the third page display subunit is used for responding to the selection operation aiming at the document link information and displaying a live document editing page.

Correspondingly, the embodiment of the present application further provides a storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the live document processing method as shown in the embodiment of the present application.

Correspondingly, the embodiment of the present application further provides a computer device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the live document processing method shown in the embodiment of the present application when executing the computer program.

The method and the device for displaying the live document editing page can display the live document editing page, wherein the live document editing page comprises a content editing area, and the content editing area comprises at least one content element of a live document; and displaying an editing control corresponding to the content element in response to the operation aiming at the content element, and displaying an edited live broadcast document in a live broadcast process based on the editing operation aiming at the editing control, wherein the edited live broadcast document is a live broadcast document obtained by replacing the content element with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

The scheme can effectively replace the content elements in the live document with the target replacement content elements. Specifically, the scheme can determine additional metadata describing a target replacement effect based on an editing operation on a content element, and further determine a target replacement content element based on the additional metadata and the content element to be replaced, thereby realizing element replacement of a live document. In this way, by determining the additional metadata based on the editing operation on the content element, the additional metadata can be made to be an information carrier describing the target replacement effect desired by the user, that is, the user can present the target replacement effect desired by the user through the generated additional metadata by only performing a simple editing operation, such as a selection operation, on the content element. Furthermore, the scheme can realize element replacement by attaching the generated additional metadata to the content element to be replaced, and display the replacement effect in the live broadcast process, so that the element replacement can be realized on the basis of not damaging the original document content in the live broadcast document. Therefore, the scheme improves the processing efficiency of the live broadcast document, improves the processing mode of the live broadcast document and enables the live broadcast to be carried out efficiently.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1a is a scene schematic diagram of a live document processing method provided in an embodiment of the present application;

FIG. 1b is a flowchart of a live document processing method provided in an embodiment of the present application;

FIG. 2a is an interaction diagram of a live document processing method provided by an embodiment of the present application;

FIG. 2b is another interaction diagram of a live document processing method provided by an embodiment of the present application;

FIG. 2c is another interaction diagram of a live document processing method provided by an embodiment of the present application;

FIG. 2d is another interaction diagram of a live document processing method provided by an embodiment of the present application;

FIG. 2e is another interaction diagram of a live document processing method provided in an embodiment of the present application;

FIG. 2f is another interaction diagram of a live document processing method provided by an embodiment of the present application;

FIG. 2g is another interaction diagram of a live document processing method provided by the embodiment of the present application;

FIG. 2h is another interaction diagram of a live document processing method provided in an embodiment of the present application;

FIG. 2i is a metadata diagram of a live document processing method provided by an embodiment of the present application;

FIG. 2j is a schematic diagram of another metadata of a live document processing method according to an embodiment of the present application;

FIG. 2k is another metadata diagram of a live document processing method according to an embodiment of the present disclosure;

fig. 2l is a schematic diagram of a screen of a live document processing method according to an embodiment of the present application;

fig. 2m is a schematic diagram of a metadata parsing of a live document processing method provided in an embodiment of the present application;

fig. 3 is another schematic flow chart of a live document processing method provided in an embodiment of the present application;

FIG. 4a is a schematic structural diagram of a live document processing apparatus according to an embodiment of the present application;

FIG. 4b is a schematic structural diagram of a live document processing apparatus provided in an embodiment of the present application;

fig. 4c is another schematic structural diagram of a live document processing apparatus provided in an embodiment of the present application;

fig. 4d is another schematic structural diagram of a live document processing apparatus provided in an embodiment of the present application;

fig. 4e is another schematic structural diagram of a live document processing apparatus provided in an embodiment of the present application;

fig. 5 is a schematic structural diagram of a computer device provided in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides a live broadcast document processing method and device. Specifically, the embodiment of the application provides a live broadcast document processing device suitable for computer equipment. The computer device may be a server or a terminal. Specifically, the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, a big data and artificial intelligence platform, and the like. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.

The embodiment of the application introduces the live document processing method by taking the live document processing method as an example executed by a terminal.

The terminal can be operated with a live client, and a user can edit a live document required for live broadcasting through the live client, for example, content elements in the live document can be replaced with target replacement content elements.

Referring to fig. 1a, a terminal 10 may display a live document editing page on a live client, where the live document editing page may include a content editing area. A live document to be edited may be presented in the content editing region such that the content editing region may include content elements of the live document.

Further, the terminal 10 may determine private description data describing the targeted replacement content element based on an operation of the content element by the user, such as a one-click operation, a long-press operation, a double-click operation, a slide operation, a combination of a series of operations, and the like, wherein the private description data may include type attribute information and content information of the targeted replacement content element, so that the terminal may generate additional metadata describing a targeted replacement effect according to the content element to be replaced, the type attribute and the content information of the targeted replacement content element. And, the terminal 10 may edit the live document by attaching the generated additional metadata to the content element to be replaced, resulting in an edited live document.

After the live document is edited, the live client can start live broadcast later, and in the live broadcast process, the live client can replace the content element with a target replacement content element by analyzing the edited live document so as to present the display effect of the replaced live document.

In another embodiment, the live document processing method is introduced by taking as an example that the live document processing method is executed by a terminal and a server together, and the live document processing method is applied to a scene of online education.

Referring to fig. 1a, a live client on a teacher side and a live client on a student side may be included in online education. In practical applications, the client operating in the terminal 10 can be a teacher-side direct-broadcast client or a student-side direct-broadcast client.

A teacher can edit a live document required for teaching in a live document editing page of a teacher-side live broadcast client through the live document processing method, for example, the teacher can prepare a courseware document required for teaching before class, and before the classroom live broadcast is started through the teacher-side live broadcast client, the edited courseware document can be edited in the live document editing page, for example, content elements in the live document can be set and replaced by target replacement content elements, for example, picture elements in the live document can be replaced by a camera picture of the teacher; for another example, a dynamic effect may be added to the text element therein, and so on, to obtain the edited live document.

Furthermore, the teacher can start live classroom broadcast through the teacher-side live broadcast client, and during live classroom broadcast, the teacher-side live broadcast client can analyze the edited live broadcast document, so that the displayed live broadcast document has the content elements replaced by the target replacement content elements.

Accordingly, the server 20 may obtain video frame data on the teacher-side live broadcast client and send the video frame data to the student-side live broadcast client, so that the student can see the edited courseware document on the student-side live broadcast client, wherein the content element is replaced by the target replacement content element in the edited courseware document displayed on the student-side live broadcast client.

The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.

The method for processing the live broadcast document can be executed by a server or a terminal, and can also be executed by the server and the terminal together; the embodiment of the present application is described by taking an example that the live document processing method is executed by a terminal, and specifically, the terminal may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, and the like, but is not limited thereto. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein. In this embodiment of the present application, the method may be executed by a live document processing apparatus integrated in a terminal, and as shown in fig. 1b, a specific flow of the live document processing method may be as follows:

101. displaying a live document editing page, wherein the live document editing page includes a content editing region that includes at least one content element of a live document.

The live broadcast is a technology of acquiring data of a broadcast provider through certain equipment, performing a series of processing on the data of the broadcast provider, for example, compressing the data into a viewable and transmittable video stream through video coding, and outputting the processed data to a viewing user terminal. The type of live broadcast can be various, for example, live broadcast can include news live broadcast, shopping live broadcast, game live broadcast, classroom live broadcast, and the like.

Video technology has wide application in life, and can be used in the field of online education, for example. The online education is also called long-distance teaching and remote education, and refers to a mode of giving lessons by using the internet technology, breaks through the boundary line of time and space, and is different from the traditional teaching mode of needing to sit in a classroom in a school hall.

And the live broadcast client may be an application program running in the terminal for providing the live broadcast service, and accordingly, when the live broadcast technology is applied to the online education scene, the live broadcast client may be an application program for providing the online education service.

The live documents can be documents required for live broadcasting. For example, when live technology is applied in an office scenario, the live documents may be documents required during an office meeting, such as a demand analysis report, a bidding presentation file, a department summary file, and so on. For another example, when the live technology is applied to online education, the live document may be a document required in the online education process, such as a presentation file for introducing a new class, a presentation file for analyzing test paper, and the like.

The format of the live document may be various, and for example, may be a Portable Document Format (PDF), a text format, an image format, a video format, and the like.

Since the document content may be included in the live document, accordingly, several content elements may be included in the live document. For example, when the live document is a PDF formatted file, the text content, image content or other multimedia content, link content, background content, etc. included therein may be content elements of the live document.

The live document editing page can be a page required for editing a live document. A content editing area may be included in the live document editing page that may be used to edit content elements in the live document.

It should be noted that, in the following embodiments, the live broadcast technology may be applied to the online education field, and the live broadcast document is taken as a PDF file, for example, and the live broadcast document processing method may be described. In practical application, the live broadcast technology can be applied to other scenes, and the format of the live broadcast document can be in various situations, which is not limited in the present application.

In an embodiment, referring to fig. 2a, a live document editing page shown in fig. 2a may be displayed on a live client, where the page may include a content editing area shown by 201, and, although not labeled, the page may further include a thumbnail list of the live document and a plurality of editing controls, such as a withdrawal control, a forward control, a font adjustment control, a font size adjustment control, a bold control, a italic control, an underline control, a strikethrough control, a font color control, a graffiti control, an alignment control, a project symbol control, a numbering control, a class triggering control, an adding page control, and the like. The representation form of the control in this embodiment may be in the form of an icon, an input box, a button, and the like.

Referring to fig. 2a, a content display area shown in 201 may be used to display a live document content to be edited, shown in 202, and in the live document content, a number of content elements may be included, for example, image content elements and text content elements may be included, such as the image content element shown in 203 and the text content element shown in 204; and so on.

For example, a teacher may replace content elements of a live document required for live teaching in a lesson preparation stage before lessons, and accordingly, the live document editing page may be triggered and displayed in the lesson preparation stage. For another example, the teacher may also replace the content elements of the live document during the course of teaching, and accordingly, the live document editing page may also be triggered and displayed during the course of teaching; and so on.

The manner in which the live document editing page is triggered to be displayed is described below.

Since the teacher may have a need to edit the live document during the lesson preparation stage, specifically, the step "displaying the live document editing page" may include:

displaying a live broadcast preparation page of a live broadcast client, wherein the live broadcast preparation page comprises a document import trigger control of a live broadcast document;

and responding to the import triggering operation of the document import triggering control, and displaying a live document editing page.

The live broadcast preparation page can be used for preparing a live broadcast document for a user before live broadcast is started, and for example, the live broadcast preparation page can be used for checking or editing courseware files used for teaching by a teacher before a live broadcast classroom is started.

In one embodiment, a live preparation page as shown in FIG. 2b can be displayed on the live client, with a "prepare in class" text message on top of the page that can be used to prompt the teacher to review or edit the live document in the interface before starting the live lesson.

It should be noted that the live preparation page and the live document editing page may be displayed in the live client at the same time, and specifically include: the live broadcast preparation page and the live broadcast document editing page are displayed in a split screen mode; the live broadcast document editing page is displayed above the live broadcast preparation page in a floating layer mode, so that the live broadcast document editing page has transparency and cannot completely shield a live broadcast preparation interface. Of course, the live broadcast preparation page and the live broadcast document editing page may also be displayed at different times, for example, when an import trigger operation for the document import trigger control is received, the live broadcast preparation interface is switched to present the live broadcast document editing page.

The document import triggering control can be used for importing live documents by a user. The representation form of the control in this embodiment may be in the form of an icon, an input box, a button, and the like. For example, in the live preparation page shown in FIG. 2b, a document import trigger control shown at 205 may be included.

The importing triggering operation can be used for triggering the live broadcast document to be imported into the live broadcast client. The expression form of the import trigger operation in this embodiment may be a specific touch operation, such as a click operation, a long-time press operation, a double-click operation, a slide operation, and the like, and may also be triggered by a voice; optionally, the import trigger operation may also be a combination of a series of operations, and this embodiment does not limit this.

In one embodiment, the teacher may select a courseware file required for live lesson by clicking on the document import trigger control shown in 205 of FIG. 2b and import the courseware file into the live document editing page shown in FIG. 2 a. Specifically, the step "displaying a live document editing page in response to the import trigger operation for the document import trigger control" may include:

responding to the import triggering operation of the document import triggering control, and displaying a document selection window of the live broadcast document on the live broadcast preparation page;

and responding to the document selection completion operation aiming at the document selection window, and displaying a live document editing page of the live client.

The document selection window may be a window for a user to select a live document, for example, the user may select a document stored in the terminal through the window, and for example, the user may select a document stored in a network or a server through the window, and the like.

The document selection window and the live broadcast preparation page can be displayed in the live broadcast client at the same time, and specifically include: the document selection window and the live broadcast preparation page are displayed in a split screen mode; and displaying the document selection window above the live broadcast preparation page in a floating layer mode, so that the document selection window has transparency and cannot completely shield the live broadcast preparation page. Of course, the document selection window and the live preparation page may not be displayed at the same time, for example, when an import trigger operation for the document import trigger control is received, the live preparation page is switched to the presentation document selection window.

Wherein the document selection completion operation may be used to complete the selection of the live document. The expression form of the document selection completion operation in this embodiment may be a specific touch operation, such as a click operation, a long-time press operation, a double-click operation, a slide operation, and the like, and may also be triggered by a voice; optionally, the file selection completing operation may also be a combination of a series of operations, and this embodiment does not limit this.

In an embodiment, after clicking the document import trigger control shown in 205 in the live broadcast preparation page shown in fig. 2b, the teacher may display a document selection window of the live broadcast document above the live broadcast preparation page, and the teacher may select the live broadcast document through the document selection window. After determining the live document to be imported, the teacher may import the selected live document into the live document editing page by clicking the "determination" control in the document selection window, and accordingly, the live client may display the live document editing page as shown in fig. 2a, and the document content of the live document selected by the teacher may be displayed in the page.

Aiming at the requirement that a teacher edits live documents in a lesson preparation stage, the method can not only provide a document importing triggering control in a live broadcast preparation page, but also provide document link information of the live broadcast documents in the live broadcast preparation page, so that the teacher can import corresponding live broadcast documents into the live broadcast document editing page by using the document link information. Specifically, the step "displaying a live document editing page" may include:

displaying a live preparation page of a live client, wherein the live preparation page comprises document link information of at least one live document;

and displaying a live document editing page in response to a selection operation for the document link information.

The document link information of the live document may be link information that can be used to direct to the live document, and for example, the live document may be opened quickly through the document link information.

The representation form of the document link information may be various, for example, it may be in the form of a control shown at 206 in fig. 2 b; as another example, the document link information may be in the form of an icon, an input box, a two-dimensional code, a hyperlink, and the like.

Wherein the selecting operation can be used for realizing the selection of the document link information. The expression form of the selection operation in this embodiment may be a specific touch operation, such as a click operation, a long-time press operation, a double-click operation, a slide operation, and the like, and may also be triggered by a voice; optionally, the selecting operation may also be a combination of a series of operations, and this embodiment is not limited thereto.

In one embodiment, a live preparation page as shown in fig. 2b may be displayed on the live client, which may include document link information of the live document named "elementary english enter" as shown at 206, which is presented in the form of a control in fig. 2 b. The teacher may select a live document named "primary english entry" by clicking the control shown in 206 of fig. 2b and import the live document into the live document editing page shown in fig. 2a, and the live client may correspondingly present the live document editing page shown in fig. 2a and present the live document named "primary english entry" in the page.

The live document editing page of the live client can be triggered and displayed according to the requirement of the teacher for editing the live document in the course preparation stage. Specifically, the step "displaying a live document editing page" may include:

displaying a live broadcast page of a live broadcast client in a live broadcast process, wherein the live broadcast page comprises a content display area of a live broadcast document and a document editing control aiming at the live broadcast document;

and displaying a live document editing page in response to the document editing operation aiming at the document editing control.

The live broadcast page may be a page displayed after the live broadcast client starts the live broadcast, and live broadcast content, for example, document content of a live broadcast document, may be displayed in the page.

The live page may include a content presentation area of a live document, and the content presentation area may be used to present document content of the live document. In addition, the live broadcast page may further include a document editing control for the live broadcast document, and the document editing control may be configured to trigger display of the live broadcast document editing page for the live broadcast document in a live broadcast process. The representation form of the control in this embodiment may be in the form of an icon, an input box, a button, and the like.

The document editing operation can be used for triggering display of a live document editing page for a live document. The expression form of the document editing operation in this embodiment may be a specific touch operation, such as a click operation, a long-time press operation, a double-click operation, a slide operation, and the like, and may also be triggered by a voice; optionally, the document editing operation may also be a combination of a series of operations, and this embodiment does not limit this.

In an embodiment, after the teacher starts the live classroom broadcast through the live broadcast client, a live broadcast page as shown in fig. 2c may be displayed on the live broadcast client, where the live broadcast page includes a content display area of the courseware document as shown in 207, and the document content of the courseware document is displayed in the content display area. In addition, the live broadcast page may further include a document editing control shown in 208, and a teacher may edit a courseware document by clicking the document editing control shown in 208 in a live broadcast process in a classroom, and accordingly, the live broadcast client may display the live broadcast document editing page for the courseware document shown in fig. 2 a.

In practical application, the position of the document editing control can be adjusted according to requirements. In addition, the live broadcast page and the live broadcast document editing page can be displayed in the live broadcast client at the same time, and the method specifically comprises the following steps: the live broadcast page and the live broadcast document editing page are displayed in a split screen mode; and displaying the live document editing page above the live page in a floating layer mode. Of course, the live page and the live document editing page may also be displayed at different times, for example, when a document editing operation is received, switching from the live page to rendering the live document editing page.

In addition, it is noted that the live document editing page displayed on the live client in the classroom may be synchronously displayed on the live client of the student, so that the live document editing page, or the element replacement setting process implemented through the live document editing page, is visible to the student; or the live document editing page or the element replacement setting process realized by the live document editing page can be displayed on the live client of the student asynchronously, so that the live document editing page or the element replacement setting process realized by the live document editing page is invisible to the student. The specific settings may be adjusted based on business requirements, which are not limited in this application.

102. And displaying an editing control corresponding to the content element in response to the operation aiming at the content element, and displaying an edited live broadcast document in a live broadcast process based on the editing operation aiming at the editing control, wherein the edited live broadcast document is a live broadcast document obtained by replacing the content element with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

The expression form of the editing control in this embodiment may be in the form of an icon, an input box, a button, and the like.

In this embodiment, the expression form of the operation on the content element or the editing operation on the editing control may be a specific touch operation, such as a click operation, a long-time press operation, a double-click operation, a slide operation, or the like, or may be triggered by a voice; alternatively, a combination of a series of operations may be also possible, and this embodiment does not limit this.

When a content element in a live document is to be replaced, the element replacing the content element may be referred to as a target replacement content element. The target replacement content element may be of the same type as the content element to be replaced or of a different type from the content element to be replaced. For example, the target replacement content element may be a text content element, an image content element, a linked content element, a background content element, or the like; furthermore, the target replacement content element may also be other types of multimedia content elements, for example, content elements including camera pictures, content elements including video pictures, and so forth.

Metadata (Metadata), also called intermediate data and relay data layer, is data describing data or structural data for providing information about a certain resource. Metadata is data that describes an object such as an information resource or data, and is used for the purpose of: identifying a resource; evaluating the resources; tracking changes of the resource in the using process; the method realizes simple and efficient management of a large amount of networked data; the information resources are effectively discovered, searched and integrally organized, and the used resources are effectively managed.

In this embodiment, the additional metadata may be metadata describing a target replacement effect generated based on an editing operation for the editing control.

The following introduces the steps of "responding to the operation on the content element, displaying the editing control corresponding to the content element, and displaying the edited live broadcast document in the live broadcast process based on the editing operation on the editing control". Specifically, the step may include:

displaying a replacement control list on a live document editing page in response to an operation on a content element, wherein the replacement control list comprises at least one element replacement control;

generating additional metadata describing a target replacement effect based on an element replacement operation for the element replacement control;

adding the additional metadata to the content elements to obtain an edited live broadcast document;

and displaying the edited live broadcast document in the live broadcast process.

The replacement control list is a list comprising at least one element replacement control, and the element replacement control can be used for triggering a series of element replacement operations aiming at the content element.

The representation form of the control in this embodiment may be in the form of an icon, an input box, a button, and the like.

Because the expression form of the operation on the content element in this embodiment may be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, a sliding operation, and the like, and may also be triggered by a voice; alternatively, the operation for the content element may also be a combination of a series of operations. Accordingly, there may be a variety of ways to display the list of replacement controls on the live document editing page based on operations directed to the content elements, as will be described below.

In an embodiment, the target replacement content element may be a multimedia content element, for example, a content element including a camera picture, a content element including a video picture, and so on. And, the user may be ultimately directed to the element replacement control based on a combination of the user's operations directed to the content element to be replaced. Thus, in particular, the step "in response to the operation on the content element, displaying a list of replacement controls on the live document editing page, wherein the list of replacement controls includes at least one element replacement control", may include:

responding to the editing operation aiming at the content elements, and displaying an editing control list on a live document editing page, wherein the editing control list comprises a replacement triggering control;

and responding to a replacement triggering operation aiming at the replacement triggering control, and displaying a replacement control list on the live document editing page, wherein the replacement control list comprises an element replacement control corresponding to at least one data acquisition module, and the data acquisition module is used for acquiring display data in a target replacement content element.

The editing control list may be a list including a plurality of editing controls, for example, the editing control list may include a replacement trigger control, and the replacement trigger control may be used to trigger presentation of the selectable element replacement control, for example, by triggering the control, a replacement control list including the element replacement control is presented, so that the element replacement control is also presented.

The data acquisition module may be a module required for acquiring the display data in the target replacement content element, for example, the data acquisition module may include a camera device required for acquiring the camera picture data, and accordingly, the display data in the target replacement content element may be the acquired camera picture data; for another example, the display data in the target substitute content element may be the acquired video picture data, and the like, if the display data includes related equipment required for acquiring the video picture data on the terminal or the network or the server.

In one embodiment, a live document editing page, as shown in FIG. 2a, may be displayed on the live client, including the image content elements shown at 203. Referring to fig. 2d, the teacher may select the image content element by clicking, accordingly, the live client may show the state of the image content element after being selected as shown in 209 in fig. 2d, and may display an editing control list shown in 210 on the live document editing page after selecting the image content element, wherein the editing control list includes a replacement trigger control shown in 211.

In addition, when the teacher places a mouse on the replacement trigger control 211, the live broadcast client may correspondingly display a prompt text of "enhanced element" below the control, so as to prompt that the image content element may be enhanced by an operation based on the control, for example, replacing the image content element with a content element including a camera picture, or replacing the image content element with a content element including a video picture, and so on.

Further, after the teacher clicks the replacement trigger control shown in 211, the live client may display a replacement control list on the live document editing page as shown in fig. 2e, where the replacement control list may include an element replacement control corresponding to at least one data acquisition module, for example, referring to fig. 2e, where an element replacement control shown in 212 is included, and the control may be used to replace the image content element with a camera picture; an element replacement control, shown at 213, is also included that can be used to replace the image content element with a video picture.

It should be noted that the expression form of the editing operation or the replacement triggering operation in this embodiment may be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, a sliding operation, and the like, and may also be triggered by a voice; optionally, the editing operation or the replacing triggering operation may also be a combination of a series of operations, which is not limited in this embodiment.

In another embodiment, the target replacement content element and the content element to be replaced may belong to the same element type but have different content information, for example, the content information in the content element to be replaced may be static content information, and the content information in the target replacement content element may be dynamic content information obtained by adding a dynamic presentation effect to the static content information, and so on. And the live document editing page may include an editing control menu, and when the editing control menu may include at least one editing control, the user may be finally guided to the element replacement control based on a combination of operations of the user for the content element to be replaced. Specifically, the step "in response to the operation on the content element, displaying a replacement control list on the live document editing page, wherein the replacement control list includes at least one element replacement control", may include:

displaying a replacement trigger control in the edit control menu in response to an operation on the content element;

and responding to the replacement triggering operation aiming at the replacement triggering control, and displaying a replacement control list on the live document editing page, wherein the replacement control list comprises at least one element replacement control corresponding to the element display mode.

The editing control menu may be a menu including a plurality of editing controls, for example, the editing control menu may include a replacement triggering control, and the replacement triggering control may be used to trigger and display the selectable element replacement control, for example, by triggering the control, a replacement control list including at least one element replacement control corresponding to the element display mode is displayed, so that the element replacement control is also displayed.

The element presentation mode is a mode followed when a content element in a live document is presented, for example, the element presentation mode may be a mode followed when the content element appears in a live page; as another example, an element presentation mode may be a mode followed by presentation of a content element leaving a live page; as another example, an element presentation pattern may be a pattern followed when a content element is presented with emphasis in a live page; and so on.

In one embodiment, a live document editing page, as shown in FIG. 2a, may be displayed on the live client, including the image content elements shown at 203. Referring to fig. 2d, the teacher may select the image content element by clicking on it in a live document editing page, which may include an editing control menu shown at 214, in which at least one editing control may be included. Accordingly, the live client may present the image content element as shown in 209 of fig. 2d in a selected state, and, upon selection of the image content element, may trigger an alternate trigger control shown at 215 in the edit control menu 214.

Wherein the replacement triggering control shown at 215 can be used to trigger the presentation of the corresponding element replacement control in at least one element presentation mode. Further, after the teacher clicks on the replacement trigger control shown at 215, the live client may display a list of replacement controls 216 on the live document editing page as shown in fig. 2f, where the list of replacement controls may include the corresponding element replacement control in at least one element presentation mode.

For example, referring to fig. 2f, the replacement control list shown in 215 includes a plurality of element replacement controls corresponding to three element display modes, specifically, includes "in-scene animation", which is a display mode followed by a content element appearing in a live page, includes "out-scene animation", which is a display mode followed by a content element leaving a live page, and includes "emphasis animation", which is a display mode followed by a content element being highlighted in a live page. Each presentation mode may include a number of corresponding element replacement controls.

After introducing the step "displaying a replacement control list on the live document editing page in response to the operation on the content element, wherein the replacement control list includes at least one element replacement control", the following step may introduce the step "generating additional metadata describing a target replacement effect based on the element replacement operation on the element replacement control", and specifically, the step may include:

determining private description data describing a target replacement content element based on an element replacement operation for an element replacement control, wherein the private description data comprises a type attribute and content information of the target replacement content element;

additional metadata describing the target replacement effect is generated according to the content element, the type attribute, and the content information.

The expression form of the element replacement control in this embodiment may be in the form of an icon, an input box, a button, and the like.

The expression form of the element replacement operation in this embodiment may be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, a sliding operation, and the like, and may also be triggered by a voice; alternatively, a combination of a series of operations may be also possible, and this embodiment does not limit this.

The private description data may be related data describing a process of replacing a content element, and specifically may be private data describing how to replace a content element to be replaced with a target replacement content element. The private data is protected, non-public, or conditionally shared data, as opposed to public data, for example, in practical applications, an editor may be designed, and the editor may replace a content element in a PDF document by generating private description data to obtain an edited PDF document, and a reader may be designed, and the reader may display the PDF document after replacing the content element by reading and analyzing the private description data. In this process, private description data can be generated only by the editor and can also be read and parsed only by the reader, and the private description data is private, protected, and non-public. For another example, conditional sharing may be set for the private description data, and a developer or an application may obtain or parse the private description data after the set condition is satisfied, so as to implement a content element replacement operation.

For example, in this embodiment, since when the content element to be replaced is replaced with the target replacement content element, the target replacement content element of the content element to be replaced may be determined by determining the type attribute of the target replacement content element, that is, what type of content element the target replacement content element is, and determining the content information presented in the target replacement content element, in this embodiment, the private description data may include the type attribute and the content information of the target replacement content element.

The type attribute of the target replacement content element may be an element type describing the target replacement content element. For example, the type attribute of the target replacement content element may be a text content element, an image content element, a link content element, a background content element, or the like; furthermore, other types of multimedia content elements are also possible, for example, content elements including camera pictures, content elements including video pictures, and so on.

Wherein the content information of the target alternative content element can be used for describing the presentation content presented by the target alternative content element with the determined element type. For example, when the target replacement content element is a textual content element, the content information of the target replacement content element may be textual information presented by the textual content element; as another example, when the target replacement content element is an image content element, the content information of the target replacement content element may be the image information presented by the image content element.

For another example, when the target replacement content element is a content element including a camera screen, the content information of the target replacement content element may be the camera screen presented by the target replacement content element; for another example, when the target replacement content element is a content element that includes a video picture, the content information of the target replacement content element may be the video picture that the target replacement content element presents.

For another example, when the content element to be replaced and the target replacement content element belong to the same element type, the content information of the target replacement content element may be the content information of the content element to be replaced, in which a dynamic effect is set; and so on.

Since the element replacement control has various expressions, for example, it may be an element replacement control that implements "replace with camera screen" shown in 212 in fig. 2e, an element replacement control that implements "replace with video screen" shown in 213 in fig. 2e, an element replacement control in a different element presentation mode shown in the list 216 in fig. 2f, and the like, there may be various ways of determining the type attribute and the content information of the target replacement content element based on the element replacement operation for the element replacement control, which will be described below.

In an embodiment, the replacement control list may include at least one element replacement control corresponding to the data collection module, and the data collection module may be configured to collect real-time data shown in the target replacement content element, and in particular, the step "determining private description data describing the target replacement content element based on an element replacement operation for the element replacement control, where the private description data includes a type attribute and content information of the target replacement content element" may include:

determining a type attribute of the target replacement content element in response to an element replacement operation for the element replacement control;

displaying a device selection window required by the determined data acquisition device on a live document editing page, wherein the device selection window comprises at least one candidate data acquisition device;

determining a target data acquisition device selected by a user from the device selection window;

and in response to the device selection completion operation aiming at the device selection window, determining the content information corresponding to the target replacement content element, wherein the content information comprises the acquisition path information of the real-time data.

The device selection window may be a window required for a user to select a data acquisition device, and therefore, at least one candidate data acquisition device may be included in the device selection window, for example, at least one optional image capture device may be included. Optionally, the device selection window may further include other function controls, for example, referring to fig. 2g, the device selection window may further include a function control that turns the camera picture 180 degrees, a function control that performs mirror image camera preview, and a function control that only performs preview; and so on.

The data acquisition device may be a device required for data acquisition, and may be, for example, a camera device, a recorder device, or the like.

The real-time data may be data acquired in real time by a data acquisition device, for example, the real-time data may be image data acquired by an image pickup device; as another example, the real-time data may be recorded data acquired by a recorder device; and so on.

The acquisition path information of the real-time data may be related path information required for acquiring the real-time data. The expression form of the acquisition path information of the real-time data may be various, for example, the expression form may be an identifier of the data acquisition device, such as an Identity Document (ID) or a device name; for another example, the data may be stored in a data storage path corresponding to the data acquisition device; and so on.

In an embodiment, a replacement control list including the element replacement control 212 and the element replacement control 213 as shown in fig. 2e may be displayed in the live document editing page, where the element replacement control 212 may correspond to a real-time data acquisition module, and the real-time data acquisition module may be configured to acquire real-time data shown in the target replacement content element, for example, picture data acquired by a camera.

Further, the teacher may determine to replace the image content element to be replaced with the camera image by clicking the element replacement control 212 shown in fig. 2e, and the live broadcast client may accordingly determine, in response to an element replacement operation of the teacher with respect to the element replacement control 212, that the target replacement content element is a content element including the camera image, that is, determine a type attribute of the target replacement content element.

Further, the live client may display a device selection window on the live document editing page that is needed to determine the data capture devices, for example, the device selection window may be as shown in 217 of fig. 2g, and as shown in 218 of fig. 2g, the device selection window includes at least one candidate data capture device: "image pickup apparatus a", "image pickup apparatus B", and the like.

The teacher may select from the candidate data collection devices through the device selection window, and the live broadcast client may also determine the target data collection device selected by the teacher from the device selection window accordingly, for example, referring to fig. 2g, the teacher may select "camera device a" as the target data collection device. After the target data collection device is determined, the real-time data collected by the target data collection device may be determined as content information corresponding to the target replacement content element, for example, the content information may include acquisition path information of the real-time data, such as an equipment account (ID) or an equipment name of the data collection device, or a data storage path corresponding to the data collection device, and the like.

It should be noted that the expression form of the element replacement operation or the device selection completion operation in this embodiment may be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, a sliding operation, or the like, and may also be triggered by a voice; optionally, the element replacing operation or the device selecting and completing operation may also be a combination of a series of operations, which is not limited in this embodiment.

In another embodiment, the replacement control list may include an element replacement control corresponding to at least one data collection module, and the data collection module may be configured to collect offline data shown in the target replacement content element, and in particular, the step "determining private description data describing the target replacement content element based on an element replacement operation for the element replacement control, where the private description data includes a type attribute and content information of the target replacement content element" may include:

displaying an offline file selection window required for acquiring offline data on a live document editing page;

determining an offline file selected by a user through the offline file selection window, wherein the offline file comprises offline data;

and in response to the file selection completion operation aiming at the offline file selection window, determining content information corresponding to the target replacement content element, wherein the content information comprises the acquisition path information of the offline file.

The offline file selection window may be a window required for the user to select the offline file, for example, the offline file selection window may be as shown in fig. 2 h.

The offline data is opposite to the real-time data, and may be the existing data resources which are not required to be acquired in real time by the data acquisition equipment, but acquired by inquiry, search or request. For example, the offline data may be data resources such as video files, images, audio, text and the like stored on the terminal; for another example, the offline data may be data resources such as video files, images, audio, text and the like acquired through a network or requested to be acquired from a server; and so on.

The obtaining path information of the offline data may be related path information required for obtaining the offline data. The expression form of the acquisition path information of the offline data may be various, for example, the expression form may be a storage path or a name of the offline data on the terminal; as another example, the network or the server may be requested for an identifier required when offline data is requested, such as a web address (URL), an offline data name, an offline data ID, and so on.

In an embodiment, a replacement control list including the element replacement control 212 and the element replacement control 213 as shown in fig. 2e may be displayed in the live document editing page, where the element replacement control 213 may correspond to an offline data collection module, and the offline data collection module may be configured to collect offline data shown in the target replacement content element, for example, a video file stored on the terminal.

Further, the teacher may determine to replace the image content element to be replaced with the video picture by clicking the element replacement control 213 shown in fig. 2e, and the live broadcast client may accordingly determine, in response to the teacher performing the element replacement operation on the element replacement control 213, that the target replacement content element is the content element including the video picture, that is, determine the type attribute of the target replacement content element.

Further, the live client may display an offline file selection window required for acquiring offline data on the live document editing page, for example, the offline file selection window may be as shown in fig. 2 h. In one embodiment, as shown in fig. 2h, the offline file selection window may include at least one candidate offline file: "video a" and "video B".

The teacher may select an offline file required for element replacement through an offline file selection window, where the selected offline file may include required offline data, for example, referring to fig. 2h, the teacher may select "video a" from the offline file selection window, and the live client may accordingly determine the offline file selected by the teacher from the offline file selection window.

After the teacher selects an offline file from the offline file selection window, the live broadcast client may determine, in response to a file selection completion operation for the offline file selection window, for example, a trigger operation for an "open" control in fig. 2h, offline data included in the offline file selected by the teacher as content information corresponding to the target replacement content element. In one embodiment, the content information may include a storage path or name of the offline data on the terminal, and may include a storage path or name of "video a" on the terminal, for example.

In another embodiment, the replacement control list may include at least one element replacement control corresponding to the element exhibition mode, and specifically, the step "determining private description data describing the target replacement content element based on an element replacement operation for the element replacement control, where the private description data includes a type attribute and content information of the target replacement content element" may include:

and determining content information corresponding to the target replacement content element based on the element display mode corresponding to the target replacement content element, wherein the content information comprises display effect information corresponding to the target replacement content element in the element display mode.

Thus, different presentation effects may be set for content elements in different element presentation modes. Since the content element may include the element type and the content information, after the element display mode of the content element is determined, the content information to which the display effect corresponding to the element display mode is added may be determined, that is, the content information may include the display effect information corresponding to the content element in the element display mode.

The display effect information may be related information describing a display effect of the content element in the corresponding element display mode. The presentation form of the exhibition effect information may be various, for example, the data such as the name and duration of the exhibition effect may be mapped to a specific exhibition effect, and thus, the data such as the name and duration of the exhibition effect may be used as the exhibition effect data; for another example, the content element can be accurately displayed in the process of displaying the live document by setting a response event of the display effect, so that the name, duration and response event of the display effect can be used as display effect data; and so on.

For example, an element presentation schema may be set to: when a content element appears in a live page, it appears with a "fade-in" effect, and the effect lasts for 0.3 second, then the corresponding presentation effect information may include "fade-in" and 0.3 second; for another example, an element presentation mode may be set as: when the content element leaves the live page, leaves with an "erase" effect, and the effect lasts for 0.4 second, the corresponding presentation effect information may include "erase" and 0.4 second; for another example, an element presentation mode may be set as: when the content element appears on the live page, in response to the user's emphasis triggering operation on the content element, the content element is highlighted again with an "enlargement" effect, and then the corresponding display effect information may include "enlargement" and emphasis triggering operations; and so on.

In an embodiment, a replacement control list as shown in 216 in fig. 2f may be displayed in a live document editing page, where the replacement control list 216 includes at least one element replacement control corresponding to an element display mode, and a teacher may select the element replacement control by clicking to trigger an increase of a display effect, such as a dynamic display effect, on a content element to be replaced. Accordingly, the live client may determine that the target replacement content element is the same type element as the content element to be replaced in response to the element replacement operation of the teacher with respect to the element replacement control.

For example, upon selection of an image content element to be replaced, the teacher chooses to add a presentation effect for that image content element that "fades in" when it appears, and that effect may last 0.3 seconds when presented. Accordingly, the live client may accordingly determine the image content element to which the "fade-in" effect is added as a target replacement content element, wherein the target replacement content element may include, in addition to the content information of the picture to be presented, corresponding presentation effect information, such as "fade-in" and 0.3 seconds.

It should be noted that the expression form of the element replacement operation in this embodiment may be a specific touch operation, such as a single-click operation, a long-press operation, a double-click operation, a sliding operation, and the like, and may also be triggered by a voice; optionally, the element replacing operation may also be a combination of a series of operations, and the embodiment is not limited thereto.

After determining the type attribute of the targeted replacement content element and the corresponding content information, the private description data of the targeted replacement content element may be determined accordingly.

After introducing the step "determining private description data describing the target replacement content element based on the element replacement operation for the element replacement control, wherein the private description data includes the type attribute and the content information of the target replacement content element", the following step may introduce the step "generating additional metadata describing a target replacement effect according to the content element, the type attribute, and the content information", and specifically, the step may include:

acquiring a metadata generation template of information to be injected according to the content elements, wherein the metadata generation template comprises at least one identification node;

according to the type attribute, carrying out type marking on the identification node to obtain a marked metadata generation template;

content information is injected into the tagged metadata generation template to generate additional metadata describing the target replacement effect.

The metadata generation template may be a template required for generating metadata describing a target replacement effect, the metadata generation template may include preset modules and nodes, and the metadata may be generated by injecting required data into the metadata generation template.

The identified node in the metadata generation template may be a node that plays an identifying role in the metadata generation template, for example, a tag label in the metadata generation template may be generated for the metadata.

The representation of the identified node may be various, for example, a keyword surrounded by an angle bracket, such as < PdfMetadata >. In one embodiment, the identification nodes may appear in pairs, e.g., < PdfMetadata > and </PdfMetadata >, and the first identification node in the pair of identification nodes may be a beginning identification node and the second identification node may be an ending identification node; in another embodiment, the identified nodes may also be presented separately.

And no matter the identification nodes which appear in pairs or the identification nodes which appear separately, the identification nodes can be assigned with values, so that the identification nodes are marked. For example, when assigning values to identification nodes appearing in pairs, the assignment content may be between two identification nodes, such as < exemplarettype > videotext </exemplartttype >; alternatively, in the start identification node, for example, < File path ═ C: mp4 "fileName ═ video presentation mp 4" >/File >; for another example, for a tag that is presented separately, when a value is assigned, the assigned content can be in the identified node.

In this embodiment, after determining the type attribute to which the target replacement content element belongs, the type marking may be performed on the identifier node in the metadata generation template, so that the marked metadata generation template includes the type attribute information of the target replacement content element.

For example, in the metadata generation template, type tagging of the identification node may be achieved by assigning a type attribute of the target replacement content element to the identification node pair < exemplarettype > </exemplarettype >. For example, when the target replacement content element is a content element including a camera picture or a content element including a video picture, the following flags may be made: < exemplarType > VideoStream </exemplarType >; for another example, when the target replacement content element is a content element with a dynamic presentation effect, the following marking may be performed: < exemplar type > animal </exemplar type >; and so on.

After the type marking is carried out on the identification nodes according to the type attribute of the target replacement content element to obtain the marked metadata generation template, the content information can be injected into the marked metadata generation template to generate additional metadata describing the target replacement effect.

Because, the content information of the target alternative content element can be used to describe the presentation content presented by the target alternative content element for which the element type is determined. Therefore, there are various ways to generate a template by injecting the content information into the marked metadata, which will be described below as an example.

In an embodiment, the format of the live document may be PDF, and the image content elements in the live document may be replaced with content elements including a camera view, i.e., the element type of the target replacement content element may be a video stream element. Referring to fig. 2i, the identification node pair < exemplarttype > </exemplarttype > may be assigned to VideoStream to identify that the target replacement content element is a video stream element, and content information of the video stream element may be described in detail by the identification node pair < VideoStream _ source > </VideoStream _ source >. Referring to fig. 2i, in the metadata generation template, the identification node pair < video stem scan > </video stem scan > is nested in the identification node pair < Camera > </Camera >, and by assigning the identification node < Camera > </Camera > to id (deviceid) and name (deviceName) of the Camera device that collects the Camera picture, the content information of the target replacement content element is injected into the marked metadata generation template, thereby obtaining the additional metadata describing the target replacement effect as shown in b2 i.

In another embodiment, the format of the live document may be PDF and the text content elements in the live document may be replaced with content elements comprising video pictures, i.e., the element type of the target replacement content element may be a video stream element. Referring to fig. 2j, the identification node pair < exemplarttype > </exemplarttype > may be assigned to VideoStream to identify that the target replacement content element is a video stream element, and content information of the video stream element may be described in detail by the identification node pair < VideoStream _ source > </VideoStream _ source >. Referring to fig. 2j, in the metadata generation template, the identification node < File > is nested in the identification node < video metadata > </video metadata >, and the content information of the target replacement content element is injected into the marked metadata generation template by assigning the identification node < File > to the storage path (filePath) and the name (fileName) of the video File, so as to obtain the additional metadata describing the target replacement effect as shown in b2 i.

In another embodiment, the format of the live document may be PDF, and the image content elements in the live document may be replaced by image content elements to which dynamic presentation effects are added, for example, the dynamic presentation effects may be: the fade-in occurs for 0.3 seconds and shows the effect as the page appears. Then, when the live client displays the PDF file, the original image content element may be replaced with the image content element to which the dynamic display effect is added, that is, the element type of the target replacement content element may be a content element with a dynamic display effect. Referring to fig. 2k, the identification node pair < ExementType > </ExementType > may be assigned to identify that the target replacement content element is a content element having a dynamic presentation effect, and the content information of the target replacement content element may be described in detail by the identification node pair < exemmatetype > </exemmatetype >. Referring to fig. 2k, In the metadata generation template, the identification node pair < In > </In > is nested In the identification node pair < animattype > </animattype >, and by assigning the identification node pair < In > </In > as the type (action), duration (time), and response event (start) of the dynamic exhibition effect, the content information of the target replacement content element is injected into the marked metadata generation template, thereby obtaining the additional metadata describing the target replacement effect as shown In b2 i.

When the additional metadata describing the target replacement effect is generated, the additional metadata describing the target replacement effect can be attached to the content element to be replaced, so that the live broadcast document can be edited, and the edited live broadcast document can be obtained.

For example, the live document may be a file in PDF format. Since support for the source data stream by elements in the PDF file is added since version 1.4 of PDF, the PDF can be expanded and extensible metadata based on the extensible markup language (XML) standard, such as in other file formats, can be added using the extensible metadata platform (XMP). This allows metadata to be attached to any word stream in the document, such as with respect to adding an incoming animation, special camera picture elements are implemented.

In one embodiment, referring to fig. 2l, 219 may be an image content element in a PDF file, which may be replaced by a content element including a camera screen by the live document processing method described in this application, so that after replacement, the content element shown in 219 is extended as an enhanced object in the PDF.

In addition, any overlay or layout between the content element corresponding to the extended enhanced object and the normal content element may be performed, for example, referring to fig. 2l, 219 is the extended video stream content element, and 220, 221 and 222 are all the normal content elements in the PDF file, that is, the content elements that are not extended, and it can be seen that any overlay or layout may be performed between the normal content element and the video stream content element.

After the additional metadata is added to the content elements to obtain the edited live broadcast document, the edited live broadcast document can be displayed in the live broadcast process. Specifically, the step "displaying the edited live document during live broadcasting" may include:

acquiring an edited live broadcast document, wherein the edited live broadcast document comprises a content element, and the content element is added with additional metadata describing a target replacement effect;

analyzing the additional metadata based on the identification node in the additional metadata to determine the type attribute and the content information of the target replacement content element;

generating a target replacement content element of the content element according to the type attribute and the content information;

and replacing the content element with a target replacement content element to obtain a replaced live broadcast document so that the live broadcast client can display the replaced live broadcast document in the live broadcast process.

In an embodiment, a teacher may process a PDF-formatted live document in a live client by using the live document processing method described in this application. For example, the teacher may replace a content element a in the live document with a video stream content element B, and specifically, may generate, by the live client, additional metadata describing a target replacement effect and attach the additional metadata to the content element to be replaced, to obtain an edited live document.

Further, when the live broadcast client displays the edited live broadcast document, for example, when a teacher uses a replaced PDF file to start live broadcast in a classroom, the terminal may read and parse additional metadata in the edited live broadcast document, and render using a picture source described by the additional metadata, so as to display the edited live broadcast document on the live broadcast client, that is, the teacher displays a video stream content element B instead of a content element a in the PDF file displayed on the live broadcast client, that is, the content element a is replaced by the video stream content element B.

In an embodiment, the content element in the live document may be replaced by a video stream content element, for example, a content element including a camera picture, or a content element including a video picture, and then the additional metadata format parsing flow may refer to fig. 2 m:

after acquiring the edited live broadcast document, the terminal can read additional metadata from the edited live broadcast document and analyze the additional metadata. Specifically, the value of the exemplarttype may be first determined by reading the identification node pair < exemplarttype > </exemplarttype > nested in the identification node pair < pdfmmetadata > </pdfmmetadata > in the additional metadata, thereby determining the type attribute of the target substitute content element. Referring to fig. 2m, the read value of exementatype is VideoStream, that is, the type of the target substitute content element is determined to be a video stream content element.

Further, the nested child identification node in the identification node pair may be determined by reading identification node pair < videotraffic _ length > </videotraffic _ length > to determine the content information of the target replacement content element. Specifically, referring to fig. 2m, if the sub identifier node is < File > </File >, that is, the target replacement content element is a content element including a video picture, the filePath, that is, the storage path of the video File, may be obtained by reading the value of the sub identifier node < File > </File >; if the sub-identifier node is < Camera > </Camera >, that is, the target replacement content element is a content element including a Camera picture, the deviceID can be obtained by reading the value of the sub-identifier node < Camera > </Camera >, that is, the Camera device required for acquiring the Camera picture is acquired.

After determining the type attribute and the content information of the target replacement content element, the target replacement content element of the content element may be generated according to the type attribute and the content information, and specifically, the step "generating the target replacement content element of the content element according to the type attribute and the content information" may include:

determining the element type of the target replacement content element according to the type attribute;

determining display data corresponding to the target replacement content element of the element type based on the content information;

the presentation data is populated to the target replacement content element of the element type to generate a target replacement content element of the content element.

In an embodiment, referring to fig. 2m, when the content element to be replaced is an image content element and the target replacement content element is a content element including a video picture, the video file to be displayed may be obtained by opening a file specified by filePath, and the terminal may render the video picture in the video file to the target replacement content area to realize the replacement of the content element.

In another embodiment, referring to fig. 2m, when the content element to be replaced is an image content element and the target replacement content element is a content element including a camera screen, the camera screen to be displayed may be acquired by turning on a device specified by the deviceID, and the terminal may render the camera screen to the target replacement content area to achieve replacement of the content element.

As can be seen from the above, the present embodiment may display a live document editing page, where the live document editing page includes a content editing area, and the content editing area includes at least one content element of a live document; and displaying an editing control corresponding to the content element in response to the operation aiming at the content element, and displaying an edited live broadcast document in a live broadcast process based on the editing operation aiming at the editing control, wherein the edited live broadcast document is a live broadcast document obtained by replacing the content element with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

Moreover, the scheme provides various modes for triggering the editing of the live broadcast document, for example, the editing of the live broadcast document can be performed before the live broadcast starts, and can also be performed in the live broadcast process, so that various functions are provided for a user, the processing efficiency of the live broadcast document is greatly improved, and the live broadcast can be performed more efficiently.

In addition, the scheme takes a live document as a PDF format file as an example, and content elements in the generated PDF can be replaced, for example, the generated PDF can be replaced by content elements including a camera picture or a video picture. For example, when the scheme is applied to an online education scene, the content elements in the PDF courseware can be replaced with content elements including camera pictures, so that in live classroom, students can see the head portrait, the body language, the expression and the like of teachers during teaching through the camera pictures in the PDF files. Further, compared with the traditional online education application scene, if the courseware content needs to be displayed for students and the camera picture of a teacher needs to be displayed for the students, the server needs to send two paths of video pictures to the student client, and the scheme replaces the content elements in the PDF file with the video stream content elements, so that the video stream content elements are embedded in the PDF file, therefore, the server only needs to send one path of video pictures to the student client, so that the scheme can avoid the waste of computing resources and improve the utilization rate of the computing resources.

The method described in the above examples is further described in detail below by way of example.

In this embodiment, a live document processing apparatus is integrated in a server and a terminal, and the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, and a big data and artificial intelligence platform. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.

As shown in fig. 3, a live document processing method specifically includes the following steps:

301. the terminal displays a live document editing page of a first live client, wherein the live document editing page comprises a content editing area, and the content editing area comprises content elements of a live document.

In this embodiment, the first live broadcast client may be a live broadcast client of an anchor broadcast in a live broadcast popularization application scenario, and the live broadcast document may be a popularization document in a PDF format.

In practical application, there are various conditions at the time of triggering and displaying the live document editing page of the first live client, for example, a live preparation stage before live promotion is started for a main broadcast; for another example, the promotion document may be edited in the live broadcasting process for the anchor.

302. The terminal determines private description data describing the target replacement content element based on an editing operation for the content element, wherein the private description data includes a type attribute and content information of the target replacement content element.

The editing operation of the anchor for the content element may include multiple operations, for example, may include simple operations such as inserting and editing pictures, characters, shapes, and the like; as another example, replacement of an existing content element with an enhanced picture-type content element may be included such that the existing content element may be replaced with a content element including a camera picture or a video picture; for another example, a dynamic presentation effect may be added to an existing content element, where the dynamic presentation effect may include an incoming animation, such as fade-in, slide-in, etc.; or a fade-out animation, such as fade-out, slide-out, etc.; or emphasis animation, such as flashing, zooming, etc.

Further, the terminal may determine private description data describing the targeted replacement content element based on an editing operation of the anchor with respect to the content element, wherein the private description data may include a type attribute and content information of the targeted replacement content element.

303. The terminal generates additional metadata describing the object replacement effect according to the content element, the type attribute, and the content information.

In an embodiment, the terminal may obtain a metadata generation template of the information to be injected according to the content element to be replaced, where the metadata generation template may include at least one identification node. Further, the terminal can mark the type of the identification node according to the type attribute, and obtain a marked metadata generation template. The terminal may inject the content information into the marked metadata generation template to generate additional metadata describing the target replacement effect.

304. And the terminal attaches the additional metadata to the content element to obtain the edited live broadcast document.

Since support for the source data stream by elements in the PDF file is added since version 1.4 of PDF, the PDF can be expanded and extensible metadata based on the extensible markup language (XML) standard, such as in other file formats, can be added using the extensible metadata platform (XMP). This allows metadata to be attached to any word stream in the document, such as with respect to adding an incoming animation, special camera picture elements are implemented.

Therefore, in the present embodiment, editing of a live document can be achieved by attaching additional metadata describing a target replacement effect to a content element to be replaced, resulting in an edited live document.

305. And the terminal displays a live broadcast picture at the first live broadcast client and sends the live broadcast picture to the server, wherein the live broadcast picture comprises the edited live broadcast document.

In an embodiment, after acquiring the edited live document, the terminal where the anchor live client is located may read and parse the additional metadata describing the target replacement effect from the edited live document. And, the metadata may be parsed based on the identified node in the additional metadata to determine the type attribute and the content information of the target replacement content element. Further, the terminal may generate a target replacement content element of the content elements to be replaced according to the type attribute and the content information.

In the live broadcasting process, when the terminal displays the edited live broadcasting document on a conference content page of the anchor live broadcasting client, the terminal can use a picture source described by the additional metadata for rendering, namely, the content element to be replaced is replaced by the corresponding target replacement content element.

Meanwhile, the anchor live broadcast client can send the live broadcast picture on the anchor live broadcast client to the server, so that the server can send the live broadcast picture to a second live broadcast client, namely, a viewer live broadcast client, and live broadcast is realized.

It should be noted that, in practical applications, the editor may be designed to complete steps 302 and 303, and the viewer may be designed to complete step 304, and the portion of "show live view on first live client" in step 305.

306. And the server sends the live broadcast picture to a second live broadcast client so that the second live broadcast client displays the live broadcast picture.

In this embodiment, the second live broadcast client may be a live broadcast client of the viewer, and since the content element in the live broadcast document is replaced, a target replacement content element, that is, a replaced effect, is presented in a live broadcast picture received by the live broadcast client of the viewer.

As can be seen from the above, the embodiment of the application can efficiently replace the content element in the live document with the target replacement content element. Specifically, the scheme can determine additional metadata describing a target replacement effect based on an editing operation on a content element, and further determine a target replacement content element based on the additional metadata and the content element to be replaced, thereby realizing element replacement of a live document. In this way, by determining the additional metadata based on the editing operation on the content element, the additional metadata can be made to be an information carrier describing the target replacement effect desired by the user, that is, the user can present the target replacement effect desired by the user through the generated additional metadata by only performing a simple editing operation, such as a selection operation, on the content element. Furthermore, the scheme can realize element replacement by attaching the generated additional metadata to the content element to be replaced, and display the replacement effect in the live broadcast process, so that the element replacement can be realized on the basis of not damaging the original document content in the live broadcast document. Therefore, the processing efficiency of the live broadcast document is improved, the processing mode of the live broadcast document is improved, and the live broadcast can be carried out efficiently.

In addition, the scheme is applied to a live broadcast promotion scene, and a live broadcast document is a PDF (portable document format) file as an example, so that besides only one path of video picture can be sent to a second live broadcast client, the utilization rate of computing resources is improved, two rectangular pages do not need to be displayed in one rectangular screen, the layout of the second live broadcast client is improved, and the utilization rate of screen space is improved.

In addition, according to the scheme, by designing the editor and the reader for the live broadcast document, the display effect can be set by restoring the editor through the reader besides adding content elements including camera pictures or video pictures and content elements with dynamic display effects to the live broadcast document such as a PDF (portable document format) file, so that the live broadcast can be more efficiently carried out.

In order to better implement the method, correspondingly, the embodiment of the application also provides a live broadcast document processing device, wherein the live broadcast document processing device can be integrated in a terminal. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like.

For example, as shown in fig. 4a, the live document processing apparatus may include a page display unit 401 and a document display unit 402 as follows:

a page display unit 401, configured to display a live document editing page, where the live document editing page includes a content editing area, and the content editing area includes at least one content element of a live document;

a document display unit 402, configured to display, in response to an operation on the content element, an editing control corresponding to the content element, and display, in a live broadcast process, an edited live broadcast document based on the editing operation on the editing control, where the edited live broadcast document is a live broadcast document in which the content element is replaced with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

In an embodiment, referring to fig. 4b, the document display unit 402 may include:

a list display subunit 4021, configured to display, in response to an operation on the content element, a replacement control list on the live document editing page, where the replacement control list includes at least one element replacement control;

a metadata generation subunit 4022, which may be configured to generate additional metadata describing a target replacement effect based on an element replacement operation for the element replacement control;

an appending subunit 4023, configured to append the appended metadata to the content element to obtain an edited live document;

the document display subunit 4024 may be configured to display the edited live document in a live process.

In an embodiment, the list display subunit 4021 may be configured to:

In one embodiment, the live document editing page includes an editing control menu, the editing control menu including at least one editing control; the list display subunit 4021 may be configured to:

In an embodiment, the metadata generation subunit 4022 may be configured to:

In an embodiment, the replacement control list includes an element replacement control corresponding to at least one data acquisition module, where the data acquisition module is configured to acquire real-time data shown in the target replacement content element; the metadata generation subunit 4022 may specifically be configured to:

In an embodiment, the replacement control list includes an element replacement control corresponding to at least one data acquisition module, where the data acquisition module is configured to acquire offline data shown in the target replacement content element; the metadata generation subunit 4022 may specifically be configured to:

In an embodiment, the replacement control list includes at least one element replacement control corresponding to the element display mode; the metadata generation subunit 4022 may specifically be configured to:

In an embodiment, the metadata generation subunit 4022 may specifically be configured to:

In an embodiment, the document display subunit 4024 may be configured to:

In an embodiment, the document display subunit 4024 may be specifically configured to:

In an embodiment, referring to fig. 4c, the page display unit 401 may include:

the first preparation display sub-unit 4011 may be configured to display a live broadcast preparation page of a live broadcast client, where the live broadcast preparation page includes a document import trigger control of a live broadcast document;

the first page display sub-unit 4012 may be configured to display a live document editing page based on an import trigger operation for the document import trigger control.

In an embodiment, referring to fig. 4d, the page display unit 401 may include:

the live broadcast display sub-unit 4013 may be configured to display a live broadcast page of a live broadcast client in a live broadcast process, where the live broadcast page includes a content display area of a live broadcast document and a document editing control for the live broadcast document;

the second page display sub-unit 4014 may be configured to display a live document editing page in response to a document editing operation with respect to the document editing control.

In an embodiment, referring to fig. 4e, the page display unit 401 may include:

a second preparation display sub-unit 4015, configured to display a live preparation page of a live client, where the live preparation page includes document link information of at least one live document;

a third page display sub-unit 4016 may be configured to display a live document editing page in response to a selection operation for the document link information.

In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.

As can be seen from the above, the page display unit 401 in the live document processing apparatus of the present embodiment displays a live document editing page, wherein the live document editing page includes a content editing area including at least one content element of a live document; and displaying, by the document display unit 402, an editing control corresponding to the content element in response to an operation on the content element, and displaying, in a live broadcast process, an edited live broadcast document based on the editing operation on the editing control, where the edited live broadcast document is a live broadcast document in which the content element is replaced with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

In addition, the embodiment of the present application further provides a computer device, which may be a server or a terminal, where the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as cloud service, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, CDN, and big data and artificial intelligence platform. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. Fig. 5 is a schematic diagram showing a structure of a computer device according to an embodiment of the present application, specifically:

the computer device may include components such as memory 501 including one or more computer-readable storage media, input unit 502, display unit 503, audio circuitry 504, Wireless Fidelity (WiFi) module 505, processor 506 including one or more processing cores, and power supply 507. Those skilled in the art will appreciate that the computer device configuration illustrated in FIG. 5 does not constitute a limitation of computer devices, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. Wherein:

the memory 501 may be used to store software programs and modules, and the processor 506 executes various functional applications and data processing by operating the software programs and modules stored in the memory 501. The memory 501 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the computer device, and the like. Further, the memory 501 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 501 may also include a memory controller to provide the processor 506 and the input unit 502 access to the memory 501.

The input unit 502 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in one particular embodiment, the input unit 502 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 506, and can receive and execute commands sent by the processor 506. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 502 may include other input devices in addition to a touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 503 may be used to display information input by or provided to a user and various graphical user interfaces of the computer device, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 503 may include a Display panel, and optionally, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 506 to determine the type of touch event, and then the processor 506 provides a corresponding visual output on the display panel according to the type of touch event. Although in FIG. 5 the touch-sensitive surface and the display panel are two separate components to implement input and output functions, in some embodiments the touch-sensitive surface may be integrated with the display panel to implement input and output functions.

Audio circuitry 504, a speaker, and a microphone may provide an audio interface between a user and a computer device. The audio circuit 504 may transmit the electrical signal converted from the received audio data to a speaker, and convert the electrical signal into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 504 and converted into audio data, which is then processed by the audio data output processor 506, and then transmitted to, for example, another computer device via the RF circuit 501, or the audio data is output to the memory 501 for further processing. The audio circuitry 504 may also include an earbud jack to provide communication of peripheral headphones with the computer device.

WiFi belongs to short-range wireless transmission technology, and the computer device can help the user send and receive e-mail, browse web pages, access streaming media, etc. through the WiFi module 505, which provides wireless broadband internet access for the user. Although fig. 5 shows the WiFi module 505, it is understood that it does not belong to the essential constitution of the computer device, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 506 is a control center of the computer device, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the computer device and processes data by operating or executing software programs and/or modules stored in the memory 501 and calling data stored in the memory 501, thereby performing overall monitoring of the mobile phone. Optionally, processor 506 may include one or more processing cores; preferably, the processor 506 may integrate an application processor, which mainly handles operating systems, user interfaces, applications, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 506.

The computer device also includes a power supply 507 (e.g., a battery) for powering the various components, which may preferably be logically connected to the processor 506 via a power management system that may be used to manage charging, discharging, and power consumption management functions. The power supply 507 may also include any component including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the computer device may further include a camera, a bluetooth module, etc., which will not be described herein. Specifically, in this embodiment, the processor 506 in the computer device loads the executable file corresponding to the process of one or more application programs into the memory 501 according to the following instructions, and the processor 506 runs the application programs stored in the memory 501, so as to implement various functions as follows:

displaying a live document editing page, wherein the live document editing page comprises a content editing area, and the content editing area comprises at least one content element of a live document; and displaying an editing control corresponding to the content element in response to the operation aiming at the content element, and displaying an edited live broadcast document in a live broadcast process based on the editing operation aiming at the editing control, wherein the edited live broadcast document is a live broadcast document obtained by replacing the content element with a target replacement content element, the target replacement content element is determined based on additional metadata and the content element, and the additional metadata is determined based on the editing operation.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

As can be seen from the above, the computer device of the present embodiment can efficiently replace a content element in a live document with a target replacement content element. Specifically, the scheme can determine additional metadata describing a target replacement effect based on an editing operation on a content element, and further determine a target replacement content element based on the additional metadata and the content element to be replaced, thereby realizing element replacement of a live document. In this way, by determining the additional metadata based on the editing operation on the content element, the additional metadata can be made to be an information carrier describing the target replacement effect desired by the user, that is, the user can present the target replacement effect desired by the user through the generated additional metadata by only performing a simple editing operation, such as a selection operation, on the content element. Furthermore, the scheme can realize element replacement by attaching the generated additional metadata to the content element to be replaced, and display the replacement effect in the live broadcast process, so that the element replacement can be realized on the basis of not damaging the original document content in the live broadcast document. Therefore, the computer equipment of the embodiment improves the processing efficiency of the live broadcast document, improves the processing mode of the live broadcast document, and enables the live broadcast to be carried out efficiently.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, the present application provides a storage medium, where a plurality of instructions are stored, where the instructions can be loaded by a processor to execute the steps in any one of the live document processing methods provided in the present application. For example, the instructions may perform the steps of:

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the instructions stored in the storage medium can execute the steps in any live broadcast document processing method provided in the embodiment of the present application, beneficial effects that can be achieved by any live broadcast document processing method provided in the embodiment of the present application can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.

According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the methods provided in the various alternative implementations of the live document processing aspect described above.

The method and the device for processing the live broadcast document provided by the embodiment of the application are described in detail, a specific example is applied in the description to explain the principle and the implementation of the application, and the description of the embodiment is only used for helping to understand the method and the core idea of the application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A live document processing method is characterized by comprising the following steps:

2. The live document processing method according to claim 1, wherein an editing control corresponding to the content element is displayed in response to an operation on the content element, and an edited live document is displayed in a live process based on the editing operation on the editing control, and the method includes:

displaying a list of replacement controls on the live document editing page in response to the operation on the content element, wherein the list of replacement controls includes at least one element replacement control;

adding the additional metadata to the content element to obtain an edited live broadcast document;

3. The live document processing method of claim 2, wherein displaying a list of replacement controls on the live document editing page in response to the operation on the content element, wherein the list of replacement controls includes at least one element replacement control, comprises:

displaying an editing control list on the live document editing page in response to the editing operation aiming at the content element, wherein the editing control list comprises a replacement triggering control;

4. The live document processing method of claim 2, wherein the live document editing page includes an editing control menu, the editing control menu including at least one editing control;

in response to the operation on the content element, displaying a list of replacement controls on the live document editing page, wherein the list of replacement controls includes at least one element replacement control, including:

displaying a replacement trigger control in the editing control menu in response to an editing operation for the content element;

5. The live document processing method according to claim 2, wherein generating additional metadata describing a target replacement effect based on an element replacement operation for the element replacement control includes:

determining private description data describing the target replacement content element based on an element replacement operation for the element replacement control, wherein the private description data comprises a type attribute and content information of the target replacement content element;

generating additional metadata describing a target replacement effect according to the content element, the type attribute, and the content information.

6. The live document processing method according to claim 5, wherein the replacement control list includes an element replacement control corresponding to at least one data collection module, and the data collection module is configured to collect real-time data shown in the target replacement content element;

determining private description data describing the target replacement content element based on an element replacement operation for the element replacement control, wherein the private description data includes a type attribute and content information of the target replacement content element, including:

displaying a device selection window required by the determined data acquisition device on the live document editing page, wherein the device selection window comprises at least one candidate data acquisition device;

and in response to a device selection completion operation for the device selection window, determining content information corresponding to the target replacement content element, wherein the content information includes acquisition path information of the real-time data.

7. The live document processing method according to claim 5, wherein the replacement control list includes an element replacement control corresponding to at least one data collection module, and the data collection module is configured to collect offline data shown in the target replacement content element;

displaying an offline file selection window required for acquiring the offline data on the live document editing page;

determining an offline file selected by a user through the offline file selection window, wherein the offline file comprises the offline data;

and in response to a file selection completion operation for the offline file selection window, determining content information corresponding to the target replacement content element, wherein the content information includes acquisition path information of the offline file.

8. The live document processing method according to claim 5, wherein the replacement control list includes at least one element replacement control corresponding to the element display mode;

and determining content information corresponding to the target replacement content element based on an element display mode corresponding to the target replacement content element, wherein the content information comprises display effect information corresponding to the target replacement content element in the element display mode.

9. The live document processing method according to claim 5, wherein generating additional metadata describing a target substitution effect from the content element, the genre attribute, and the content information includes:

and injecting the content information into the marked metadata generation template to generate additional metadata describing the target replacement effect.

10. The live document processing method according to claim 2, wherein displaying the edited live document during live broadcasting includes:

acquiring the edited live broadcast document, wherein the edited live broadcast document comprises content elements, and the content elements are added with additional metadata describing a target replacement effect;

and replacing the content element with the target replacement content element to obtain a replaced live broadcast document so that the live broadcast client displays the replaced live broadcast document in the live broadcast process.

11. The live document processing method according to claim 10, wherein generating a target substitute content element of the content element based on the type attribute and the content information includes:

and filling the display data into the target replacement content element of the element type to generate a target replacement content element of the content elements.

12. The live document processing method of claim 1, wherein displaying a live document editing page includes:

and displaying a live document editing page based on the importing triggering operation aiming at the document importing triggering control.

13. The live document processing method of claim 1, wherein displaying a live document editing page includes:

and responding to the document editing operation aiming at the document editing control, and displaying a live document editing page.

14. The live document processing method of claim 1, wherein displaying a live document editing page includes:

and responding to the selection operation of the document link information, and displaying a live document editing page.

15. A live document processing apparatus, comprising: